2023-06-09T04:23:03.600 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T04:23:03.601 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299736 --verbose --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_xiubli@teuthology --name xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi -- /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299736/orig.config.yaml 2023-06-09T04:23:03.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-09T04:23:03.736 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299736 branch: wip-lxb-fscrypt-20230607-0901 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7299736' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-lxb-fscrypt-20230607-0901 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lxb-fscrypt-20230607-0901 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b owner: scheduled_xiubli@teuthology priority: 110 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-lxb-fscrypt-20230607-0901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi149.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi184.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-09_04:16:27 tube: smithi user: xiubli verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-09T04:23:03.736 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa; will attempt to use it 2023-06-09T04:23:03.737 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa/tasks 2023-06-09T04:23:03.738 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-09T04:23:03.739 INFO:teuthology.task.internal:Checking packages... 2023-06-09T04:23:03.772 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a02638f808b8fe11bccdd01222c0e6e2eb71120b' 2023-06-09T04:23:03.772 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-09T04:23:03.773 INFO:teuthology.packaging:ref: None 2023-06-09T04:23:03.773 INFO:teuthology.packaging:tag: None 2023-06-09T04:23:03.773 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:03.773 INFO:teuthology.packaging:sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:23:03.774 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:04.128 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4313.ga02638f8 2023-06-09T04:23:04.128 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-09T04:23:04.135 INFO:teuthology.task.internal:no buildpackages task found 2023-06-09T04:23:04.135 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-09T04:23:04.150 INFO:teuthology.task.internal:Saving configuration 2023-06-09T04:23:04.166 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-09T04:23:04.172 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T04:23:04.198 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299736', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:34.016415', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-09T04:23:04.226 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299736', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:34.014853', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-06-09T04:23:04.227 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-09T04:23:04.233 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-09T04:23:04.233 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-09T04:23:04.233 INFO:teuthology.run_tasks:Running task console_log... 2023-06-09T04:23:04.317 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee5e1aef70>, signals=[15]) 2023-06-09T04:23:04.319 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-09T04:23:04.325 INFO:teuthology.task.internal:Opening connections... 2023-06-09T04:23:04.325 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:23:04.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:04.395 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:23:04.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:04.463 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-09T04:23:04.470 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-06-09T04:23:04.490 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-06-09T04:23:04.491 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-06-09T04:23:04.550 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T04:23:04.550 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T04:23:04.550 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-06-09T04:23:04.551 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-06-09T04:23:04.551 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.6" 2023-06-09T04:23:04.551 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-06-09T04:23:04.551 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T04:23:04.551 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-06-09T04:23:04.551 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T04:23:04.551 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T04:23:04.552 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T04:23:04.552 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T04:23:04.552 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:23:04.552 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T04:23:04.552 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T04:23:04.552 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T04:23:04.552 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T04:23:04.553 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-06-09T04:23:04.577 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-06-09T04:23:04.597 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-06-09T04:23:04.597 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-06-09T04:23:04.656 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T04:23:04.656 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T04:23:04.656 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-06-09T04:23:04.656 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-06-09T04:23:04.657 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2023-06-09T04:23:04.657 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-06-09T04:23:04.657 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T04:23:04.657 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-06-09T04:23:04.657 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T04:23:04.657 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T04:23:04.657 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T04:23:04.658 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T04:23:04.658 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:23:04.658 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T04:23:04.658 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T04:23:04.658 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T04:23:04.658 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T04:23:04.659 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-06-09T04:23:04.684 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-09T04:23:04.694 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-09T04:23:04.702 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-09T04:23:04.702 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:04.705 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:04.722 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-09T04:23:04.729 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-09T04:23:04.729 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:04.763 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:04.792 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-09T04:23:04.851 INFO:teuthology.run_tasks:Running task kernel... 2023-06-09T04:23:04.867 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-06-09T04:23:04.868 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-06-09T04:23:04.869 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-06-09T04:23:04.869 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:04.870 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:04.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:04.887 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2023-06-09T04:23:04.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:04.888 DEBUG:teuthology.orchestra.run.smithi149:> uname -r 2023-06-09T04:23:04.944 INFO:teuthology.orchestra.run.smithi184.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:04.945 INFO:teuthology.task.kernel:Running kernel on smithi184: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:04.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2023-06-09T04:23:04.946 INFO:teuthology.orchestra.run.smithi149.stdout:4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:04.946 INFO:teuthology.task.kernel:Running kernel on smithi149: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:04.947 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y kernel 2023-06-09T04:23:06.147 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-06-09T04:23:06.148 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-06-09T04:23:06.164 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-06-09T04:23:06.164 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-06-09T04:23:09.326 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2023-06-09T04:23:09.964 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-09T04:23:10.967 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 16 MB 00:01 2023-06-09T04:23:11.198 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-06-09T04:23:14.392 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 392 kB/s | 24 kB 00:00 2023-06-09T04:23:14.764 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 418 kB/s | 24 kB 00:00 2023-06-09T04:23:15.086 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-06-09T04:23:15.145 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-06-09T04:23:15.146 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2023-06-09T04:23:15.146 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-06-09T04:23:15.278 DEBUG:teuthology.orchestra.run.smithi184:> echo no | sudo yum reinstall kernel || true 2023-06-09T04:23:15.450 INFO:teuthology.orchestra.run.smithi149.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-06-09T04:23:15.507 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-06-09T04:23:15.508 INFO:teuthology.orchestra.run.smithi149.stdout:Nothing to do. 2023-06-09T04:23:15.509 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-06-09T04:23:15.647 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-06-09T04:23:15.647 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-06-09T04:23:15.654 DEBUG:teuthology.orchestra.run.smithi149:> echo no | sudo yum reinstall kernel || true 2023-06-09T04:23:15.906 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:01 ago on Fri 09 Jun 2023 04:23:14 AM UTC. 2023-06-09T04:23:15.955 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:23:15.987 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-06-09T04:23:15.988 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-06-09T04:23:15.998 INFO:teuthology.orchestra.run.smithi184.stderr:Error: No packages marked for reinstall. 2023-06-09T04:23:16.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum reinstall -y kernel || true 2023-06-09T04:23:16.253 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:02 ago on Fri 09 Jun 2023 04:23:14 AM UTC. 2023-06-09T04:23:16.295 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:23:16.343 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-06-09T04:23:16.374 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-06-09T04:23:16.375 INFO:teuthology.orchestra.run.smithi184.stdout:Unable to read consumer identity 2023-06-09T04:23:16.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum reinstall -y kernel || true 2023-06-09T04:23:16.630 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:02 ago on Fri 09 Jun 2023 04:23:14 AM UTC. 2023-06-09T04:23:16.669 INFO:teuthology.orchestra.run.smithi184.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:23:16.699 INFO:teuthology.orchestra.run.smithi184.stderr:Error: No packages marked for reinstall. 2023-06-09T04:23:16.724 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-06-09T04:23:16.724 INFO:teuthology.orchestra.run.smithi149.stdout:Unable to read consumer identity 2023-06-09T04:23:16.745 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2023-06-09T04:23:16.855 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:16.855 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:16.856 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-06-09T04:23:16.856 DEBUG:teuthology.parallel:result is None 2023-06-09T04:23:16.984 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:00:02 ago on Fri 09 Jun 2023 04:23:14 AM UTC. 2023-06-09T04:23:17.026 INFO:teuthology.orchestra.run.smithi149.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-06-09T04:23:17.066 INFO:teuthology.orchestra.run.smithi149.stderr:Error: No packages marked for reinstall. 2023-06-09T04:23:17.114 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q kernel | sort -rV | head -n 1 2023-06-09T04:23:17.196 INFO:teuthology.orchestra.run.smithi149.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:17.196 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-06-09T04:23:17.197 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-06-09T04:23:17.197 DEBUG:teuthology.parallel:result is None 2023-06-09T04:23:17.197 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-09T04:23:17.205 INFO:teuthology.task.internal:Creating test directory... 2023-06-09T04:23:17.205 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:23:17.207 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:23:17.224 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-09T04:23:17.230 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-09T04:23:17.238 INFO:teuthology.task.internal:Creating archive directory... 2023-06-09T04:23:17.239 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:23:17.263 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:23:17.287 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-09T04:23:17.295 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-09T04:23:17.296 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:23:17.321 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:23:17.358 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:23:17.361 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:23:17.373 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:23:17.376 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:23:17.377 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-09T04:23:17.384 INFO:teuthology.task.internal:Configuring sudo... 2023-06-09T04:23:17.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:23:17.420 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:23:17.447 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-09T04:23:17.456 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-09T04:23:17.456 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:23:17.486 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:23:17.503 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:23:17.587 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:23:17.644 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:23:17.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:23:17.727 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:23:17.728 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:23:17.794 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:23:17.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:23:17.914 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:23:17.958 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:23:17.998 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:23:17.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:23:18.078 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2023-06-09T04:23:18.080 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2023-06-09T04:23:18.144 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-09T04:23:18.190 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-09T04:23:18.643 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-09T04:23:18.659 INFO:teuthology.task.internal:Starting timer... 2023-06-09T04:23:18.660 INFO:teuthology.run_tasks:Running task pcp... 2023-06-09T04:23:18.670 INFO:teuthology.run_tasks:Running task selinux... 2023-06-09T04:23:18.682 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-06-09T04:23:18.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2023-06-09T04:23:18.748 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2023-06-09T04:23:18.749 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2023-06-09T04:23:18.807 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2023-06-09T04:23:18.808 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-09T04:23:18.809 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2023-06-09T04:23:18.837 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2023-06-09T04:23:18.837 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2023-06-09T04:23:18.861 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2023-06-09T04:23:18.862 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi149.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2023-06-09T04:23:18.862 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-09T04:23:18.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:18.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-09T04:23:18.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:18.934 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-09T04:23:18.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2023-06-09T04:23:18.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2023-06-09T04:23:19.014 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-09T04:23:19.022 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-09T04:23:19.023 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-09T04:23:19.043 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-09T04:23:19.044 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi149.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-09T04:31:37.515 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2023-06-09T04:31:37.517 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-09T04:31:37.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:31:37.586 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-06-09T04:31:37.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-06-09T04:31:37.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:31:37.722 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-06-09T04:31:37.795 INFO:teuthology.run_tasks:Running task clock... 2023-06-09T04:31:37.813 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-09T04:31:37.814 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:31:37.814 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:31:37.816 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:31:37.817 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:31:37.846 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-09T04:31:37.860 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-09T04:31:37.870 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-09T04:31:37.885 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-09T04:31:37.939 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2023-06-09T04:31:37.950 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2023-06-09T04:31:37.964 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-09T04:31:37.965 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2023-06-09T04:31:37.977 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2023-06-09T04:31:37.978 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-09T04:31:37.992 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-09T04:31:38.006 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-09T04:31:38.048 INFO:teuthology.orchestra.run.smithi149.stderr:bash: ntpq: command not found 2023-06-09T04:31:38.051 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-09T04:31:38.051 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2023-06-09T04:31:38.051 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.051 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.052 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.052 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.079 INFO:teuthology.orchestra.run.smithi184.stderr:bash: ntpq: command not found 2023-06-09T04:31:38.082 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-09T04:31:38.082 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2023-06-09T04:31:38.082 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.083 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.083 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.083 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-09T04:31:38.084 INFO:teuthology.run_tasks:Running task install... 2023-06-09T04:31:38.092 DEBUG:teuthology.task.install:project ceph 2023-06-09T04:31:38.092 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}} 2023-06-09T04:31:38.093 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'} 2023-06-09T04:31:38.093 INFO:teuthology.task.install:Using flavor: default 2023-06-09T04:31:38.102 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-09T04:31:38.103 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-09T04:31:38.103 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-09T04:31:38.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:31:38.106 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'tag': None, 'wait_for_package': False} 2023-06-09T04:31:38.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:31:38.384 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-09T04:31:38.384 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-09T04:31:38.389 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/ 2023-06-09T04:31:38.389 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4313.ga02638f8 2023-06-09T04:31:38.504 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-09T04:31:38.504 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:31:38.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-09T04:31:38.532 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-09T04:31:38.532 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-09T04:31:38.556 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-09T04:31:38.556 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:31:38.557 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-09T04:31:38.584 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-09T04:31:38.585 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a02638f808b8fe11bccdd01222c0e6e2eb71120b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-09T04:31:38.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-09T04:31:38.653 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-09T04:31:38.677 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-09T04:31:38.730 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-09T04:31:38.742 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2023-06-09T04:31:38.744 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2023-06-09T04:31:38.796 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2023-06-09T04:31:38.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2023-06-09T04:31:39.114 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-06-09T04:31:39.168 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-06-09T04:31:39.386 INFO:teuthology.orchestra.run.smithi149.stdout:44 files removed 2023-06-09T04:31:39.403 INFO:teuthology.orchestra.run.smithi184.stdout:44 files removed 2023-06-09T04:31:39.433 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-09T04:31:39.449 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-09T04:31:39.766 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-06-09T04:31:39.779 INFO:teuthology.orchestra.run.smithi184.stdout:Updating Subscription Management repositories. 2023-06-09T04:31:40.557 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 202 kB/s | 80 kB 00:00 2023-06-09T04:31:40.567 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 192 kB/s | 80 kB 00:00 2023-06-09T04:31:40.932 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-06-09T04:31:40.967 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-06-09T04:31:41.283 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-06-09T04:31:41.352 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 4.1 kB/s | 1.5 kB 00:00 2023-06-09T04:31:43.809 INFO:teuthology.orchestra.run.smithi149.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-09T04:31:43.885 INFO:teuthology.orchestra.run.smithi184.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-09T04:31:44.676 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-06-09T04:31:48.143 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-06-09T04:31:48.921 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 3.1 MB/s | 16 MB 00:05 2023-06-09T04:31:49.086 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-06-09T04:31:52.408 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 284 kB/s | 24 kB 00:00 2023-06-09T04:31:53.313 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-06-09T04:31:57.179 INFO:teuthology.orchestra.run.smithi149.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-06-09T04:32:01.209 INFO:teuthology.orchestra.run.smithi184.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-06-09T04:32:08.251 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:32:08.252 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:32:08.266 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-09T04:32:08.267 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-09T04:32:08.268 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-09T04:32:08.269 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:32:08.272 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:32:08.275 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-09T04:32:08.276 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:32:08.406 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-06-09T04:32:08.418 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-06-09T04:32:08.419 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-06-09T04:32:08.419 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-06-09T04:32:08.419 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-06-09T04:32:08.419 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-09T04:32:08.419 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-09T04:32:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-09T04:32:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-09T04:32:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-09T04:32:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-09T04:32:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-09T04:32:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-09T04:32:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-09T04:32:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-09T04:32:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-09T04:32:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-09T04:32:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-09T04:32:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-09T04:32:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-09T04:32:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-09T04:32:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-09T04:32:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-09T04:32:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-09T04:32:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-09T04:32:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-09T04:32:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-09T04:32:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-09T04:32:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-09T04:32:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-09T04:32:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-09T04:32:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-09T04:32:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-09T04:32:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-09T04:32:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-09T04:32:08.424 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-06-09T04:32:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-09T04:32:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-09T04:32:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-09T04:32:08.425 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-06-09T04:32:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-09T04:32:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-09T04:32:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-09T04:32:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-09T04:32:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-09T04:32:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-09T04:32:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-09T04:32:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-09T04:32:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-09T04:32:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-09T04:32:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-09T04:32:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-09T04:32:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-09T04:32:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-09T04:32:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-09T04:32:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-09T04:32:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-09T04:32:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-09T04:32:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-09T04:32:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-09T04:32:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-09T04:32:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-09T04:32:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-09T04:32:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-09T04:32:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-09T04:32:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-09T04:32:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-09T04:32:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-09T04:32:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-09T04:32:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-09T04:32:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-09T04:32:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-09T04:32:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-09T04:32:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-09T04:32:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-09T04:32:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-09T04:32:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-09T04:32:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-09T04:32:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-09T04:32:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-09T04:32:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-09T04:32:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-09T04:32:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-09T04:32:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-09T04:32:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-09T04:32:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-09T04:32:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-09T04:32:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-09T04:32:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-09T04:32:08.437 INFO:teuthology.orchestra.run.smithi149.stdout:Enabling module streams: 2023-06-09T04:32:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql 10 2023-06-09T04:32:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:32:08.438 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-06-09T04:32:08.438 INFO:teuthology.orchestra.run.smithi149.stdout:=========================================================================================================================== 2023-06-09T04:32:08.439 INFO:teuthology.orchestra.run.smithi149.stdout:Install 128 Packages 2023-06-09T04:32:08.439 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 3 Packages 2023-06-09T04:32:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:32:08.439 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 197 M 2023-06-09T04:32:08.440 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-06-09T04:32:08.620 INFO:teuthology.orchestra.run.smithi149.stdout:(1/131): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2023-06-09T04:32:08.821 INFO:teuthology.orchestra.run.smithi149.stdout:(2/131): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 4.1 MB/s | 848 kB 00:00 2023-06-09T04:32:08.871 INFO:teuthology.orchestra.run.smithi149.stdout:(3/131): ceph-immutable-object-cache-18.0.0-431 3.3 MB/s | 166 kB 00:00 2023-06-09T04:32:09.130 INFO:teuthology.orchestra.run.smithi149.stdout:(4/131): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 8.8 MB/s | 2.3 MB 00:00 2023-06-09T04:32:09.272 INFO:teuthology.orchestra.run.smithi149.stdout:(5/131): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 11 MB/s | 1.5 MB 00:00 2023-06-09T04:32:09.672 INFO:teuthology.orchestra.run.smithi149.stdout:(6/131): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 12 MB/s | 4.6 MB 00:00 2023-06-09T04:32:09.747 INFO:teuthology.orchestra.run.smithi149.stdout:(7/131): ceph-base-18.0.0-4313.ga02638f8.el8.x8 4.3 MB/s | 5.4 MB 00:01 2023-06-09T04:32:11.081 INFO:teuthology.orchestra.run.smithi149.stdout:(8/131): ceph-osd-18.0.0-4313.ga02638f8.el8.x86 13 MB/s | 18 MB 00:01 2023-06-09T04:32:11.139 INFO:teuthology.orchestra.run.smithi149.stdout:(9/131): ceph-selinux-18.0.0-4313.ga02638f8.el8 420 kB/s | 24 kB 00:00 2023-06-09T04:32:11.773 INFO:teuthology.orchestra.run.smithi149.stdout:(10/131): ceph-radosgw-18.0.0-4313.ga02638f8.el 6.4 MB/s | 13 MB 00:02 2023-06-09T04:32:12.015 INFO:teuthology.orchestra.run.smithi149.stdout:(11/131): ceph-common-18.0.0-4313.ga02638f8.el8 6.2 MB/s | 22 MB 00:03 2023-06-09T04:32:12.040 INFO:teuthology.orchestra.run.smithi149.stdout:(12/131): cephfs-mirror-18.0.0-4313.ga02638f8.e 968 kB/s | 258 kB 00:00 2023-06-09T04:32:12.082 INFO:teuthology.orchestra.run.smithi149.stdout:(13/131): libcephfs-devel-18.0.0-4313.ga02638f8 465 kB/s | 31 kB 00:00 2023-06-09T04:32:12.166 INFO:teuthology.orchestra.run.smithi149.stdout:(14/131): libcephfs2-18.0.0-4313.ga02638f8.el8. 6.0 MB/s | 771 kB 00:00 2023-06-09T04:32:12.191 INFO:teuthology.orchestra.run.smithi149.stdout:(15/131): libcephsqlite-18.0.0-4313.ga02638f8.e 1.2 MB/s | 137 kB 00:00 2023-06-09T04:32:12.227 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:32:12.228 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-09T04:32:12.243 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-06-09T04:32:12.244 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-06-09T04:32:12.244 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-06-09T04:32:12.246 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:32:12.248 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:32:12.251 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-09T04:32:12.252 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:32:12.333 INFO:teuthology.orchestra.run.smithi149.stdout:(16/131): librados-devel-18.0.0-4313.ga02638f8. 832 kB/s | 139 kB 00:00 2023-06-09T04:32:12.375 INFO:teuthology.orchestra.run.smithi149.stdout:(17/131): libradosstriper1-18.0.0-4313.ga02638f 2.5 MB/s | 473 kB 00:00 2023-06-09T04:32:12.391 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2023-06-09T04:32:12.403 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-06-09T04:32:12.404 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2023-06-09T04:32:12.404 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-06-09T04:32:12.405 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2023-06-09T04:32:12.405 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-06-09T04:32:12.405 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-06-09T04:32:12.405 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.4 k 2023-06-09T04:32:12.406 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 5.4 M 2023-06-09T04:32:12.406 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 848 k 2023-06-09T04:32:12.406 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 166 k 2023-06-09T04:32:12.406 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 1.5 M 2023-06-09T04:32:12.406 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 128 k 2023-06-09T04:32:12.407 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 1.7 M 2023-06-09T04:32:12.407 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 7.4 M 2023-06-09T04:32:12.407 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 47 k 2023-06-09T04:32:12.408 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 13 M 2023-06-09T04:32:12.408 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 41 M 2023-06-09T04:32:12.408 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 258 k 2023-06-09T04:32:12.408 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 160 k 2023-06-09T04:32:12.409 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 258 k 2023-06-09T04:32:12.409 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 18 k 2023-06-09T04:32:12.409 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-06-09T04:32:12.409 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-06-09T04:32:12.409 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-06-09T04:32:12.409 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 31 k 2023-06-09T04:32:12.409 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 771 k 2023-06-09T04:32:12.410 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 139 k 2023-06-09T04:32:12.410 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-06-09T04:32:12.410 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-06-09T04:32:12.410 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-06-09T04:32:12.410 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-06-09T04:32:12.410 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-06-09T04:32:12.410 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 197 k 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 370 k 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 365 k 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 107 k 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 94 k 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.4 M 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 179 k 2023-06-09T04:32:12.411 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-06-09T04:32:12.412 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2023-06-09T04:32:12.412 INFO:teuthology.orchestra.run.smithi184.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-06-09T04:32:12.412 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.7 M 2023-06-09T04:32:12.412 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 3.6 M 2023-06-09T04:32:12.412 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2023-06-09T04:32:12.412 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-06-09T04:32:12.412 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 22 M 2023-06-09T04:32:12.413 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 23 k 2023-06-09T04:32:12.413 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 2.3 M 2023-06-09T04:32:12.413 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 240 k 2023-06-09T04:32:12.413 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 4.6 M 2023-06-09T04:32:12.413 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 18 M 2023-06-09T04:32:12.413 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4313.ga02638f8.el8 ceph-noarch 15 k 2023-06-09T04:32:12.413 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 24 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 137 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-06-09T04:32:12.414 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-06-09T04:32:12.415 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-09T04:32:12.415 INFO:teuthology.orchestra.run.smithi184.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-06-09T04:32:12.415 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-06-09T04:32:12.415 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-06-09T04:32:12.415 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 473 k 2023-06-09T04:32:12.415 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-06-09T04:32:12.415 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 6.5 M 2023-06-09T04:32:12.416 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-06-09T04:32:12.416 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-06-09T04:32:12.416 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-09T04:32:12.416 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-06-09T04:32:12.416 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-06-09T04:32:12.416 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-06-09T04:32:12.416 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-09T04:32:12.417 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-09T04:32:12.418 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-09T04:32:12.418 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 45 k 2023-06-09T04:32:12.418 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:18.0.0-4313.ga02638f8.el8 ceph 119 k 2023-06-09T04:32:12.418 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-09T04:32:12.418 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-06-09T04:32:12.418 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-06-09T04:32:12.419 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-06-09T04:32:12.420 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:32:12.420 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-09T04:32:12.420 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-09T04:32:12.420 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-06-09T04:32:12.420 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-06-09T04:32:12.420 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-09T04:32:12.420 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-06-09T04:32:12.421 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-06-09T04:32:12.422 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-09T04:32:12.422 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-06-09T04:32:12.422 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-06-09T04:32:12.422 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-09T04:32:12.422 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-06-09T04:32:12.422 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-09T04:32:12.422 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-09T04:32:12.423 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-06-09T04:32:12.423 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-09T04:32:12.423 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-09T04:32:12.423 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-09T04:32:12.423 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-09T04:32:12.423 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-09T04:32:12.423 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-09T04:32:12.424 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-09T04:32:12.424 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-09T04:32:12.424 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-06-09T04:32:12.424 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-09T04:32:12.424 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-06-09T04:32:12.424 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-09T04:32:12.424 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-06-09T04:32:12.425 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-06-09T04:32:12.425 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-06-09T04:32:12.425 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling module streams: 2023-06-09T04:32:12.425 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql 10 2023-06-09T04:32:12.425 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:32:12.425 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2023-06-09T04:32:12.425 INFO:teuthology.orchestra.run.smithi184.stdout:=========================================================================================================================== 2023-06-09T04:32:12.426 INFO:teuthology.orchestra.run.smithi184.stdout:Install 128 Packages 2023-06-09T04:32:12.426 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 3 Packages 2023-06-09T04:32:12.426 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:32:12.426 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 197 M 2023-06-09T04:32:12.426 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2023-06-09T04:32:12.450 INFO:teuthology.orchestra.run.smithi149.stdout:(18/131): python3-ceph-argparse-18.0.0-4313.ga0 598 kB/s | 45 kB 00:00 2023-06-09T04:32:12.551 INFO:teuthology.orchestra.run.smithi149.stdout:(19/131): python3-ceph-common-18.0.0-4313.ga026 1.2 MB/s | 119 kB 00:00 2023-06-09T04:32:12.651 INFO:teuthology.orchestra.run.smithi149.stdout:(20/131): python3-cephfs-18.0.0-4313.ga02638f8. 1.9 MB/s | 197 kB 00:00 2023-06-09T04:32:12.655 INFO:teuthology.orchestra.run.smithi184.stdout:(1/131): ceph-18.0.0-4313.ga02638f8.el8.x86_64. 31 kB/s | 6.4 kB 00:00 2023-06-09T04:32:12.760 INFO:teuthology.orchestra.run.smithi149.stdout:(21/131): python3-rados-18.0.0-4313.ga02638f8.e 3.3 MB/s | 370 kB 00:00 2023-06-09T04:32:12.877 INFO:teuthology.orchestra.run.smithi149.stdout:(22/131): python3-rbd-18.0.0-4313.ga02638f8.el8 3.1 MB/s | 365 kB 00:00 2023-06-09T04:32:12.985 INFO:teuthology.orchestra.run.smithi149.stdout:(23/131): python3-rgw-18.0.0-4313.ga02638f8.el8 986 kB/s | 107 kB 00:00 2023-06-09T04:32:13.102 INFO:teuthology.orchestra.run.smithi149.stdout:(24/131): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 813 kB/s | 94 kB 00:00 2023-06-09T04:32:13.361 INFO:teuthology.orchestra.run.smithi149.stdout:(25/131): librgw2-18.0.0-4313.ga02638f8.el8.x86 6.4 MB/s | 6.5 MB 00:01 2023-06-09T04:32:13.397 INFO:teuthology.orchestra.run.smithi184.stdout:(2/131): ceph-fuse-18.0.0-4313.ga02638f8.el8.x8 1.1 MB/s | 848 kB 00:00 2023-06-09T04:32:13.461 INFO:teuthology.orchestra.run.smithi149.stdout:(26/131): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 1.8 MB/s | 179 kB 00:00 2023-06-09T04:32:13.506 INFO:teuthology.orchestra.run.smithi184.stdout:(3/131): ceph-immutable-object-cache-18.0.0-431 1.5 MB/s | 166 kB 00:00 2023-06-09T04:32:13.545 INFO:teuthology.orchestra.run.smithi149.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4313.g 277 kB/s | 23 kB 00:00 2023-06-09T04:32:13.670 INFO:teuthology.orchestra.run.smithi149.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4313.ga02638f 1.0 MB/s | 128 kB 00:00 2023-06-09T04:32:13.737 INFO:teuthology.orchestra.run.smithi149.stdout:(29/131): rbd-mirror-18.0.0-4313.ga02638f8.el8. 5.4 MB/s | 3.4 MB 00:00 2023-06-09T04:32:14.014 INFO:teuthology.orchestra.run.smithi184.stdout:(4/131): ceph-mds-18.0.0-4313.ga02638f8.el8.x86 4.5 MB/s | 2.3 MB 00:00 2023-06-09T04:32:14.112 INFO:teuthology.orchestra.run.smithi149.stdout:(30/131): ceph-test-18.0.0-4313.ga02638f8.el8.x 14 MB/s | 41 MB 00:02 2023-06-09T04:32:14.154 INFO:teuthology.orchestra.run.smithi149.stdout:(31/131): ceph-mgr-dashboard-18.0.0-4313.ga0263 3.5 MB/s | 1.7 MB 00:00 2023-06-09T04:32:14.171 INFO:teuthology.orchestra.run.smithi149.stdout:(32/131): ceph-mgr-modules-core-18.0.0-4313.ga0 4.0 MB/s | 240 kB 00:00 2023-06-09T04:32:14.173 INFO:teuthology.orchestra.run.smithi184.stdout:(5/131): ceph-base-18.0.0-4313.ga02638f8.el8.x8 3.1 MB/s | 5.4 MB 00:01 2023-06-09T04:32:14.231 INFO:teuthology.orchestra.run.smithi184.stdout:(6/131): ceph-mgr-18.0.0-4313.ga02638f8.el8.x86 7.1 MB/s | 1.5 MB 00:00 2023-06-09T04:32:14.244 INFO:teuthology.orchestra.run.smithi149.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4313.ga 201 kB/s | 15 kB 00:00 2023-06-09T04:32:14.272 INFO:teuthology.orchestra.run.smithi149.stdout:(34/131): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 405 kB/s | 47 kB 00:00 2023-06-09T04:32:14.314 INFO:teuthology.orchestra.run.smithi149.stdout:(35/131): ceph-volume-18.0.0-4313.ga02638f8.el8 3.6 MB/s | 258 kB 00:00 2023-06-09T04:32:14.364 INFO:teuthology.orchestra.run.smithi149.stdout:(36/131): cephadm-18.0.0-4313.ga02638f8.el8.noa 1.7 MB/s | 160 kB 00:00 2023-06-09T04:32:14.389 INFO:teuthology.orchestra.run.smithi149.stdout:(37/131): cephfs-top-18.0.0-4313.ga02638f8.el8. 239 kB/s | 18 kB 00:00 2023-06-09T04:32:14.737 INFO:teuthology.orchestra.run.smithi184.stdout:(7/131): ceph-mon-18.0.0-4313.ga02638f8.el8.x86 8.2 MB/s | 4.6 MB 00:00 2023-06-09T04:32:14.880 INFO:teuthology.orchestra.run.smithi149.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 6.5 MB/s | 7.4 MB 00:01 2023-06-09T04:32:15.848 INFO:teuthology.orchestra.run.smithi184.stdout:(8/131): ceph-radosgw-18.0.0-4313.ga02638f8.el8 12 MB/s | 13 MB 00:01 2023-06-09T04:32:16.007 INFO:teuthology.orchestra.run.smithi184.stdout:(9/131): ceph-osd-18.0.0-4313.ga02638f8.el8.x86 10 MB/s | 18 MB 00:01 2023-06-09T04:32:16.024 INFO:teuthology.orchestra.run.smithi184.stdout:(10/131): ceph-selinux-18.0.0-4313.ga02638f8.el 139 kB/s | 24 kB 00:00 2023-06-09T04:32:16.100 INFO:teuthology.orchestra.run.smithi184.stdout:(11/131): cephfs-mirror-18.0.0-4313.ga02638f8.e 3.4 MB/s | 258 kB 00:00 2023-06-09T04:32:16.167 INFO:teuthology.orchestra.run.smithi184.stdout:(12/131): libcephfs-devel-18.0.0-4313.ga02638f8 465 kB/s | 31 kB 00:00 2023-06-09T04:32:16.267 INFO:teuthology.orchestra.run.smithi184.stdout:(13/131): libcephfs2-18.0.0-4313.ga02638f8.el8. 7.5 MB/s | 771 kB 00:00 2023-06-09T04:32:16.334 INFO:teuthology.orchestra.run.smithi184.stdout:(14/131): libcephsqlite-18.0.0-4313.ga02638f8.e 2.0 MB/s | 137 kB 00:00 2023-06-09T04:32:16.414 INFO:teuthology.orchestra.run.smithi184.stdout:(15/131): librados-devel-18.0.0-4313.ga02638f8. 1.7 MB/s | 139 kB 00:00 2023-06-09T04:32:16.509 INFO:teuthology.orchestra.run.smithi184.stdout:(16/131): libradosstriper1-18.0.0-4313.ga02638f 4.9 MB/s | 473 kB 00:00 2023-06-09T04:32:17.277 INFO:teuthology.orchestra.run.smithi184.stdout:(17/131): librgw2-18.0.0-4313.ga02638f8.el8.x86 8.5 MB/s | 6.5 MB 00:00 2023-06-09T04:32:17.352 INFO:teuthology.orchestra.run.smithi184.stdout:(18/131): python3-ceph-argparse-18.0.0-4313.ga0 598 kB/s | 45 kB 00:00 2023-06-09T04:32:17.452 INFO:teuthology.orchestra.run.smithi184.stdout:(19/131): python3-ceph-common-18.0.0-4313.ga026 1.2 MB/s | 119 kB 00:00 2023-06-09T04:32:17.519 INFO:teuthology.orchestra.run.smithi184.stdout:(20/131): python3-cephfs-18.0.0-4313.ga02638f8. 2.9 MB/s | 197 kB 00:00 2023-06-09T04:32:17.603 INFO:teuthology.orchestra.run.smithi184.stdout:(21/131): python3-rados-18.0.0-4313.ga02638f8.e 4.3 MB/s | 370 kB 00:00 2023-06-09T04:32:17.686 INFO:teuthology.orchestra.run.smithi184.stdout:(22/131): python3-rbd-18.0.0-4313.ga02638f8.el8 4.3 MB/s | 365 kB 00:00 2023-06-09T04:32:17.786 INFO:teuthology.orchestra.run.smithi184.stdout:(23/131): python3-rgw-18.0.0-4313.ga02638f8.el8 1.0 MB/s | 107 kB 00:00 2023-06-09T04:32:17.866 INFO:teuthology.orchestra.run.smithi184.stdout:(24/131): rbd-fuse-18.0.0-4313.ga02638f8.el8.x8 1.2 MB/s | 94 kB 00:00 2023-06-09T04:32:18.338 INFO:teuthology.orchestra.run.smithi184.stdout:(25/131): ceph-test-18.0.0-4313.ga02638f8.el8.x 17 MB/s | 41 MB 00:02 2023-06-09T04:32:18.413 INFO:teuthology.orchestra.run.smithi184.stdout:(26/131): rbd-mirror-18.0.0-4313.ga02638f8.el8. 6.3 MB/s | 3.4 MB 00:00 2023-06-09T04:32:18.438 INFO:teuthology.orchestra.run.smithi184.stdout:(27/131): rbd-nbd-18.0.0-4313.ga02638f8.el8.x86 1.8 MB/s | 179 kB 00:00 2023-06-09T04:32:18.463 INFO:teuthology.orchestra.run.smithi184.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4313.g 461 kB/s | 23 kB 00:00 2023-06-09T04:32:18.489 INFO:teuthology.orchestra.run.smithi184.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4313.ga02638f 2.5 MB/s | 128 kB 00:00 2023-06-09T04:32:18.639 INFO:teuthology.orchestra.run.smithi184.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4313.ga0263 9.8 MB/s | 1.7 MB 00:00 2023-06-09T04:32:18.731 INFO:teuthology.orchestra.run.smithi184.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4313.ga0 2.6 MB/s | 240 kB 00:00 2023-06-09T04:32:18.798 INFO:teuthology.orchestra.run.smithi184.stdout:(32/131): ceph-mgr-rook-18.0.0-4313.ga02638f8.e 712 kB/s | 47 kB 00:00 2023-06-09T04:32:18.932 INFO:teuthology.orchestra.run.smithi184.stdout:(33/131): ceph-mgr-diskprediction-local-18.0.0- 17 MB/s | 7.4 MB 00:00 2023-06-09T04:32:18.948 INFO:teuthology.orchestra.run.smithi184.stdout:(34/131): ceph-prometheus-alerts-18.0.0-4313.ga 97 kB/s | 15 kB 00:00 2023-06-09T04:32:18.982 INFO:teuthology.orchestra.run.smithi184.stdout:(35/131): ceph-volume-18.0.0-4313.ga02638f8.el8 5.0 MB/s | 258 kB 00:00 2023-06-09T04:32:19.007 INFO:teuthology.orchestra.run.smithi184.stdout:(36/131): cephadm-18.0.0-4313.ga02638f8.el8.noa 2.7 MB/s | 160 kB 00:00 2023-06-09T04:32:19.033 INFO:teuthology.orchestra.run.smithi184.stdout:(37/131): cephfs-top-18.0.0-4313.ga02638f8.el8. 356 kB/s | 18 kB 00:00 2023-06-09T04:32:19.267 INFO:teuthology.orchestra.run.smithi184.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 252 kB/s | 59 kB 00:00 2023-06-09T04:32:19.367 INFO:teuthology.orchestra.run.smithi184.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 853 kB/s | 306 kB 00:00 2023-06-09T04:32:19.392 INFO:teuthology.orchestra.run.smithi184.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 600 kB/s | 75 kB 00:00 2023-06-09T04:32:19.555 INFO:teuthology.orchestra.run.smithi184.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-06-09T04:32:19.584 INFO:teuthology.orchestra.run.smithi184.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 227 kB/s | 44 kB 00:00 2023-06-09T04:32:19.635 INFO:teuthology.orchestra.run.smithi184.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.3 MB/s | 185 kB 00:00 2023-06-09T04:32:19.660 INFO:teuthology.orchestra.run.smithi184.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 437 kB/s | 33 kB 00:00 2023-06-09T04:32:19.710 INFO:teuthology.orchestra.run.smithi184.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-06-09T04:32:19.802 INFO:teuthology.orchestra.run.smithi184.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-06-09T04:32:19.853 INFO:teuthology.orchestra.run.smithi184.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-06-09T04:32:19.919 INFO:teuthology.orchestra.run.smithi184.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 695 kB/s | 81 kB 00:00 2023-06-09T04:32:19.945 INFO:teuthology.orchestra.run.smithi184.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-06-09T04:32:20.003 INFO:teuthology.orchestra.run.smithi184.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-06-09T04:32:20.170 INFO:teuthology.orchestra.run.smithi184.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-06-09T04:32:20.196 INFO:teuthology.orchestra.run.smithi184.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 254 kB/s | 49 kB 00:00 2023-06-09T04:32:20.262 INFO:teuthology.orchestra.run.smithi184.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 638 kB/s | 59 kB 00:00 2023-06-09T04:32:20.288 INFO:teuthology.orchestra.run.smithi184.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 655 kB/s | 60 kB 00:00 2023-06-09T04:32:20.380 INFO:teuthology.orchestra.run.smithi184.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-06-09T04:32:20.405 INFO:teuthology.orchestra.run.smithi184.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-06-09T04:32:20.455 INFO:teuthology.orchestra.run.smithi184.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-06-09T04:32:20.522 INFO:teuthology.orchestra.run.smithi184.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-06-09T04:32:20.581 INFO:teuthology.orchestra.run.smithi184.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 491 kB/s | 61 kB 00:00 2023-06-09T04:32:20.623 INFO:teuthology.orchestra.run.smithi184.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-06-09T04:32:20.665 INFO:teuthology.orchestra.run.smithi184.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 285 kB/s | 24 kB 00:00 2023-06-09T04:32:20.707 INFO:teuthology.orchestra.run.smithi184.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-06-09T04:32:20.749 INFO:teuthology.orchestra.run.smithi184.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 328 kB/s | 27 kB 00:00 2023-06-09T04:32:20.808 INFO:teuthology.orchestra.run.smithi184.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-06-09T04:32:20.858 INFO:teuthology.orchestra.run.smithi184.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-06-09T04:32:20.911 INFO:teuthology.orchestra.run.smithi184.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 596 kB/s | 61 kB 00:00 2023-06-09T04:32:20.950 INFO:teuthology.orchestra.run.smithi184.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 929 kB/s | 85 kB 00:00 2023-06-09T04:32:20.992 INFO:teuthology.orchestra.run.smithi184.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 283 kB/s | 23 kB 00:00 2023-06-09T04:32:21.018 INFO:teuthology.orchestra.run.smithi184.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-06-09T04:32:21.160 INFO:teuthology.orchestra.run.smithi184.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2023-06-09T04:32:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:(71/131): ceph-common-18.0.0-4313.ga02638f8.el8 2.4 MB/s | 22 MB 00:08 2023-06-09T04:32:21.444 INFO:teuthology.orchestra.run.smithi184.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 388 kB/s | 110 kB 00:00 2023-06-09T04:32:21.469 INFO:teuthology.orchestra.run.smithi184.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 780 kB/s | 54 kB 00:00 2023-06-09T04:32:21.494 INFO:teuthology.orchestra.run.smithi184.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-06-09T04:32:21.528 INFO:teuthology.orchestra.run.smithi184.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-06-09T04:32:21.545 INFO:teuthology.orchestra.run.smithi184.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 774 kB/s | 39 kB 00:00 2023-06-09T04:32:21.587 INFO:teuthology.orchestra.run.smithi184.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-06-09T04:32:21.620 INFO:teuthology.orchestra.run.smithi184.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2023-06-09T04:32:21.646 INFO:teuthology.orchestra.run.smithi184.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-06-09T04:32:21.671 INFO:teuthology.orchestra.run.smithi184.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-06-09T04:32:21.746 INFO:teuthology.orchestra.run.smithi184.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 6.9 MB/s | 713 kB 00:00 2023-06-09T04:32:21.788 INFO:teuthology.orchestra.run.smithi184.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 639 kB/s | 27 kB 00:00 2023-06-09T04:32:21.930 INFO:teuthology.orchestra.run.smithi184.stdout:(83/131): python3-scipy-1.0.0-21.module+el8.5.0 15 MB/s | 14 MB 00:00 2023-06-09T04:32:21.964 INFO:teuthology.orchestra.run.smithi184.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-06-09T04:32:21.989 INFO:teuthology.orchestra.run.smithi184.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 754 kB/s | 44 kB 00:00 2023-06-09T04:32:22.072 INFO:teuthology.orchestra.run.smithi184.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 5.4 MB/s | 457 kB 00:00 2023-06-09T04:32:22.165 INFO:teuthology.orchestra.run.smithi184.stdout:(87/131): python3-babel-2.5.1-7.el8.noarch.rpm 9.7 MB/s | 4.8 MB 00:00 2023-06-09T04:32:22.190 INFO:teuthology.orchestra.run.smithi184.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.9 MB/s | 225 kB 00:00 2023-06-09T04:32:22.215 INFO:teuthology.orchestra.run.smithi184.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-06-09T04:32:22.241 INFO:teuthology.orchestra.run.smithi184.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-06-09T04:32:22.266 INFO:teuthology.orchestra.run.smithi184.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 396 kB/s | 20 kB 00:00 2023-06-09T04:32:22.291 INFO:teuthology.orchestra.run.smithi184.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-06-09T04:32:22.325 INFO:teuthology.orchestra.run.smithi184.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-06-09T04:32:22.383 INFO:teuthology.orchestra.run.smithi184.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 8.9 MB/s | 3.7 MB 00:00 2023-06-09T04:32:22.442 INFO:teuthology.orchestra.run.smithi184.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2023-06-09T04:32:22.484 INFO:teuthology.orchestra.run.smithi184.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-06-09T04:32:22.526 INFO:teuthology.orchestra.run.smithi184.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-06-09T04:32:22.626 INFO:teuthology.orchestra.run.smithi184.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-06-09T04:32:22.693 INFO:teuthology.orchestra.run.smithi184.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-06-09T04:32:22.727 INFO:teuthology.orchestra.run.smithi184.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-06-09T04:32:22.785 INFO:teuthology.orchestra.run.smithi184.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 801 kB/s | 47 kB 00:00 2023-06-09T04:32:22.828 INFO:teuthology.orchestra.run.smithi184.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-06-09T04:32:22.853 INFO:teuthology.orchestra.run.smithi184.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-06-09T04:32:22.878 INFO:teuthology.orchestra.run.smithi184.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 850 kB/s | 43 kB 00:00 2023-06-09T04:32:22.903 INFO:teuthology.orchestra.run.smithi184.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-06-09T04:32:22.928 INFO:teuthology.orchestra.run.smithi184.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-06-09T04:32:22.954 INFO:teuthology.orchestra.run.smithi184.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-06-09T04:32:23.141 INFO:teuthology.orchestra.run.smithi184.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 201 kB/s | 43 kB 00:00 2023-06-09T04:32:23.255 INFO:teuthology.orchestra.run.smithi184.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 363 kB/s | 109 kB 00:00 2023-06-09T04:32:23.280 INFO:teuthology.orchestra.run.smithi184.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-06-09T04:32:23.314 INFO:teuthology.orchestra.run.smithi184.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-06-09T04:32:23.339 INFO:teuthology.orchestra.run.smithi184.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-06-09T04:32:23.364 INFO:teuthology.orchestra.run.smithi184.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-06-09T04:32:23.431 INFO:teuthology.orchestra.run.smithi184.stdout:(114/131): postgresql-server-10.21-2.module+el8 5.6 MB/s | 5.1 MB 00:00 2023-06-09T04:32:23.448 INFO:teuthology.orchestra.run.smithi184.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 214 kB/s | 18 kB 00:00 2023-06-09T04:32:23.490 INFO:teuthology.orchestra.run.smithi184.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-06-09T04:32:23.549 INFO:teuthology.orchestra.run.smithi184.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-06-09T04:32:23.574 INFO:teuthology.orchestra.run.smithi184.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.8 MB/s | 238 kB 00:00 2023-06-09T04:32:23.599 INFO:teuthology.orchestra.run.smithi184.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-06-09T04:32:23.625 INFO:teuthology.orchestra.run.smithi184.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-06-09T04:32:23.650 INFO:teuthology.orchestra.run.smithi184.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-06-09T04:32:23.675 INFO:teuthology.orchestra.run.smithi184.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-06-09T04:32:23.701 INFO:teuthology.orchestra.run.smithi184.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-06-09T04:32:23.726 INFO:teuthology.orchestra.run.smithi184.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 770 kB/s | 39 kB 00:00 2023-06-09T04:32:23.759 INFO:teuthology.orchestra.run.smithi184.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-06-09T04:32:23.785 INFO:teuthology.orchestra.run.smithi184.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-06-09T04:32:23.802 INFO:teuthology.orchestra.run.smithi184.stdout:(127/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-06-09T04:32:23.882 INFO:teuthology.orchestra.run.smithi184.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.9 MB/s | 2.3 MB 00:00 2023-06-09T04:32:23.944 INFO:teuthology.orchestra.run.smithi184.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-06-09T04:32:24.178 INFO:teuthology.orchestra.run.smithi184.stdout:(130/131): librados2-18.0.0-4313.ga02638f8.el8. 9.3 MB/s | 3.7 MB 00:00 2023-06-09T04:32:24.278 INFO:teuthology.orchestra.run.smithi184.stdout:(131/131): librbd1-18.0.0-4313.ga02638f8.el8.x8 7.5 MB/s | 3.6 MB 00:00 2023-06-09T04:32:24.281 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2023-06-09T04:32:24.281 INFO:teuthology.orchestra.run.smithi184.stdout:Total 17 MB/s | 197 MB 00:11 2023-06-09T04:32:25.132 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2023-06-09T04:32:25.252 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2023-06-09T04:32:25.252 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2023-06-09T04:32:26.350 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2023-06-09T04:32:26.354 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2023-06-09T04:32:31.890 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2023-06-09T04:32:32.050 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-09T04:32:32.234 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-09T04:32:32.442 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-06-09T04:32:32.635 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-09T04:32:32.740 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-06-09T04:32:32.977 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-09T04:32:33.373 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-06-09T04:32:33.619 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:32:34.020 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:32:34.185 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:32:34.377 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:32:34.543 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:32:34.666 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:32:34.878 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-09T04:32:35.172 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-09T04:32:35.388 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-09T04:32:35.782 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-09T04:32:36.064 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-09T04:32:36.218 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:32:36.308 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:32:36.493 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:32:36.564 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:32:36.709 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-09T04:32:36.847 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-06-09T04:32:36.976 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-09T04:32:37.615 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-06-09T04:32:37.818 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-09T04:32:38.410 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-06-09T04:32:38.576 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-06-09T04:32:39.306 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-06-09T04:32:39.891 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-06-09T04:32:40.099 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-06-09T04:32:40.347 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-06-09T04:32:40.507 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-06-09T04:32:40.742 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-06-09T04:32:40.978 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-09T04:32:41.132 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 26/134 2023-06-09T04:32:41.295 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 27/134 2023-06-09T04:32:42.205 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 28/134 2023-06-09T04:32:42.514 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-06-09T04:32:42.794 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-06-09T04:32:43.100 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-06-09T04:32:43.325 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-09T04:32:45.083 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-06-09T04:32:45.444 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-06-09T04:32:45.637 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-09T04:32:45.843 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-09T04:32:46.005 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 36/134 2023-06-09T04:32:46.162 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 37/134 2023-06-09T04:32:46.347 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-06-09T04:32:46.536 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-06-09T04:32:46.744 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-06-09T04:32:46.870 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-06-09T04:32:47.048 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-06-09T04:32:47.246 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-06-09T04:32:47.621 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-06-09T04:32:47.902 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-06-09T04:32:48.092 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-06-09T04:32:48.336 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-06-09T04:32:48.595 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-06-09T04:32:48.932 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-06-09T04:32:49.232 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-06-09T04:32:49.417 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-06-09T04:32:49.662 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-06-09T04:32:49.857 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-06-09T04:32:50.011 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-06-09T04:32:50.345 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-06-09T04:32:50.639 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-06-09T04:32:50.870 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-06-09T04:32:51.080 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-06-09T04:32:51.273 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-06-09T04:32:51.417 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-06-09T04:32:51.615 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-06-09T04:32:51.672 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-06-09T04:32:51.879 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-06-09T04:32:52.086 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-06-09T04:32:52.265 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-09T04:32:52.350 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-06-09T04:32:52.561 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-06-09T04:32:52.741 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-06-09T04:32:52.940 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-09T04:32:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-09T04:32:53.377 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-09T04:32:53.614 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-09T04:32:53.753 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-09T04:32:53.885 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-09T04:32:54.100 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-09T04:32:54.336 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-09T04:32:54.518 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-09T04:32:54.685 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-09T04:32:54.812 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-09T04:32:55.036 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-09T04:32:55.272 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-09T04:32:55.487 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-09T04:32:55.778 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-09T04:32:56.047 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-09T04:32:56.197 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-09T04:32:56.417 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-09T04:32:57.480 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-09T04:32:57.718 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-09T04:32:57.947 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-09T04:32:58.248 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-09T04:32:58.569 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-09T04:32:58.733 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-09T04:32:59.533 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-09T04:32:59.689 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:32:59.761 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:32:59.948 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 93/134 2023-06-09T04:33:03.870 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:33:04.106 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:33:04.683 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:33:04.992 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:33:05.115 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:33:05.263 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:33:24.354 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:33:24.354 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2023-06-09T04:33:24.354 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /run 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /dev 2023-06-09T04:33:24.355 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:33:24.718 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:33:26.303 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:33:26.463 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:33:26.681 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:33:26.835 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:33:27.284 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:33:27.459 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:33:27.477 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:33:29.135 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:33:29.357 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:33:29.465 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 102/134 2023-06-09T04:33:29.640 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 103/134 2023-06-09T04:33:29.858 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:33:30.074 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:33:30.359 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:33:31.317 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:33:31.500 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:33:31.590 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:33:31.990 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 107/134 2023-06-09T04:33:32.246 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:33:32.281 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:33:32.467 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:33:32.478 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:33:33.726 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 110/134 2023-06-09T04:33:34.102 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:33:34.136 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:33:34.317 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:33:34.359 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:33:34.509 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:33:34.853 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:33:35.050 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:33:38.959 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:33:39.284 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 115/134 2023-06-09T04:33:39.457 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-06-09T04:33:39.649 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-06-09T04:33:40.493 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-06-09T04:33:40.829 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-06-09T04:33:40.996 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 119/134 2023-06-09T04:33:41.202 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-09T04:33:41.394 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 121/134 2023-06-09T04:33:41.516 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-09T04:33:43.774 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:33:44.023 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:33:44.043 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:33:44.276 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 124/134 2023-06-09T04:33:44.531 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 125/134 2023-06-09T04:33:44.807 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 126/134 2023-06-09T04:33:45.154 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-09T04:33:45.314 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-09T04:33:45.323 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-09T04:33:45.549 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-06-09T04:33:45.722 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-06-09T04:33:45.806 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-06-09T04:33:46.023 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-06-09T04:33:46.036 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-06-09T04:33:46.036 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:33:46.234 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:33:46.234 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:33:46.455 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:33:46.655 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:33:46.933 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:33:46.933 INFO:teuthology.orchestra.run.smithi184.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-09T04:33:46.933 INFO:teuthology.orchestra.run.smithi184.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-09T04:33:46.933 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:33:47.153 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/134 2023-06-09T04:33:47.154 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/134 2023-06-09T04:33:47.154 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/134 2023-06-09T04:33:47.154 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/134 2023-06-09T04:33:47.154 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/134 2023-06-09T04:33:47.154 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:33:47.154 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:33:47.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:33:47.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-09T04:33:47.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/134 2023-06-09T04:33:47.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/134 2023-06-09T04:33:47.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/134 2023-06-09T04:33:47.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/134 2023-06-09T04:33:47.155 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/134 2023-06-09T04:33:47.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/134 2023-06-09T04:33:47.157 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/134 2023-06-09T04:33:47.157 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/134 2023-06-09T04:33:47.164 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/134 2023-06-09T04:33:47.164 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/134 2023-06-09T04:33:47.164 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/134 2023-06-09T04:33:47.164 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/134 2023-06-09T04:33:47.164 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/134 2023-06-09T04:33:47.164 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/134 2023-06-09T04:33:47.165 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-09T04:33:47.166 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-09T04:33:47.167 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-09T04:33:47.167 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-09T04:33:47.167 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-09T04:33:47.167 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-09T04:33:47.167 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-09T04:33:47.167 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-09T04:33:47.167 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-09T04:33:47.168 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-09T04:33:47.169 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-09T04:33:47.170 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-09T04:33:47.170 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-09T04:33:47.170 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-06-09T04:33:47.170 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-06-09T04:33:47.170 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-06-09T04:33:47.170 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-06-09T04:33:47.170 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-06-09T04:33:47.171 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-06-09T04:33:47.172 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-06-09T04:33:47.173 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-06-09T04:33:47.174 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-06-09T04:33:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-06-09T04:33:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-06-09T04:33:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-06-09T04:33:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-06-09T04:33:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-06-09T04:33:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-06-09T04:33:47.175 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-09T04:33:47.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-09T04:33:47.177 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/134 2023-06-09T04:33:47.178 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:33:47.178 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-09T04:33:49.990 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:33:49.990 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:49 ago on Fri 09 Jun 2023 04:32:00 AM UTC. 2023-06-09T04:33:52.485 INFO:teuthology.orchestra.run.smithi184.stdout:Installed products updated. 2023-06-09T04:33:52.709 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:33:52.709 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2023-06-09T04:33:52.709 INFO:teuthology.orchestra.run.smithi184.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-09T04:33:52.709 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.1-7.el8.noarch 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.0.4-10.el8.x86_64 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.710 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.711 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.712 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.712 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.712 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.712 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.712 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.712 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.712 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.1-9.el8.x86_64 2023-06-09T04:33:52.713 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-09T04:33:52.714 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-09T04:33:52.714 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-3.el8.x86_64 2023-06-09T04:33:52.714 INFO:teuthology.orchestra.run.smithi184.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-09T04:33:52.714 INFO:teuthology.orchestra.run.smithi184.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-09T04:33:52.714 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-09T04:33:52.714 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.714 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: libpq-13.5-1.el8.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-09T04:33:52.715 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-09T04:33:52.716 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-09T04:33:52.717 INFO:teuthology.orchestra.run.smithi184.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-09T04:33:52.717 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-09T04:33:52.717 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-09T04:33:52.717 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-09T04:33:52.717 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-09T04:33:52.717 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-09T04:33:52.717 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-09T04:33:52.718 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-09T04:33:52.719 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-09T04:33:52.720 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-09T04:33:52.720 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-09T04:33:52.720 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-09T04:33:52.720 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-09T04:33:52.720 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-09T04:33:52.720 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-09T04:33:52.720 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-09T04:33:52.721 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-09T04:33:52.722 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-09T04:33:52.722 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-09T04:33:52.722 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-09T04:33:52.722 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-09T04:33:52.722 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-2.6-1.el8.noarch 2023-06-09T04:33:52.722 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-09T04:33:52.722 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-09T04:33:52.723 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-09T04:33:52.724 INFO:teuthology.orchestra.run.smithi184.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.725 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.726 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:33:52.726 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-09T04:33:52.726 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-09T04:33:52.726 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-09T04:33:52.726 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-09T04:33:52.726 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-09T04:33:52.727 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-09T04:33:52.727 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:33:52.727 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2023-06-09T04:33:52.911 DEBUG:teuthology.parallel:result is None 2023-06-09T04:34:25.166 INFO:teuthology.orchestra.run.smithi149.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-09T04:34:25.166 INFO:teuthology.orchestra.run.smithi149.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-09T04:34:25.166 INFO:teuthology.orchestra.run.smithi149.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-09T04:34:25.647 INFO:teuthology.orchestra.run.smithi149.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 458 B/s | 59 kB 02:11 2023-06-09T04:34:25.672 INFO:teuthology.orchestra.run.smithi149.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 587 B/s | 75 kB 02:10 2023-06-09T04:34:25.789 INFO:teuthology.orchestra.run.smithi149.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-06-09T04:34:25.814 INFO:teuthology.orchestra.run.smithi149.stdout:(42/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:11 2023-06-09T04:34:25.939 INFO:teuthology.orchestra.run.smithi149.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2023-06-09T04:34:25.965 INFO:teuthology.orchestra.run.smithi149.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 219 kB/s | 33 kB 00:00 2023-06-09T04:34:25.990 INFO:teuthology.orchestra.run.smithi149.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 922 kB/s | 185 kB 00:00 2023-06-09T04:34:26.040 INFO:teuthology.orchestra.run.smithi149.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 162 kB/s | 16 kB 00:00 2023-06-09T04:34:26.082 INFO:teuthology.orchestra.run.smithi149.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-06-09T04:34:26.141 INFO:teuthology.orchestra.run.smithi149.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 811 kB/s | 81 kB 00:00 2023-06-09T04:34:26.191 INFO:teuthology.orchestra.run.smithi149.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-06-09T04:34:26.208 INFO:teuthology.orchestra.run.smithi149.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 88 kB/s | 11 kB 00:00 2023-06-09T04:34:26.242 INFO:teuthology.orchestra.run.smithi149.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-06-09T04:34:26.317 INFO:teuthology.orchestra.run.smithi149.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 449 kB/s | 49 kB 00:00 2023-06-09T04:34:26.342 INFO:teuthology.orchestra.run.smithi149.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 585 kB/s | 59 kB 00:00 2023-06-09T04:34:26.418 INFO:teuthology.orchestra.run.smithi149.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-06-09T04:34:26.476 INFO:teuthology.orchestra.run.smithi149.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 379 kB/s | 60 kB 00:00 2023-06-09T04:34:26.501 INFO:teuthology.orchestra.run.smithi149.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-06-09T04:34:26.535 INFO:teuthology.orchestra.run.smithi149.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-06-09T04:34:26.585 INFO:teuthology.orchestra.run.smithi149.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 309 kB/s | 34 kB 00:00 2023-06-09T04:34:26.619 INFO:teuthology.orchestra.run.smithi149.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-06-09T04:34:26.644 INFO:teuthology.orchestra.run.smithi149.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 565 kB/s | 61 kB 00:00 2023-06-09T04:34:26.694 INFO:teuthology.orchestra.run.smithi149.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 172 kB/s | 19 kB 00:00 2023-06-09T04:34:26.753 INFO:teuthology.orchestra.run.smithi149.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 178 kB/s | 24 kB 00:00 2023-06-09T04:34:26.778 INFO:teuthology.orchestra.run.smithi149.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 218 kB/s | 29 kB 00:00 2023-06-09T04:34:26.820 INFO:teuthology.orchestra.run.smithi149.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 219 kB/s | 27 kB 00:00 2023-06-09T04:34:26.887 INFO:teuthology.orchestra.run.smithi149.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-06-09T04:34:26.912 INFO:teuthology.orchestra.run.smithi149.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.8 MB/s | 251 kB 00:00 2023-06-09T04:34:26.938 INFO:teuthology.orchestra.run.smithi149.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 522 kB/s | 61 kB 00:00 2023-06-09T04:34:26.997 INFO:teuthology.orchestra.run.smithi149.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 784 kB/s | 85 kB 00:00 2023-06-09T04:34:27.047 INFO:teuthology.orchestra.run.smithi149.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 171 kB/s | 23 kB 00:00 2023-06-09T04:34:27.072 INFO:teuthology.orchestra.run.smithi149.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 926 kB/s | 70 kB 00:00 2023-06-09T04:34:27.122 INFO:teuthology.orchestra.run.smithi149.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2023-06-09T04:34:27.148 INFO:teuthology.orchestra.run.smithi149.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-06-09T04:34:27.173 INFO:teuthology.orchestra.run.smithi149.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 849 kB/s | 43 kB 00:00 2023-06-09T04:34:27.198 INFO:teuthology.orchestra.run.smithi149.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-06-09T04:34:27.223 INFO:teuthology.orchestra.run.smithi149.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 958 kB/s | 48 kB 00:00 2023-06-09T04:34:27.249 INFO:teuthology.orchestra.run.smithi149.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-06-09T04:34:27.274 INFO:teuthology.orchestra.run.smithi149.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-06-09T04:34:27.299 INFO:teuthology.orchestra.run.smithi149.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-06-09T04:34:27.316 INFO:teuthology.orchestra.run.smithi149.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2023-06-09T04:34:27.358 INFO:teuthology.orchestra.run.smithi149.stdout:(80/131): thrift-0.13.0-2.el8.x86_64.rpm 4.1 MB/s | 1.7 MB 00:00 2023-06-09T04:34:27.383 INFO:teuthology.orchestra.run.smithi149.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-06-09T04:34:27.417 INFO:teuthology.orchestra.run.smithi149.stdout:(82/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.7 MB/s | 560 kB 00:00 2023-06-09T04:34:27.442 INFO:teuthology.orchestra.run.smithi149.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-06-09T04:34:27.468 INFO:teuthology.orchestra.run.smithi149.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-06-09T04:34:27.501 INFO:teuthology.orchestra.run.smithi149.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.9 MB/s | 559 kB 00:00 2023-06-09T04:34:27.535 INFO:teuthology.orchestra.run.smithi149.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-06-09T04:34:27.560 INFO:teuthology.orchestra.run.smithi149.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-06-09T04:34:27.585 INFO:teuthology.orchestra.run.smithi149.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-06-09T04:34:27.611 INFO:teuthology.orchestra.run.smithi149.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-06-09T04:34:27.627 INFO:teuthology.orchestra.run.smithi149.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-06-09T04:34:27.686 INFO:teuthology.orchestra.run.smithi149.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.3 MB/s | 98 kB 00:00 2023-06-09T04:34:27.712 INFO:teuthology.orchestra.run.smithi149.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 687 kB/s | 58 kB 00:00 2023-06-09T04:34:27.728 INFO:teuthology.orchestra.run.smithi149.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 919 kB/s | 39 kB 00:00 2023-06-09T04:34:27.762 INFO:teuthology.orchestra.run.smithi149.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 13 MB/s | 644 kB 00:00 2023-06-09T04:34:27.788 INFO:teuthology.orchestra.run.smithi149.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-06-09T04:34:27.813 INFO:teuthology.orchestra.run.smithi149.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-06-09T04:34:27.855 INFO:teuthology.orchestra.run.smithi149.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-06-09T04:34:27.913 INFO:teuthology.orchestra.run.smithi149.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.6 MB/s | 2.3 MB 00:00 2023-06-09T04:34:27.938 INFO:teuthology.orchestra.run.smithi149.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 649 kB/s | 54 kB 00:00 2023-06-09T04:34:27.955 INFO:teuthology.orchestra.run.smithi149.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-06-09T04:34:27.989 INFO:teuthology.orchestra.run.smithi149.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-06-09T04:34:28.014 INFO:teuthology.orchestra.run.smithi149.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-06-09T04:34:28.065 INFO:teuthology.orchestra.run.smithi149.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 9.0 MB/s | 688 kB 00:00 2023-06-09T04:34:28.106 INFO:teuthology.orchestra.run.smithi149.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.7 MB/s | 538 kB 00:00 2023-06-09T04:34:28.132 INFO:teuthology.orchestra.run.smithi149.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-06-09T04:34:28.157 INFO:teuthology.orchestra.run.smithi149.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-06-09T04:34:28.199 INFO:teuthology.orchestra.run.smithi149.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-06-09T04:34:28.224 INFO:teuthology.orchestra.run.smithi149.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 1.0 MB/s | 27 kB 00:00 2023-06-09T04:34:28.266 INFO:teuthology.orchestra.run.smithi149.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-06-09T04:34:28.317 INFO:teuthology.orchestra.run.smithi149.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 879 kB/s | 44 kB 00:00 2023-06-09T04:34:28.417 INFO:teuthology.orchestra.run.smithi149.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-06-09T04:34:28.459 INFO:teuthology.orchestra.run.smithi149.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-06-09T04:34:28.501 INFO:teuthology.orchestra.run.smithi149.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-06-09T04:34:28.567 INFO:teuthology.orchestra.run.smithi149.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-06-09T04:34:28.593 INFO:teuthology.orchestra.run.smithi149.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 697 kB/s | 64 kB 00:00 2023-06-09T04:34:28.618 INFO:teuthology.orchestra.run.smithi149.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-06-09T04:34:28.644 INFO:teuthology.orchestra.run.smithi149.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-06-09T04:34:28.669 INFO:teuthology.orchestra.run.smithi149.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-06-09T04:34:28.702 INFO:teuthology.orchestra.run.smithi149.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-06-09T04:34:28.744 INFO:teuthology.orchestra.run.smithi149.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-06-09T04:34:28.911 INFO:teuthology.orchestra.run.smithi149.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-06-09T04:34:28.953 INFO:teuthology.orchestra.run.smithi149.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-06-09T04:34:29.003 INFO:teuthology.orchestra.run.smithi149.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-06-09T04:34:29.095 INFO:teuthology.orchestra.run.smithi149.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-06-09T04:34:29.171 INFO:teuthology.orchestra.run.smithi149.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-06-09T04:34:29.204 INFO:teuthology.orchestra.run.smithi149.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-06-09T04:34:29.263 INFO:teuthology.orchestra.run.smithi149.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-06-09T04:34:29.338 INFO:teuthology.orchestra.run.smithi149.stdout:(128/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-06-09T04:34:29.388 INFO:teuthology.orchestra.run.smithi149.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 17 MB/s | 798 kB 00:00 2023-06-09T04:34:29.872 INFO:teuthology.orchestra.run.smithi149.stdout:(130/131): librados2-18.0.0-4313.ga02638f8.el8. 5.5 MB/s | 3.7 MB 00:00 2023-06-09T04:34:29.947 INFO:teuthology.orchestra.run.smithi149.stdout:(131/131): librbd1-18.0.0-4313.ga02638f8.el8.x8 5.2 MB/s | 3.6 MB 00:00 2023-06-09T04:34:29.950 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-06-09T04:34:29.951 INFO:teuthology.orchestra.run.smithi149.stdout:Total 1.4 MB/s | 197 MB 02:21 2023-06-09T04:34:30.735 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-06-09T04:34:30.856 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-06-09T04:34:30.856 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-06-09T04:34:31.936 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-06-09T04:34:31.940 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-06-09T04:34:36.849 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-06-09T04:34:37.048 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-06-09T04:34:37.207 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-06-09T04:34:37.359 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-09T04:34:37.476 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-06-09T04:34:37.684 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-09T04:34:38.086 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-06-09T04:34:38.351 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 5/134 2023-06-09T04:34:38.754 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 5/134 2023-06-09T04:34:38.983 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:34:39.105 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:34:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:34:39.402 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:34:39.581 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:34:39.759 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-06-09T04:34:39.995 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-06-09T04:34:40.237 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-06-09T04:34:40.643 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-06-09T04:34:40.904 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-06-09T04:34:41.066 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:34:41.175 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 14/134 2023-06-09T04:34:41.342 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:34:41.484 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 15/134 2023-06-09T04:34:41.662 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-06-09T04:34:41.831 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-06-09T04:34:41.980 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-06-09T04:34:42.133 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-09T04:34:42.270 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-06-09T04:34:42.425 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-09T04:34:43.040 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-06-09T04:34:43.224 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-09T04:34:43.827 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-06-09T04:34:44.058 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-06-09T04:34:44.793 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-06-09T04:34:45.061 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-06-09T04:34:45.272 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-06-09T04:34:45.484 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-06-09T04:34:45.655 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 26/134 2023-06-09T04:34:45.827 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 27/134 2023-06-09T04:34:46.072 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 28/134 2023-06-09T04:34:46.274 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-09T04:34:48.048 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-06-09T04:34:49.080 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-06-09T04:34:49.389 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-06-09T04:34:49.643 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-06-09T04:34:49.843 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-06-09T04:34:50.068 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-06-09T04:34:50.259 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-06-09T04:34:50.429 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 36/134 2023-06-09T04:34:50.584 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 37/134 2023-06-09T04:34:50.739 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-06-09T04:34:50.883 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-06-09T04:34:51.040 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-06-09T04:34:51.108 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-06-09T04:34:51.361 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-06-09T04:34:51.585 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-06-09T04:34:51.732 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-09T04:34:51.811 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-06-09T04:34:52.052 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-06-09T04:34:52.210 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-06-09T04:34:52.366 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-06-09T04:34:52.583 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-06-09T04:34:52.750 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-06-09T04:34:52.901 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-06-09T04:34:53.079 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-06-09T04:34:53.293 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-06-09T04:34:53.633 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-06-09T04:34:53.916 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-06-09T04:34:54.134 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-06-09T04:34:54.368 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-06-09T04:34:54.577 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-06-09T04:34:54.871 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-06-09T04:34:55.122 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-06-09T04:34:55.307 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-06-09T04:34:55.520 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-06-09T04:34:55.719 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-06-09T04:34:55.892 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-06-09T04:34:56.413 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-06-09T04:34:56.669 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-06-09T04:34:56.960 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-06-09T04:34:57.182 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-06-09T04:34:57.355 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-06-09T04:34:57.567 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-06-09T04:34:57.841 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-06-09T04:34:58.046 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-06-09T04:34:58.226 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-06-09T04:34:58.383 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-06-09T04:34:58.574 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-06-09T04:34:58.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-06-09T04:34:58.959 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-06-09T04:34:59.134 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-06-09T04:34:59.303 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-06-09T04:34:59.569 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-06-09T04:34:59.751 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-06-09T04:34:59.936 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-06-09T04:35:00.212 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-06-09T04:35:00.429 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-06-09T04:35:00.597 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-06-09T04:35:00.844 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-06-09T04:35:01.912 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-06-09T04:35:02.175 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-06-09T04:35:02.397 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-06-09T04:35:02.705 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-06-09T04:35:02.960 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-06-09T04:35:03.181 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-06-09T04:35:03.941 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-06-09T04:35:04.096 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:35:04.166 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 92/134 2023-06-09T04:35:04.380 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 93/134 2023-06-09T04:35:08.047 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:35:08.263 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:35:08.852 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 94/134 2023-06-09T04:35:09.139 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:35:09.209 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 95/134 2023-06-09T04:35:09.345 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:35:28.349 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 96/134 2023-06-09T04:35:28.349 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2023-06-09T04:35:28.349 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2023-06-09T04:35:28.349 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-06-09T04:35:28.350 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /run 2023-06-09T04:35:28.350 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2023-06-09T04:35:28.350 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2023-06-09T04:35:28.350 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2023-06-09T04:35:28.350 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2023-06-09T04:35:28.350 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /dev 2023-06-09T04:35:28.350 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:35:28.734 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:35:30.318 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 97/134 2023-06-09T04:35:30.510 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:35:30.728 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 98/134 2023-06-09T04:35:30.868 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:35:31.317 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 99/134 2023-06-09T04:35:31.492 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:35:31.509 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 100/134 2023-06-09T04:35:33.227 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:35:33.458 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 101/134 2023-06-09T04:35:33.581 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 102/134 2023-06-09T04:35:33.757 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 103/134 2023-06-09T04:35:33.916 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:35:34.133 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 104/134 2023-06-09T04:35:34.393 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:35:35.353 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 105/134 2023-06-09T04:35:35.483 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:35:35.575 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 106/134 2023-06-09T04:35:35.962 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 107/134 2023-06-09T04:35:36.168 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:35:36.203 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 108/134 2023-06-09T04:35:36.358 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:35:36.369 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 109/134 2023-06-09T04:35:37.653 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 110/134 2023-06-09T04:35:37.880 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:35:37.914 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 111/134 2023-06-09T04:35:38.067 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:35:38.108 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4313.ga0263 112/134 2023-06-09T04:35:38.267 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:35:38.610 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 113/134 2023-06-09T04:35:38.783 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:35:42.698 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 114/134 2023-06-09T04:35:43.593 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 115/134 2023-06-09T04:35:43.897 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-06-09T04:35:44.136 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 117/134 2023-06-09T04:35:44.376 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-06-09T04:35:44.523 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-06-09T04:35:44.724 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-06-09T04:35:44.961 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-06-09T04:35:45.119 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 121/134 2023-06-09T04:35:45.308 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-06-09T04:35:47.503 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:35:47.765 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:35:47.783 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-06-09T04:35:47.944 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 124/134 2023-06-09T04:35:48.164 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 125/134 2023-06-09T04:35:48.447 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 126/134 2023-06-09T04:35:48.762 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-06-09T04:35:48.973 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-06-09T04:35:49.051 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-06-09T04:35:49.256 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-06-09T04:35:49.268 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-06-09T04:35:49.422 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-09T04:35:49.430 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-06-09T04:35:49.591 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-06-09T04:35:49.592 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:35:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:35:49.776 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:35:50.012 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-06-09T04:35:50.179 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:35:50.483 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:35:50.483 INFO:teuthology.orchestra.run.smithi149.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-06-09T04:35:50.483 INFO:teuthology.orchestra.run.smithi149.stdout:All rules containing unresolvable specifiers will be skipped. 2023-06-09T04:35:50.483 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:35:50.704 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 1/134 2023-06-09T04:35:50.704 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2/134 2023-06-09T04:35:50.704 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 3/134 2023-06-09T04:35:50.704 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 4/134 2023-06-09T04:35:50.704 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4313.ga0263 5/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 6/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 7/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 8/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 9/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 10/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 11/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 12/134 2023-06-09T04:35:50.705 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 13/134 2023-06-09T04:35:50.706 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_ 14/134 2023-06-09T04:35:50.706 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 15/134 2023-06-09T04:35:50.706 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 16/134 2023-06-09T04:35:50.706 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_6 17/134 2023-06-09T04:35:50.706 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86 18/134 2023-06-09T04:35:50.706 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 19/134 2023-06-09T04:35:50.706 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el 20/134 2023-06-09T04:35:50.707 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:18.0.0-4313.ga02638f8.el8. 21/134 2023-06-09T04:35:50.707 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_6 22/134 2023-06-09T04:35:50.707 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 23/134 2023-06-09T04:35:50.707 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 24/134 2023-06-09T04:35:50.707 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 25/134 2023-06-09T04:35:50.714 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 26/134 2023-06-09T04:35:50.714 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 27/134 2023-06-09T04:35:50.714 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 28/134 2023-06-09T04:35:50.714 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8. 29/134 2023-06-09T04:35:50.714 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noa 30/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.n 31/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02 32/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el 33/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 34/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.e 35/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 36/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 37/134 2023-06-09T04:35:50.715 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 38/134 2023-06-09T04:35:50.716 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-06-09T04:35:50.716 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-06-09T04:35:50.716 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-06-09T04:35:50.716 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-06-09T04:35:50.716 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-06-09T04:35:50.716 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-06-09T04:35:50.716 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-06-09T04:35:50.717 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-06-09T04:35:50.718 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-06-09T04:35:50.719 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-06-09T04:35:50.720 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-06-09T04:35:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-06-09T04:35:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-06-09T04:35:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-06-09T04:35:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-06-09T04:35:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-06-09T04:35:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-06-09T04:35:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-06-09T04:35:50.722 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-06-09T04:35:50.723 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-06-09T04:35:50.724 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-06-09T04:35:50.725 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-06-09T04:35:50.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-06-09T04:35:50.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-06-09T04:35:50.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-06-09T04:35:50.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-06-09T04:35:50.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-06-09T04:35:50.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-06-09T04:35:50.726 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 129/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-06-09T04:35:50.727 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 131/134 2023-06-09T04:35:50.728 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-06-09T04:35:50.728 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-06-09T04:35:53.469 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-06-09T04:35:53.470 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:03:57 ago on Fri 09 Jun 2023 04:31:56 AM UTC. 2023-06-09T04:35:55.999 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-06-09T04:35:56.223 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:35:56.223 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-06-09T04:35:56.223 INFO:teuthology.orchestra.run.smithi149.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-06-09T04:35:56.223 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.224 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.224 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-06-09T04:35:56.224 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-06-09T04:35:56.224 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.1-7.el8.noarch 2023-06-09T04:35:56.224 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.0.4-10.el8.x86_64 2023-06-09T04:35:56.224 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.224 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.225 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.225 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.225 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.225 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.225 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.225 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.225 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.226 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.226 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.226 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.226 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.226 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.226 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.226 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.227 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.227 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.227 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.227 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.227 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.227 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.227 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:18.0.0-4313.ga02638f8.el8.noarch 2023-06-09T04:35:56.228 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-06-09T04:35:56.228 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.1-9.el8.x86_64 2023-06-09T04:35:56.228 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.7-15.el8.x86_64 2023-06-09T04:35:56.228 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-09T04:35:56.228 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.6-3.el8.x86_64 2023-06-09T04:35:56.228 INFO:teuthology.orchestra.run.smithi149.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-09T04:35:56.228 INFO:teuthology.orchestra.run.smithi149.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-09T04:35:56.229 INFO:teuthology.orchestra.run.smithi149.stdout: libpq-13.5-1.el8.x86_64 2023-06-09T04:35:56.230 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-06-09T04:35:56.230 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-09T04:35:56.230 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.230 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.230 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-09T04:35:56.231 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.231 INFO:teuthology.orchestra.run.smithi149.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-06-09T04:35:56.231 INFO:teuthology.orchestra.run.smithi149.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-09T04:35:56.231 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-09T04:35:56.231 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-09T04:35:56.231 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-06-09T04:35:56.232 INFO:teuthology.orchestra.run.smithi149.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-06-09T04:35:56.232 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-09T04:35:56.232 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-09T04:35:56.232 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.15-3.el8.x86_64 2023-06-09T04:35:56.232 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-06-09T04:35:56.232 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-06-09T04:35:56.232 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-06-09T04:35:56.233 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-06-09T04:35:56.233 INFO:teuthology.orchestra.run.smithi149.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-06-09T04:35:56.233 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:35:56.233 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:35:56.233 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-06-09T04:35:56.233 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-09T04:35:56.233 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-09T04:35:56.234 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-09T04:35:56.234 INFO:teuthology.orchestra.run.smithi149.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-09T04:35:56.234 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-09T04:35:56.234 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.234 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.234 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-09T04:35:56.235 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-09T04:35:56.236 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-09T04:35:56.237 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.0.6-13.el8.noarch 2023-06-09T04:35:56.237 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-09T04:35:56.237 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-09T04:35:56.237 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-09T04:35:56.237 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-09T04:35:56.237 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-09T04:35:56.237 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-09T04:35:56.238 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-09T04:35:56.238 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-2.6-1.el8.noarch 2023-06-09T04:35:56.238 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-09T04:35:56.238 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-09T04:35:56.238 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-09T04:35:56.238 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-09T04:35:56.238 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-09T04:35:56.239 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-09T04:35:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-06-09T04:35:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-09T04:35:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-09T04:35:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-09T04:35:56.240 INFO:teuthology.orchestra.run.smithi149.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-09T04:35:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-09T04:35:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-09T04:35:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-09T04:35:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-09T04:35:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-09T04:35:56.241 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-09T04:35:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:18.0.0-4313.ga02638f8.el8.x86_64 2023-06-09T04:35:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-09T04:35:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-09T04:35:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-09T04:35:56.242 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-06-09T04:35:56.243 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-09T04:35:56.243 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-06-09T04:35:56.243 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:35:56.243 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-06-09T04:35:56.485 DEBUG:teuthology.parallel:result is None 2023-06-09T04:35:56.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:35:56.635 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-09T04:35:56.659 INFO:teuthology.orchestra.run.smithi149.stdout:18.0.0-4313.ga02638f8.el8 2023-06-09T04:35:56.660 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-09T04:35:56.660 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-09T04:35:56.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:35:56.897 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-09T04:35:56.926 INFO:teuthology.orchestra.run.smithi184.stdout:18.0.0-4313.ga02638f8.el8 2023-06-09T04:35:56.927 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313.ga02638f8.el8 2023-06-09T04:35:56.927 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313.ga02638f8 is installed. 2023-06-09T04:35:56.928 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-09T04:35:56.929 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:35:56.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:35:56.971 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:35:56.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:35:57.016 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-09T04:35:57.016 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:35:57.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:35:57.044 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:35:57.110 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:35:57.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:35:57.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:35:57.208 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-09T04:35:57.209 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:35:57.209 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:35:57.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:35:57.301 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:35:57.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:35:57.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:35:57.394 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-09T04:35:57.395 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:35:57.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:35:57.421 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:35:57.486 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:35:57.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:35:57.514 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:35:57.581 INFO:teuthology.run_tasks:Running task ceph... 2023-06-09T04:35:57.650 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-09T04:35:57.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /var/log/ceph 2023-06-09T04:35:57.653 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2023-06-09T04:35:57.679 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-09T04:35:57.680 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:35:57.719 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:35:57.745 INFO:tasks.ceph:Creating extra log directories... 2023-06-09T04:35:57.745 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:35:57.785 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:35:57.816 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-09T04:35:57.816 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-09T04:35:57.817 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-09T04:35:57.817 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:35:57.817 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:35:57.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:35:58.015 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-09T04:35:58.041 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:35:58.042 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:35:58.058 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:35:58.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-09T04:35:58.227 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-09T04:35:58.227 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-09T04:35:58.227 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299736', 'branch': 'wip-lxb-fscrypt-20230607-0901', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7299736', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20230607-0901'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lxb-fscrypt-20230607-0901', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 110, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-lxb-fscrypt-20230607-0901', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi149.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi184.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-09_04:16:27', 'tube': 'smithi', 'user': 'xiubli', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-09T04:35:58.228 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:35:58.230 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:35:58.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:35:58.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:35:58.344 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:35:58.344 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:35:58.366 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:35:58.366 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2023-06-09T04:35:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:35:58.422 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:58.422 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 371496 Links: 1 2023-06-09T04:35:58.423 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:58.423 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:58.423 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-09 04:35:50.402833821 +0000 2023-06-09T04:35:58.423 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-09 04:31:01.955112162 +0000 2023-06-09T04:35:58.423 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-09 04:31:01.955112162 +0000 2023-06-09T04:35:58.423 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-09T04:35:58.424 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:35:58.487 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-09T04:35:58.487 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-09T04:35:58.487 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000317624 s, 1.6 MB/s 2023-06-09T04:35:58.488 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:35:58.545 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2023-06-09T04:35:58.601 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:35:58.602 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:58.602 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 371635 Links: 1 2023-06-09T04:35:58.602 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:58.602 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:58.602 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-09 04:35:50.402833821 +0000 2023-06-09T04:35:58.602 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-09 04:31:02.495100716 +0000 2023-06-09T04:35:58.602 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-09 04:31:02.495100716 +0000 2023-06-09T04:35:58.603 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-09T04:35:58.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:35:58.666 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-09T04:35:58.667 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-09T04:35:58.667 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000220043 s, 2.3 MB/s 2023-06-09T04:35:58.668 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:35:58.724 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2023-06-09T04:35:58.781 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:35:58.781 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:58.781 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 373677 Links: 1 2023-06-09T04:35:58.781 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:58.781 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:58.782 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-09 04:35:50.403833800 +0000 2023-06-09T04:35:58.782 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-09 04:31:03.003089948 +0000 2023-06-09T04:35:58.782 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-09 04:31:03.003089948 +0000 2023-06-09T04:35:58.782 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-09T04:35:58.782 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:35:58.845 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-09T04:35:58.845 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-09T04:35:58.845 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000224925 s, 2.3 MB/s 2023-06-09T04:35:58.846 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:35:58.903 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2023-06-09T04:35:58.959 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:35:58.960 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:58.960 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 6h/6d Inode: 378082 Links: 1 2023-06-09T04:35:58.960 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:58.960 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:58.960 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2023-06-09 04:35:50.403833800 +0000 2023-06-09T04:35:58.961 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2023-06-09 04:31:03.687075449 +0000 2023-06-09T04:35:58.961 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2023-06-09 04:31:03.687075449 +0000 2023-06-09T04:35:58.961 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: - 2023-06-09T04:35:58.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:35:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2023-06-09T04:35:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2023-06-09T04:35:59.025 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000197675 s, 2.6 MB/s 2023-06-09T04:35:59.026 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:35:59.083 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:35:59.084 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:35:59.084 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:35:59.101 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:35:59.102 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2023-06-09T04:35:59.158 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:35:59.159 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 377065 Links: 1 2023-06-09T04:35:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-06-09 04:33:46.855267292 +0000 2023-06-09T04:35:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-06-09 04:31:07.844652105 +0000 2023-06-09T04:35:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-06-09 04:31:07.844652105 +0000 2023-06-09T04:35:59.160 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-06-09T04:35:59.160 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:35:59.224 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-06-09T04:35:59.225 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-06-09T04:35:59.225 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000275393 s, 1.9 MB/s 2023-06-09T04:35:59.226 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:35:59.283 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2023-06-09T04:35:59.340 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:35:59.341 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:59.341 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 379909 Links: 1 2023-06-09T04:35:59.341 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:59.341 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:59.341 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-06-09 04:33:46.855267292 +0000 2023-06-09T04:35:59.341 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-06-09 04:31:08.372640496 +0000 2023-06-09T04:35:59.341 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-06-09 04:31:08.372640496 +0000 2023-06-09T04:35:59.342 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-06-09T04:35:59.342 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:35:59.406 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-06-09T04:35:59.406 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-06-09T04:35:59.406 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000228156 s, 2.2 MB/s 2023-06-09T04:35:59.407 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:35:59.464 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2023-06-09T04:35:59.521 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:35:59.521 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:59.521 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 375328 Links: 1 2023-06-09T04:35:59.521 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:59.521 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:59.522 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-06-09 04:33:46.855267292 +0000 2023-06-09T04:35:59.522 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-06-09 04:31:08.903628821 +0000 2023-06-09T04:35:59.522 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-06-09 04:31:08.903628821 +0000 2023-06-09T04:35:59.522 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-06-09T04:35:59.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:35:59.586 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-06-09T04:35:59.586 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-06-09T04:35:59.586 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000326035 s, 1.6 MB/s 2023-06-09T04:35:59.587 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:35:59.644 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2023-06-09T04:35:59.701 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:35:59.701 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:35:59.701 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 6h/6d Inode: 375365 Links: 1 2023-06-09T04:35:59.701 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:35:59.701 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2023-06-09T04:35:59.701 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2023-06-09 04:33:46.855267292 +0000 2023-06-09T04:35:59.702 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2023-06-09 04:31:09.419617476 +0000 2023-06-09T04:35:59.702 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2023-06-09 04:31:09.419617476 +0000 2023-06-09T04:35:59.702 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2023-06-09T04:35:59.702 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:35:59.765 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2023-06-09T04:35:59.765 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2023-06-09T04:35:59.765 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000190437 s, 2.7 MB/s 2023-06-09T04:35:59.766 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:35:59.823 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:35:59.823 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:35:59.824 INFO:tasks.ceph:Generating config... 2023-06-09T04:35:59.825 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-09T04:35:59.825 INFO:tasks.ceph:[client] debug client = 20 2023-06-09T04:35:59.825 INFO:tasks.ceph:[client] debug ms = 1 2023-06-09T04:35:59.826 INFO:tasks.ceph:[client] pid file = 2023-06-09T04:35:59.826 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-09T04:35:59.826 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-09T04:35:59.826 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-09T04:35:59.826 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-09T04:35:59.827 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-09T04:35:59.827 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-09T04:35:59.827 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-09T04:35:59.827 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-09T04:35:59.827 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-09T04:35:59.827 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-09T04:35:59.828 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-09T04:35:59.828 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-09T04:35:59.828 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-09T04:35:59.828 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-09T04:35:59.829 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-09T04:35:59.829 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-09T04:35:59.829 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-09T04:35:59.829 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-09T04:35:59.829 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-09T04:35:59.829 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-09T04:35:59.830 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-09T04:35:59.830 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-09T04:35:59.830 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-09T04:35:59.830 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-09T04:35:59.830 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-09T04:35:59.831 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-09T04:35:59.831 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-09T04:35:59.831 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-09T04:35:59.831 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-09T04:35:59.831 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-09T04:35:59.832 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-09T04:35:59.832 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-09T04:35:59.832 INFO:tasks.ceph:Setting up mon.a... 2023-06-09T04:35:59.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-09T04:35:59.887 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.keyring 2023-06-09T04:35:59.890 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-09T04:35:59.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:35:59.964 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.149'), ('mon.b', '172.21.15.184'), ('mon.c', '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]')] 2023-06-09T04:35:59.965 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.149,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-09T04:35:59.965 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:35:59.966 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:36:00.021 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.149 --add b 172.21.15.184 --addv c '[v2:172.21.15.184:3301,v1:172.21.15.184:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:00.108 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:00.108 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: generated fsid 8958df92-450c-4c1c-8166-a5a3573afffd 2023-06-09T04:36:00.108 INFO:teuthology.orchestra.run.smithi149.stdout:setting min_mon_release = pacific 2023-06-09T04:36:00.108 INFO:teuthology.orchestra.run.smithi149.stdout:epoch 0 2023-06-09T04:36:00.108 INFO:teuthology.orchestra.run.smithi149.stdout:fsid 8958df92-450c-4c1c-8166-a5a3573afffd 2023-06-09T04:36:00.109 INFO:teuthology.orchestra.run.smithi149.stdout:last_changed 2023-06-09T04:36:00.108213+0000 2023-06-09T04:36:00.109 INFO:teuthology.orchestra.run.smithi149.stdout:created 2023-06-09T04:36:00.108213+0000 2023-06-09T04:36:00.109 INFO:teuthology.orchestra.run.smithi149.stdout:min_mon_release 16 (pacific) 2023-06-09T04:36:00.109 INFO:teuthology.orchestra.run.smithi149.stdout:election_strategy: 1 2023-06-09T04:36:00.109 INFO:teuthology.orchestra.run.smithi149.stdout:0: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.a 2023-06-09T04:36:00.109 INFO:teuthology.orchestra.run.smithi149.stdout:1: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.b 2023-06-09T04:36:00.109 INFO:teuthology.orchestra.run.smithi149.stdout:2: [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] mon.c 2023-06-09T04:36:00.110 INFO:teuthology.orchestra.run.smithi149.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-09T04:36:00.111 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:36:00.127 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8958df92-450c-4c1c-8166-a5a3573afffd... 2023-06-09T04:36:00.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:36:00.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:36:00.212 INFO:teuthology.orchestra.run.smithi149.stdout:[global] 2023-06-09T04:36:00.212 INFO:teuthology.orchestra.run.smithi149.stdout: chdir = "" 2023-06-09T04:36:00.212 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:36:00.212 INFO:teuthology.orchestra.run.smithi149.stdout: auth supported = cephx 2023-06-09T04:36:00.212 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: filestore xattr use omap = true 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: mon clock drift allowed = 1.000 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: osd crush chooseleaf type = 0 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: auth debug = true 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.213 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on old message = true 2023-06-09T04:36:00.214 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on bug = true 2023-06-09T04:36:00.214 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.214 INFO:teuthology.orchestra.run.smithi149.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:36:00.214 INFO:teuthology.orchestra.run.smithi149.stdout: mon pg warn max object skew = 0 2023-06-09T04:36:00.214 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.214 INFO:teuthology.orchestra.run.smithi149.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:36:00.214 INFO:teuthology.orchestra.run.smithi149.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default size = 2 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow primary affinity = true 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd allow pg remap = true 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:36:00.215 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on no sortbitwise = false 2023-06-09T04:36:00.216 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:36:00.216 INFO:teuthology.orchestra.run.smithi149.stdout: mon warn on too few osds = false 2023-06-09T04:36:00.216 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:36:00.216 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:36:00.216 INFO:teuthology.orchestra.run.smithi149.stdout: mon_allow_pool_size_one = true 2023-06-09T04:36:00.216 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.216 INFO:teuthology.orchestra.run.smithi149.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:36:00.217 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.217 INFO:teuthology.orchestra.run.smithi149.stdout: osd default data pool replay window = 5 2023-06-09T04:36:00.217 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.217 INFO:teuthology.orchestra.run.smithi149.stdout: mon allow pool delete = true 2023-06-09T04:36:00.217 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.217 INFO:teuthology.orchestra.run.smithi149.stdout: mon cluster log file level = debug 2023-06-09T04:36:00.217 INFO:teuthology.orchestra.run.smithi149.stdout: debug asserts on shutdown = true 2023-06-09T04:36:00.218 INFO:teuthology.orchestra.run.smithi149.stdout: mon health detail to clog = false 2023-06-09T04:36:00.218 INFO:teuthology.orchestra.run.smithi149.stdout: mon host = "172.21.15.149,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-06-09T04:36:00.218 INFO:teuthology.orchestra.run.smithi149.stdout: ms die on skipped message = False 2023-06-09T04:36:00.218 INFO:teuthology.orchestra.run.smithi149.stdout: fsid = 8958df92-450c-4c1c-8166-a5a3573afffd 2023-06-09T04:36:00.218 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.218 INFO:teuthology.orchestra.run.smithi149.stdout:[osd] 2023-06-09T04:36:00.218 INFO:teuthology.orchestra.run.smithi149.stdout: osd journal size = 100 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub load threshold = 5.0 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: osd scrub max interval = 600 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: osd recover clone overlap = true 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: osd recovery max chunk = 1048576 2023-06-09T04:36:00.219 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.220 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug shutdown = true 2023-06-09T04:36:00.220 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug op order = true 2023-06-09T04:36:00.220 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug verify stray on activate = true 2023-06-09T04:36:00.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.220 INFO:teuthology.orchestra.run.smithi149.stdout: osd open classes on start = true 2023-06-09T04:36:00.220 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug pg log writeout = true 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: osd map max advance = 10 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: journal zero on create = true 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.221 INFO:teuthology.orchestra.run.smithi149.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: filestore apply finisher threads = 3 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: bdev debug aio = true 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: osd debug misdirected ops = true 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore block size = 96636764160 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: bluestore fsck on mount = True 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluefs = 20 2023-06-09T04:36:00.222 INFO:teuthology.orchestra.run.smithi149.stdout: debug bluestore = 20 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: debug osd = 20 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: debug rocksdb = 10 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd full ratio = 0.9 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:36:00.223 INFO:teuthology.orchestra.run.smithi149.stdout: osd objectstore = bluestore 2023-06-09T04:36:00.224 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-06-09T04:36:00.224 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.224 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr] 2023-06-09T04:36:00.224 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-09T04:36:00.224 INFO:teuthology.orchestra.run.smithi149.stdout: debug mgr = 20 2023-06-09T04:36:00.224 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-06-09T04:36:00.224 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout: mgr/telemetry/nag = false 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout:[mon] 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout: debug mon = 20 2023-06-09T04:36:00.225 INFO:teuthology.orchestra.run.smithi149.stdout: debug paxos = 20 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: debug auth = 20 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon data avail warn = 5 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon mgr mkfs grace = 240 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd reporter subtree level = osd 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon osd prime pg temp = true 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:36:00.226 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:36:00.227 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout: # 1m isn't quite enough 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout: mon op complaint time = 120 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout:[client] 2023-06-09T04:36:00.228 INFO:teuthology.orchestra.run.smithi149.stdout: rgw cache enabled = true 2023-06-09T04:36:00.229 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable ops log = true 2023-06-09T04:36:00.229 INFO:teuthology.orchestra.run.smithi149.stdout: rgw enable usage log = true 2023-06-09T04:36:00.229 INFO:teuthology.orchestra.run.smithi149.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:36:00.229 INFO:teuthology.orchestra.run.smithi149.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:36:00.229 INFO:teuthology.orchestra.run.smithi149.stdout: client mount timeout = 600 2023-06-09T04:36:00.229 INFO:teuthology.orchestra.run.smithi149.stdout: debug client = 20 2023-06-09T04:36:00.229 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-09T04:36:00.230 INFO:teuthology.orchestra.run.smithi149.stdout: pid file = "" 2023-06-09T04:36:00.230 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-06-09T04:36:00.230 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-06-09T04:36:00.230 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.a] 2023-06-09T04:36:00.230 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.b] 2023-06-09T04:36:00.230 INFO:teuthology.orchestra.run.smithi149.stdout:[mon.c] 2023-06-09T04:36:00.230 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout:[mds] 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds = 20 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout: debug mds balancer = 20 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout: debug ms = 1 2023-06-09T04:36:00.231 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug frag = True 2023-06-09T04:36:00.232 INFO:teuthology.orchestra.run.smithi149.stdout: mds debug scatterstat = True 2023-06-09T04:36:00.232 INFO:teuthology.orchestra.run.smithi149.stdout: mds op complaint time = 180 2023-06-09T04:36:00.232 INFO:teuthology.orchestra.run.smithi149.stdout: mds verify scatter = True 2023-06-09T04:36:00.232 INFO:teuthology.orchestra.run.smithi149.stdout: osd op complaint time = 180 2023-06-09T04:36:00.232 INFO:teuthology.orchestra.run.smithi149.stdout: rados mon op timeout = 900 2023-06-09T04:36:00.232 INFO:teuthology.orchestra.run.smithi149.stdout: rados osd op timeout = 900 2023-06-09T04:36:00.233 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2023-06-09T04:36:00.234 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2023-06-09T04:36:00.234 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:36:00.234 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2023-06-09T04:36:00.234 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.234 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2023-06-09T04:36:00.234 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.234 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2023-06-09T04:36:00.235 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.235 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2023-06-09T04:36:00.235 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2023-06-09T04:36:00.235 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.235 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2023-06-09T04:36:00.235 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2023-06-09T04:36:00.235 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2023-06-09T04:36:00.236 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.237 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2023-06-09T04:36:00.237 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2023-06-09T04:36:00.237 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:36:00.237 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:36:00.237 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2023-06-09T04:36:00.237 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:36:00.237 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2023-06-09T04:36:00.238 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:36:00.238 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:36:00.238 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2023-06-09T04:36:00.238 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.238 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:36:00.238 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.238 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.149,172.21.15.184,[v2:172.21.15.184:3301,v1:172.21.15.184:6790]" 2023-06-09T04:36:00.239 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = 8958df92-450c-4c1c-8166-a5a3573afffd 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2023-06-09T04:36:00.240 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2023-06-09T04:36:00.241 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.242 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2023-06-09T04:36:00.243 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2023-06-09T04:36:00.244 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2023-06-09T04:36:00.245 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-06-09T04:36:00.246 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2023-06-09T04:36:00.247 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:36:00.248 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.248 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:36:00.248 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:36:00.248 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:36:00.248 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.248 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:36:00.248 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:36:00.249 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:36:00.249 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.249 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2023-06-09T04:36:00.249 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:36:00.249 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.249 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:36:00.249 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:36:00.250 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2023-06-09T04:36:00.251 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2023-06-09T04:36:00.251 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-06-09T04:36:00.251 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = "" 2023-06-09T04:36:00.251 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-06-09T04:36:00.251 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-06-09T04:36:00.251 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2023-06-09T04:36:00.251 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2023-06-09T04:36:00.252 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds balancer = 20 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2023-06-09T04:36:00.253 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2023-06-09T04:36:00.254 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-09T04:36:00.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-09T04:36:00.331 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-09T04:36:00.331 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:00.332 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-09T04:36:00.348 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:00.349 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-09T04:36:00.403 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:36:00.404 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:00.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:36:00.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:36:00.479 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:00.480 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:00.536 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:36:00.536 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:00.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:36:00.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:36:00.574 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:00.574 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:00.630 INFO:tasks.ceph:Setting up mon nodes... 2023-06-09T04:36:00.630 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-09T04:36:00.631 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:36:00.684 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:36:00.686 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:36:00.785 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:36:00.788 INFO:tasks.ceph:Setting up mds nodes... 2023-06-09T04:36:00.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:36:00.842 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:36:00.844 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-09T04:36:00.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:36:00.963 INFO:teuthology.orchestra.run.smithi149.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:36:00.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-09T04:36:00.991 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:36:01.044 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:36:01.047 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-09T04:36:01.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:36:01.165 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:36:01.168 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-09T04:36:01.193 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-09T04:36:01.194 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-09T04:36:01.236 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-09T04:36:01.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-09T04:36:01.292 INFO:teuthology.orchestra.run.smithi149.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-09T04:36:01.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-09T04:36:01.347 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-09T04:36:01.360 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-09T04:36:01.442 INFO:teuthology.orchestra.run.smithi184.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-09T04:36:01.455 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-09T04:36:01.455 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi149.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:36:01.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-09T04:36:01.481 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:01.482 INFO:tasks.ceph:role: osd.0 2023-06-09T04:36:01.482 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:36:01.482 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:36:01.555 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:01.556 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:01.556 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:01.556 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:01.556 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:01.557 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:01.557 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:01.557 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:01.557 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:01.557 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:01.990 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-06-09T04:36:01.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-09T04:36:01.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-09T04:36:02.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-09T04:36:02.205 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-09T04:36:02.272 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:02.272 INFO:tasks.ceph:role: osd.1 2023-06-09T04:36:02.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:36:02.272 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:36:02.345 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:02.345 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:02.346 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:02.346 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:02.346 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:02.346 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:02.346 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:02.771 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-06-09T04:36:02.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-09T04:36:02.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-09T04:36:02.882 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-09T04:36:02.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-09T04:36:02.980 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:02.980 INFO:tasks.ceph:role: osd.2 2023-06-09T04:36:02.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:36:02.981 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:36:03.054 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:03.054 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:03.055 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:03.055 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:03.055 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:03.055 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:03.055 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:03.501 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-06-09T04:36:03.503 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-09T04:36:03.503 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-09T04:36:03.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-09T04:36:03.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-09T04:36:03.775 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:03.775 INFO:tasks.ceph:role: osd.3 2023-06-09T04:36:03.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:36:03.776 DEBUG:teuthology.orchestra.run.smithi149:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:36:03.850 INFO:teuthology.orchestra.run.smithi149.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:03.850 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:03.850 INFO:teuthology.orchestra.run.smithi149.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:03.851 INFO:teuthology.orchestra.run.smithi149.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:03.851 INFO:teuthology.orchestra.run.smithi149.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:03.851 INFO:teuthology.orchestra.run.smithi149.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:03.851 INFO:teuthology.orchestra.run.smithi149.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:03.851 INFO:teuthology.orchestra.run.smithi149.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:03.851 INFO:teuthology.orchestra.run.smithi149.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:03.851 INFO:teuthology.orchestra.run.smithi149.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:04.290 INFO:teuthology.orchestra.run.smithi149.stdout:Discarding blocks...Done. 2023-06-09T04:36:04.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi149.front.sepia.ceph.com -o noatime 2023-06-09T04:36:04.293 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-09T04:36:04.476 DEBUG:teuthology.orchestra.run.smithi149:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-09T04:36:04.511 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:04.774+0000 7f3524dab640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-09T04:36:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:04.775+0000 7f3524dab640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-09T04:36:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:04.775+0000 7f3524dab640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:36:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:04.775+0000 7f3524dab640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:36:04.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:04.775+0000 7f3524dab640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:36:04.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:04.775+0000 7f3524dab640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-09T04:36:07.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-09T04:36:07.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:07.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:07.774+0000 7f3893ce5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-09T04:36:07.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:07.774+0000 7f3893ce5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-09T04:36:07.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:07.774+0000 7f3893ce5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:36:07.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:07.774+0000 7f3893ce5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:36:07.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:07.774+0000 7f3893ce5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:36:07.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:07.775+0000 7f3893ce5640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-09T04:36:10.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-09T04:36:10.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:10.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:10.753+0000 7f32a62a3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-09T04:36:10.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:10.754+0000 7f32a62a3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-09T04:36:10.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:10.754+0000 7f32a62a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:36:10.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:10.754+0000 7f32a62a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:36:10.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:10.754+0000 7f32a62a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:36:10.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:10.754+0000 7f32a62a3640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-09T04:36:13.621 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-09T04:36:13.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:13.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:13.739+0000 7fa50d835640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-09T04:36:13.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:13.740+0000 7fa50d835640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-09T04:36:13.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:13.740+0000 7fa50d835640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:36:13.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:13.740+0000 7fa50d835640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:36:13.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:13.740+0000 7fa50d835640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:36:13.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:13.740+0000 7fa50d835640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-09T04:36:16.600 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-09T04:36:16.630 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-09T04:36:16.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:16.662 INFO:tasks.ceph:role: osd.4 2023-06-09T04:36:16.662 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:36:16.663 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:36:16.740 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:16.740 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:16.740 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:16.741 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:16.741 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:16.741 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:16.741 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:17.179 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-06-09T04:36:17.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-06-09T04:36:17.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-09T04:36:17.363 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-09T04:36:17.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-09T04:36:17.467 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:17.467 INFO:tasks.ceph:role: osd.5 2023-06-09T04:36:17.467 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:36:17.467 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:36:17.541 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:17.541 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:17.542 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:17.542 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:17.542 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:17.542 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:17.542 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:17.542 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:17.542 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:17.543 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:17.954 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-06-09T04:36:17.956 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-06-09T04:36:17.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-09T04:36:18.064 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-09T04:36:18.096 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-09T04:36:18.163 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:18.163 INFO:tasks.ceph:role: osd.6 2023-06-09T04:36:18.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:36:18.164 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:36:18.236 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:18.237 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:18.237 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:18.237 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:18.237 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:18.237 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:18.237 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:18.238 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:18.238 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:18.238 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:18.675 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-06-09T04:36:18.677 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-06-09T04:36:18.677 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-09T04:36:18.848 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-09T04:36:18.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-09T04:36:18.945 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:36:18.945 INFO:tasks.ceph:role: osd.7 2023-06-09T04:36:18.945 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:36:18.946 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:36:19.019 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:36:19.020 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:36:19.020 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:36:19.020 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-09T04:36:19.020 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:36:19.020 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:36:19.020 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:36:19.020 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:36:19.021 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:36:19.021 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:36:19.471 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2023-06-09T04:36:19.473 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2023-06-09T04:36:19.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-09T04:36:19.651 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-09T04:36:19.685 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:19.788 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:19.787+0000 7f533571f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-09T04:36:19.789 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:19.787+0000 7f533571f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-09T04:36:19.789 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:19.788+0000 7f533571f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:36:19.789 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:19.788+0000 7f533571f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:36:19.790 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:19.788+0000 7f533571f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:36:19.790 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:19.788+0000 7f533571f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-09T04:36:22.652 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-09T04:36:22.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:22.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:22.773+0000 7fb7d9403640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-09T04:36:22.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:22.773+0000 7fb7d9403640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-09T04:36:22.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:22.773+0000 7fb7d9403640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:36:22.775 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:22.774+0000 7fb7d9403640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:36:22.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:22.774+0000 7fb7d9403640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:36:22.776 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:22.774+0000 7fb7d9403640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-09T04:36:25.643 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-09T04:36:25.674 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:25.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:25.763+0000 7f30de0a3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-09T04:36:25.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:25.763+0000 7f30de0a3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-09T04:36:25.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:25.763+0000 7f30de0a3640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:36:25.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:25.763+0000 7f30de0a3640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:36:25.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:25.763+0000 7f30de0a3640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:36:25.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:25.764+0000 7f30de0a3640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-09T04:36:28.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:36:28.232 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:36:28.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-09T04:36:28.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:28.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:28.763+0000 7fa2a30ac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-09T04:36:28.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:28.763+0000 7fa2a30ac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-09T04:36:28.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:28.763+0000 7fa2a30ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:36:28.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:28.763+0000 7fa2a30ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:36:28.765 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:28.763+0000 7fa2a30ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:36:28.766 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:28.764+0000 7fa2a30ac640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-09T04:36:31.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-09T04:36:31.656 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-09T04:36:31.657 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:31.657 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-09T04:36:31.686 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:31.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-09T04:36:31.751 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:31.751 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-09T04:36:31.818 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:31.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-09T04:36:31.885 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:31.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-09T04:36:31.952 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:31.952 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-09T04:36:32.019 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:32.019 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-09T04:36:32.086 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.086 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-09T04:36:32.117 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.118 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-09T04:36:32.188 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.189 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-09T04:36:32.258 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.258 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-09T04:36:32.326 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-09T04:36:32.394 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.394 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-09T04:36:32.461 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.462 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-09T04:36:32.528 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:32.528 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-09T04:36:32.544 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:32.544 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-09T04:36:32.601 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.601 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-09T04:36:32.618 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:32.618 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-09T04:36:32.675 INFO:tasks.ceph:Adding keys to all mons... 2023-06-09T04:36:32.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:36:32.677 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:36:32.718 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.y] 2023-06-09T04:36:32.718 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAwrIJkETXLKBAAL4kg22/BkmCqzzjk81xNQA== 2023-06-09T04:36:32.718 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.a] 2023-06-09T04:36:32.718 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAwrIJkOxg4MhAA0mKD3EbWcN9NdMSj5X6ugg== 2023-06-09T04:36:32.718 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.c] 2023-06-09T04:36:32.718 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAwrIJkgP1pORAAMV3u6xgej85xYE2v7QXRmQ== 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.0] 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA0rIJkCHNDLhAAJcROpElQl0GeISJ4LWwV0g== 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.1] 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA3rIJkcRY+LhAA3ehtWSzFGUk1s5cbuU7huQ== 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.2] 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA6rIJkcucDLRAAJe1nvO9Qi0CIgqcJJDpQSA== 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.3] 2023-06-09T04:36:32.719 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQA9rIJkyUcsLBAAvaczCRou+iRo+SZKpk333Q== 2023-06-09T04:36:32.720 INFO:teuthology.orchestra.run.smithi149.stdout:[mgr.x] 2023-06-09T04:36:32.720 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAwrIJksW/bLhAAsE9C4RNZwCpVVdfDNeu5yg== 2023-06-09T04:36:32.720 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.b] 2023-06-09T04:36:32.720 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAxrIJkBSuwAhAALUBpODXvUmsR/5njb3WVcw== 2023-06-09T04:36:32.720 INFO:teuthology.orchestra.run.smithi149.stdout:[mds.d] 2023-06-09T04:36:32.720 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAxrIJkqO3lCRAAfpHkpnEzOtGcfxWznUoC0w== 2023-06-09T04:36:32.720 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.4] 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBDrIJkiE/9LhAAlFS2EeY53bjfW+yw2ESz2g== 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.5] 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBGrIJkEgc2LhAAbcwqWh/ssrzFdpj4Lb8JOw== 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.6] 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBJrIJkjtmbLRAA9n+zHQ8tc167dF8J2xJQzw== 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout:[osd.7] 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQBMrIJkxLiZLRAAzT0ZEyWHOh19YJtqO9SUtA== 2023-06-09T04:36:32.721 INFO:teuthology.orchestra.run.smithi149.stdout:[client.0] 2023-06-09T04:36:32.722 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAxrIJktnEkDhAA+rHerKk2ySHGeQ7cztjsIw== 2023-06-09T04:36:32.722 INFO:teuthology.orchestra.run.smithi149.stdout:[client.2] 2023-06-09T04:36:32.722 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAxrIJk0UVxERAALXvjqSqyxcNz8b5EsY8ySg== 2023-06-09T04:36:32.722 INFO:teuthology.orchestra.run.smithi149.stdout:[client.1] 2023-06-09T04:36:32.722 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAxrIJkTwe6FBAAHoWLUAMxepprRks07H63Ow== 2023-06-09T04:36:32.722 INFO:teuthology.orchestra.run.smithi149.stdout:[client.3] 2023-06-09T04:36:32.722 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAxrIJkg2xmGhAAtCTewRUqbOL5wTS0IOKVpA== 2023-06-09T04:36:32.740 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2023-06-09T04:36:32.740 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAwrIJkETXLKBAAL4kg22/BkmCqzzjk81xNQA== 2023-06-09T04:36:32.740 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2023-06-09T04:36:32.741 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAwrIJkOxg4MhAA0mKD3EbWcN9NdMSj5X6ugg== 2023-06-09T04:36:32.741 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2023-06-09T04:36:32.741 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAwrIJkgP1pORAAMV3u6xgej85xYE2v7QXRmQ== 2023-06-09T04:36:32.741 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2023-06-09T04:36:32.741 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA0rIJkCHNDLhAAJcROpElQl0GeISJ4LWwV0g== 2023-06-09T04:36:32.741 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2023-06-09T04:36:32.741 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA3rIJkcRY+LhAA3ehtWSzFGUk1s5cbuU7huQ== 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA6rIJkcucDLRAAJe1nvO9Qi0CIgqcJJDpQSA== 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQA9rIJkyUcsLBAAvaczCRou+iRo+SZKpk333Q== 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAwrIJksW/bLhAAsE9C4RNZwCpVVdfDNeu5yg== 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2023-06-09T04:36:32.742 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAxrIJkBSuwAhAALUBpODXvUmsR/5njb3WVcw== 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAxrIJkqO3lCRAAfpHkpnEzOtGcfxWznUoC0w== 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBDrIJkiE/9LhAAlFS2EeY53bjfW+yw2ESz2g== 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBGrIJkEgc2LhAAbcwqWh/ssrzFdpj4Lb8JOw== 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2023-06-09T04:36:32.743 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBJrIJkjtmbLRAA9n+zHQ8tc167dF8J2xJQzw== 2023-06-09T04:36:32.744 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2023-06-09T04:36:32.744 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBMrIJkxLiZLRAAzT0ZEyWHOh19YJtqO9SUtA== 2023-06-09T04:36:32.744 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2023-06-09T04:36:32.744 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAxrIJktnEkDhAA+rHerKk2ySHGeQ7cztjsIw== 2023-06-09T04:36:32.744 INFO:teuthology.orchestra.run.smithi184.stdout:[client.2] 2023-06-09T04:36:32.744 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAxrIJk0UVxERAALXvjqSqyxcNz8b5EsY8ySg== 2023-06-09T04:36:32.744 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2023-06-09T04:36:32.745 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAxrIJkTwe6FBAAHoWLUAMxepprRks07H63Ow== 2023-06-09T04:36:32.745 INFO:teuthology.orchestra.run.smithi184.stdout:[client.3] 2023-06-09T04:36:32.745 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAxrIJkg2xmGhAAtCTewRUqbOL5wTS0IOKVpA== 2023-06-09T04:36:32.746 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:36:32.765 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:36:32.840 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:32.842 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:32.897 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:32.899 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:32.955 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:32.957 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.009 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.011 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.119 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:36:33.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:36:33.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:33.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:33.283 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:33.285 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:36:33.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.343 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.396 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.398 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.453 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:36:33.560 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.562 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.619 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.677 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.735 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:36:33.791 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-09T04:36:33.792 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-09T04:36:33.819 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:36:33.920 DEBUG:teuthology.orchestra.run.smithi149:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-09T04:36:33.949 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-09T04:36:33.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:36:34.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-09T04:36:34.099 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-09T04:36:34.165 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:36:34.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-09T04:36:34.289 DEBUG:teuthology.orchestra.run.smithi149:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:34.291 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:36:34.344 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-09T04:36:34.345 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-09T04:36:34.345 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-09T04:36:34.347 INFO:tasks.ceph.mon.a:Started 2023-06-09T04:36:34.347 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-09T04:36:34.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-09T04:36:34.386 INFO:tasks.ceph.mon.b:Started 2023-06-09T04:36:34.386 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-09T04:36:34.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-09T04:36:34.388 INFO:tasks.ceph.mon.c:Started 2023-06-09T04:36:34.389 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-09T04:36:34.389 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-09T04:36:34.389 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-09T04:36:34.391 INFO:tasks.ceph.mgr.y:Started 2023-06-09T04:36:34.392 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-09T04:36:34.392 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-09T04:36:34.394 INFO:tasks.ceph.mgr.x:Started 2023-06-09T04:36:34.394 INFO:tasks.ceph:Setting crush tunables to default 2023-06-09T04:36:34.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd crush tunables default 2023-06-09T04:36:34.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.517+0000 7f2f2dc1f700 1 Processor -- start 2023-06-09T04:36:34.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.517+0000 7f2f2dc1f700 1 -- start start 2023-06-09T04:36:34.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.517+0000 7f2f2dc1f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:34.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.517+0000 7f2f2dc1f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 0x7f2f280cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:34.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.517+0000 7f2f2dc1f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f280d0d30 con 0x7f2f280cd670 2023-06-09T04:36:34.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.517+0000 7f2f2dc1f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2806aec0 con 0x7f2f280ce310 2023-06-09T04:36:34.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.517+0000 7f2f2dc1f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280d1520 con 0x7f2f2815c270 2023-06-09T04:36:34.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f26ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 0x7f2f280cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:34.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f26ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 0x7f2f280cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35286/0 (socket says 172.21.15.149:35286) 2023-06-09T04:36:34.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f26ffd700 1 -- 172.21.15.149:0/3877151101 learned_addr learned my addr 172.21.15.149:0/3877151101 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:34.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f26ffd700 1 -- 172.21.15.149:0/3877151101 >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 msgr2=0x7f2f280cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T04:36:34.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f26ffd700 1 -- 172.21.15.149:0/3877151101 >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 msgr2=0x7f2f280cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:36:34.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f26ffd700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 0x7f2f280cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:36:34.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f26ffd700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 0x7f2f280cd130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:36:34.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f277fe700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:34.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f277fe700 1 -- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 msgr2=0x7f2f280d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-09T04:36:34.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f277fe700 1 -- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 msgr2=0x7f2f280d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:36:34.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f277fe700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:36:34.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.518+0000 7f2f277fe700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:36:34.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.715+0000 7f2f267fc700 1 -- 172.21.15.149:0/3877151101 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345456535 0 0) 0x7f2f280d0d30 con 0x7f2f280cd670 2023-06-09T04:36:34.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.715+0000 7f2f267fc700 1 -- 172.21.15.149:0/3877151101 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f140035b0 con 0x7f2f280cd670 2023-06-09T04:36:34.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f26ffd700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.149:3300/0 conn(0x7f2f280ce310 0x7f2f280cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:34.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f277fe700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:34.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f26ffd700 1 -- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 msgr2=0x7f2f280d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:34.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f26ffd700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f26ffd700 1 -- 172.21.15.149:0/3877151101 >> v1:172.21.15.184:6789/0 conn(0x7f2f280cd670 legacy=0x7f2f2815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:34.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f26ffd700 1 -- 172.21.15.149:0/3877151101 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280cdad0 con 0x7f2f280ce310 2023-06-09T04:36:34.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f277fe700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:34.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.719+0000 7f2f26ffd700 1 --2- 172.21.15.149:0/3877151101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280ce310 0x7f2f280cd130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f2806f5e0 tx=0x7f2f10009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84380edf67d2bca0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:34.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f267fc700 1 -- 172.21.15.149:0/3877151101 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f10004230 con 0x7f2f280ce310 2023-06-09T04:36:34.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f267fc700 1 -- 172.21.15.149:0/3877151101 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10004390 con 0x7f2f280ce310 2023-06-09T04:36:34.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f267fc700 1 -- 172.21.15.149:0/3877151101 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100036a0 con 0x7f2f280ce310 2023-06-09T04:36:34.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/3877151101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280ce310 msgr2=0x7f2f280cd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:34.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 --2- 172.21.15.149:0/3877151101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280ce310 0x7f2f280cd130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f2806f5e0 tx=0x7f2f10009c30 comp rx=0 tx=0).stop 2023-06-09T04:36:34.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/3877151101 shutdown_connections 2023-06-09T04:36:34.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 --2- 172.21.15.149:0/3877151101 >> v2:172.21.15.184:3300/0 conn(0x7f2f2815c270 0x7f2f280d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 --2- 172.21.15.149:0/3877151101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280ce310 0x7f2f280cd130 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/3877151101 >> 172.21.15.149:0/3877151101 conn(0x7f2f28069db0 msgr2=0x7f2f2806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:34.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/3877151101 shutdown_connections 2023-06-09T04:36:34.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.720+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/3877151101 wait complete. 2023-06-09T04:36:34.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.722+0000 7f2f2dc1f700 1 Processor -- start 2023-06-09T04:36:34.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.722+0000 7f2f2dc1f700 1 -- start start 2023-06-09T04:36:34.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f2dc1f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280cd670 0x7f2f2815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:34.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f2dc1f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f280ce310 0x7f2f2815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:34.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f2dc1f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2815c270 0x7f2f2815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:34.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f2dc1f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2814a8a0 con 0x7f2f280cd670 2023-06-09T04:36:34.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f2dc1f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28149c90 con 0x7f2f2815c270 2023-06-09T04:36:34.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f2dc1f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f28149f70 con 0x7f2f280ce310 2023-06-09T04:36:34.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280cd670 0x7f2f2815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:34.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280cd670 0x7f2f2815c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35314/0 (socket says 172.21.15.149:35314) 2023-06-09T04:36:34.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 -- 172.21.15.149:0/1723718441 learned_addr learned my addr 172.21.15.149:0/1723718441 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:34.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f26ffd700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f280ce310 0x7f2f2815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:34.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f27fff700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2815c270 0x7f2f2815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:34.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 -- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f280ce310 msgr2=0x7f2f2815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:34.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f280ce310 0x7f2f2815cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 -- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2815c270 msgr2=0x7f2f2815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:34.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2815c270 0x7f2f2815ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 -- 172.21.15.149:0/1723718441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18009ad0 con 0x7f2f280cd670 2023-06-09T04:36:34.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f26ffd700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f280ce310 0x7f2f2815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:34.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f27fff700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2815c270 0x7f2f2815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:34.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.723+0000 7f2f277fe700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280cd670 0x7f2f2815c7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f18007630 tx=0x7f2f180079f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:34.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.725+0000 7f2f1ffff700 1 -- 172.21.15.149:0/1723718441 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18003b90 con 0x7f2f280cd670 2023-06-09T04:36:34.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.725+0000 7f2f1ffff700 1 -- 172.21.15.149:0/1723718441 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18013780 con 0x7f2f280cd670 2023-06-09T04:36:34.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.725+0000 7f2f1ffff700 1 -- 172.21.15.149:0/1723718441 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18013af0 con 0x7f2f280cd670 2023-06-09T04:36:34.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.725+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f100095b0 con 0x7f2f280cd670 2023-06-09T04:36:34.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.725+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2814a530 con 0x7f2f280cd670 2023-06-09T04:36:34.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.725+0000 7f2f1ffff700 1 -- 172.21.15.149:0/1723718441 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2f18013c50 con 0x7f2f280cd670 2023-06-09T04:36:34.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.725+0000 7f2f1ffff700 1 -- 172.21.15.149:0/1723718441 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f18014410 con 0x7f2f280cd670 2023-06-09T04:36:34.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.726+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2814a6c0 con 0x7f2f280cd670 2023-06-09T04:36:34.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.728+0000 7f2f1ffff700 1 -- 172.21.15.149:0/1723718441 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2f1801d5b0 con 0x7f2f280cd670 2023-06-09T04:36:34.804 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.803+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2f28073fa0 con 0x7f2f280cd670 2023-06-09T04:36:34.807 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.806+0000 7f2f1ffff700 1 -- 172.21.15.149:0/1723718441 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2f1801d750 con 0x7f2f280cd670 2023-06-09T04:36:34.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280cd670 msgr2=0x7f2f2815c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:34.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280cd670 0x7f2f2815c7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f18007630 tx=0x7f2f180079f0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 shutdown_connections 2023-06-09T04:36:34.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2815c270 0x7f2f2815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f280cd670 0x7f2f2815c7d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 --2- 172.21.15.149:0/1723718441 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f280ce310 0x7f2f2815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:34.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 >> 172.21.15.149:0/1723718441 conn(0x7f2f28069db0 msgr2=0x7f2f280cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:34.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 shutdown_connections 2023-06-09T04:36:34.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:34.807+0000 7f2f2dc1f700 1 -- 172.21.15.149:0/1723718441 wait complete. 2023-06-09T04:36:34.812 INFO:teuthology.orchestra.run.smithi149.stderr:adjusted tunables profile to default 2023-06-09T04:36:34.820 INFO:tasks.ceph:check_enable_crimson: False 2023-06-09T04:36:34.821 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-09T04:36:34.821 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:34.821 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-09T04:36:34.847 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:34.847 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-09T04:36:34.849 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:34.848+0000 7f3f73acf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:36:34.874 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:34.874 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-09T04:36:34.918 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:34.917+0000 7f3f73acf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:36:34.939 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:36:34.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-09T04:36:34.998 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:34.997+0000 7f3f73acf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:36:35.007 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:35.007 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-09T04:36:35.034 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:35.035 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-09T04:36:35.081 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:35.080+0000 7f3f73acf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:36:35.102 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:35.103 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-09T04:36:35.168 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:36:35.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-09T04:36:35.192 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:35.191+0000 7fb8c161e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:36:35.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new a6679ca7-c5dd-4930-9c6f-db3b82326053 0 2023-06-09T04:36:35.228 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:35.226+0000 7f3f73acf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:36:35.265 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:35.263+0000 7fb8c161e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:36:35.345 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:35.343+0000 7fb8c161e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:36:35.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.381+0000 7f334c3f7700 1 Processor -- start 2023-06-09T04:36:35.383 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.381+0000 7f334c3f7700 1 -- start start 2023-06-09T04:36:35.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f334c3f7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f334415c270 0x7f33440d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f334c3f7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f33440cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f334c3f7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440d0d30 con 0x7f33440ce310 2023-06-09T04:36:35.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f334c3f7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334406aec0 con 0x7f334415c270 2023-06-09T04:36:35.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f334c3f7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440d1520 con 0x7f33440cd840 2023-06-09T04:36:35.385 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f334a994700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f33440cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.386 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f3349992700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f33440ce310 0x7f33440cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46058/0 (socket says 172.21.15.184:46058) 2023-06-09T04:36:35.386 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f3349992700 1 -- 172.21.15.184:0/1901783540 learned_addr learned my addr 172.21.15.184:0/1901783540 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-06-09T04:36:35.386 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.382+0000 7f334a193700 1 --2- 172.21.15.184:0/1901783540 >> v2:172.21.15.149:3300/0 conn(0x7f334415c270 0x7f33440d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.386 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f3349191700 1 -- 172.21.15.184:0/1901783540 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707598073 0 0) 0x7f33440d0d30 con 0x7f33440ce310 2023-06-09T04:36:35.386 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f3349191700 1 -- 172.21.15.184:0/1901783540 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33300035b0 con 0x7f33440ce310 2023-06-09T04:36:35.386 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f334a994700 1 -- 172.21.15.184:0/1901783540 >> v2:172.21.15.149:3300/0 conn(0x7f334415c270 msgr2=0x7f33440d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:35.386 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f334a994700 1 --2- 172.21.15.184:0/1901783540 >> v2:172.21.15.149:3300/0 conn(0x7f334415c270 0x7f33440d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.387 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f334a994700 1 -- 172.21.15.184:0/1901783540 >> v1:172.21.15.184:6789/0 conn(0x7f33440ce310 legacy=0x7f33440cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.387 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f334a994700 1 -- 172.21.15.184:0/1901783540 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440cb1a0 con 0x7f33440cd840 2023-06-09T04:36:35.387 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f334a994700 1 --2- 172.21.15.184:0/1901783540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f33440cb630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f333c009d90 tx=0x7f333c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f00da55f5f95747a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:35.387 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f3349191700 1 -- 172.21.15.184:0/1901783540 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00e070 con 0x7f33440cd840 2023-06-09T04:36:35.387 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f3349191700 1 -- 172.21.15.184:0/1901783540 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c00bb20 con 0x7f33440cd840 2023-06-09T04:36:35.387 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.383+0000 7f3349191700 1 -- 172.21.15.184:0/1901783540 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c012430 con 0x7f33440cd840 2023-06-09T04:36:35.389 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 -- 172.21.15.184:0/1901783540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 msgr2=0x7f33440cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 --2- 172.21.15.184:0/1901783540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f33440cb630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f333c009d90 tx=0x7f333c00b330 comp rx=0 tx=0).stop 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 -- 172.21.15.184:0/1901783540 shutdown_connections 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 --2- 172.21.15.184:0/1901783540 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f33440cb630 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 --2- 172.21.15.184:0/1901783540 >> v2:172.21.15.149:3300/0 conn(0x7f334415c270 0x7f33440d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 -- 172.21.15.184:0/1901783540 >> 172.21.15.184:0/1901783540 conn(0x7f3344069db0 msgr2=0x7f334406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 -- 172.21.15.184:0/1901783540 shutdown_connections 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.384+0000 7f334c3f7700 1 -- 172.21.15.184:0/1901783540 wait complete. 2023-06-09T04:36:35.390 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.385+0000 7f334c3f7700 1 Processor -- start 2023-06-09T04:36:35.391 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.385+0000 7f334c3f7700 1 -- start start 2023-06-09T04:36:35.391 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334c3f7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f334415a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.391 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334c3f7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33440ce310 0x7f334415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.391 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334c3f7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334415c270 0x7f334415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.391 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334c3f7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334415e200 con 0x7f334415c270 2023-06-09T04:36:35.391 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334c3f7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334415e4e0 con 0x7f33440ce310 2023-06-09T04:36:35.391 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334c3f7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334415e7c0 con 0x7f33440cd840 2023-06-09T04:36:35.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f334415a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f3349992700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33440ce310 0x7f334415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f334415a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54294/0 (socket says 172.21.15.184:54294) 2023-06-09T04:36:35.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f3349992700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33440ce310 0x7f334415d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52240/0 (socket says 172.21.15.184:52240) 2023-06-09T04:36:35.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 -- 172.21.15.184:0/2498455292 learned_addr learned my addr 172.21.15.184:0/2498455292 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:35.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a994700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334415c270 0x7f334415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.392 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 -- 172.21.15.184:0/2498455292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33440ce310 msgr2=0x7f334415d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33440ce310 0x7f334415d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 -- 172.21.15.184:0/2498455292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334415c270 msgr2=0x7f334415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334415c270 0x7f334415dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.393 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 -- 172.21.15.184:0/2498455292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c009a70 con 0x7f33440cd840 2023-06-09T04:36:35.394 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334a193700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f334415a5d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f334000e9b0 tx=0x7f334000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:35.394 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f333affd700 1 -- 172.21.15.184:0/2498455292 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340009710 con 0x7f33440cd840 2023-06-09T04:36:35.394 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f333affd700 1 -- 172.21.15.184:0/2498455292 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000ee50 con 0x7f33440cd840 2023-06-09T04:36:35.394 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f334415eaa0 con 0x7f33440cd840 2023-06-09T04:36:35.395 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.386+0000 7f333affd700 1 -- 172.21.15.184:0/2498455292 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334000ca50 con 0x7f33440cd840 2023-06-09T04:36:35.395 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.387+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33441f1f10 con 0x7f33440cd840 2023-06-09T04:36:35.395 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.387+0000 7f333affd700 1 -- 172.21.15.184:0/2498455292 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3340005a20 con 0x7f33440cd840 2023-06-09T04:36:35.395 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.387+0000 7f333affd700 1 -- 172.21.15.184:0/2498455292 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f33400137b0 con 0x7f33440cd840 2023-06-09T04:36:35.396 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.387+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3344073fa0 con 0x7f33440cd840 2023-06-09T04:36:35.396 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.390+0000 7f333affd700 1 -- 172.21.15.184:0/2498455292 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3340021060 con 0x7f33440cd840 2023-06-09T04:36:35.431 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:35.430+0000 7fb8c161e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:36:35.475 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.473+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a6679ca7-c5dd-4930-9c6f-db3b82326053", "id": 0} v 0) v1 -- 0x7f33440b2790 con 0x7f33440cd840 2023-06-09T04:36:35.480 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.479+0000 7f333affd700 1 -- 172.21.15.184:0/2498455292 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6679ca7-c5dd-4930-9c6f-db3b82326053", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3340017070 con 0x7f33440cd840 2023-06-09T04:36:35.481 INFO:teuthology.orchestra.run.smithi184.stdout:0 2023-06-09T04:36:35.482 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 msgr2=0x7f334415a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.482 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f334415a5d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f334000e9b0 tx=0x7f334000ecc0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.482 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 shutdown_connections 2023-06-09T04:36:35.482 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33440cd840 0x7f334415a5d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.482 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f334415c270 0x7f334415dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.482 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 --2- 172.21.15.184:0/2498455292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33440ce310 0x7f334415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.483 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 >> 172.21.15.184:0/2498455292 conn(0x7f3344069db0 msgr2=0x7f33440cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:35.483 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 shutdown_connections 2023-06-09T04:36:35.483 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.480+0000 7f334c3f7700 1 -- 172.21.15.184:0/2498455292 wait complete. 2023-06-09T04:36:35.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61 1 2023-06-09T04:36:35.574 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:35.573+0000 7f3f73acf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:36:35.586 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:35.585+0000 7fb8c161e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:36:35.651 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:35.650+0000 7f3f73acf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:36:35.661 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.659+0000 7fca85d82700 1 Processor -- start 2023-06-09T04:36:35.661 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca85d82700 1 -- start start 2023-06-09T04:36:35.662 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca85d82700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca800cd300 0x7fca800ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca85d82700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fca801591d0 0x7fca80071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca85d82700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca800716e0 con 0x7fca800cded0 2023-06-09T04:36:35.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca85d82700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8006f4a0 con 0x7fca801591d0 2023-06-09T04:36:35.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca85d82700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800ce7e0 con 0x7fca800cd300 2023-06-09T04:36:35.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca7effd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca800cd300 0x7fca800ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca7f7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fca800cded0 0x7fca8015d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46068/0 (socket says 172.21.15.184:46068) 2023-06-09T04:36:35.663 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.660+0000 7fca7f7fe700 1 -- 172.21.15.184:0/1751563187 learned_addr learned my addr 172.21.15.184:0/1751563187 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-06-09T04:36:35.664 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7ffff700 1 --2- 172.21.15.184:0/1751563187 >> v2:172.21.15.149:3300/0 conn(0x7fca801591d0 0x7fca80071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.664 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7effd700 1 -- 172.21.15.184:0/1751563187 >> v2:172.21.15.149:3300/0 conn(0x7fca801591d0 msgr2=0x7fca80071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:35.664 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7effd700 1 --2- 172.21.15.184:0/1751563187 >> v2:172.21.15.149:3300/0 conn(0x7fca801591d0 0x7fca80071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.664 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7effd700 1 -- 172.21.15.184:0/1751563187 >> v1:172.21.15.184:6789/0 conn(0x7fca800cded0 legacy=0x7fca8015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.664 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7e7fc700 1 -- 172.21.15.184:0/1751563187 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401815460 0 0) 0x7fca800716e0 con 0x7fca800cded0 2023-06-09T04:36:35.664 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7effd700 1 -- 172.21.15.184:0/1751563187 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8006f6b0 con 0x7fca800cd300 2023-06-09T04:36:35.664 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7effd700 1 --2- 172.21.15.184:0/1751563187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800cd300 0x7fca800ce2a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca800b2210 tx=0x7fca74009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=124cb4b08aa2e0f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:35.665 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7e7fc700 1 -- 172.21.15.184:0/1751563187 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74011830 con 0x7fca800cd300 2023-06-09T04:36:35.665 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7e7fc700 1 -- 172.21.15.184:0/1751563187 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca74011990 con 0x7fca800cd300 2023-06-09T04:36:35.665 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.661+0000 7fca7e7fc700 1 -- 172.21.15.184:0/1751563187 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74011d20 con 0x7fca800cd300 2023-06-09T04:36:35.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 -- 172.21.15.184:0/1751563187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800cd300 msgr2=0x7fca800ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 --2- 172.21.15.184:0/1751563187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800cd300 0x7fca800ce2a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fca800b2210 tx=0x7fca74009b20 comp rx=0 tx=0).stop 2023-06-09T04:36:35.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 -- 172.21.15.184:0/1751563187 shutdown_connections 2023-06-09T04:36:35.667 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 --2- 172.21.15.184:0/1751563187 >> v2:172.21.15.149:3300/0 conn(0x7fca801591d0 0x7fca80071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 --2- 172.21.15.184:0/1751563187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca800cd300 0x7fca800ce2a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 -- 172.21.15.184:0/1751563187 >> 172.21.15.184:0/1751563187 conn(0x7fca8006aec0 msgr2=0x7fca8006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:35.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 -- 172.21.15.184:0/1751563187 shutdown_connections 2023-06-09T04:36:35.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.662+0000 7fca85d82700 1 -- 172.21.15.184:0/1751563187 wait complete. 2023-06-09T04:36:35.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.663+0000 7fca85d82700 1 Processor -- start 2023-06-09T04:36:35.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.664+0000 7fca85d82700 1 -- start start 2023-06-09T04:36:35.668 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.664+0000 7fca85d82700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca800cd300 0x7fca800c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.664+0000 7fca85d82700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cded0 0x7fca80158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.664+0000 7fca85d82700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca801591d0 0x7fca800c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca85d82700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca80158860 con 0x7fca800cd300 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca85d82700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca800c5240 con 0x7fca801591d0 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca85d82700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800c5520 con 0x7fca800cded0 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cded0 0x7fca80158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cded0 0x7fca80158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54308/0 (socket says 172.21.15.184:54308) 2023-06-09T04:36:35.669 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 -- 172.21.15.184:0/3751403959 learned_addr learned my addr 172.21.15.184:0/3751403959 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:35.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7ffff700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca801591d0 0x7fca800c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7f7fe700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca800cd300 0x7fca800c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 -- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca801591d0 msgr2=0x7fca800c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca801591d0 0x7fca800c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 -- 172.21.15.184:0/3751403959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca800cd300 msgr2=0x7fca800c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca800cd300 0x7fca800c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.670 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 -- 172.21.15.184:0/3751403959 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740094a0 con 0x7fca800cded0 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7ffff700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca801591d0 0x7fca800c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca7effd700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cded0 0x7fca80158320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca74013000 tx=0x7fca74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca67fff700 1 -- 172.21.15.184:0/3751403959 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740036a0 con 0x7fca800cded0 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca67fff700 1 -- 172.21.15.184:0/3751403959 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7401f070 con 0x7fca800cded0 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca67fff700 1 -- 172.21.15.184:0/3751403959 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74003a60 con 0x7fca800cded0 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca800c5800 con 0x7fca800cded0 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.665+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca800c5dc0 con 0x7fca800cded0 2023-06-09T04:36:35.671 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.666+0000 7fca67fff700 1 -- 172.21.15.184:0/3751403959 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca74026480 con 0x7fca800cded0 2023-06-09T04:36:35.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.666+0000 7fca67fff700 1 -- 172.21.15.184:0/3751403959 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fca74021070 con 0x7fca800cded0 2023-06-09T04:36:35.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.666+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca80073fa0 con 0x7fca800cded0 2023-06-09T04:36:35.672 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.670+0000 7fca67fff700 1 -- 172.21.15.184:0/3751403959 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fca7402b020 con 0x7fca800cded0 2023-06-09T04:36:35.756 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.755+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61", "id": 1} v 0) v1 -- 0x7fca800b55d0 con 0x7fca800cded0 2023-06-09T04:36:35.761 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.760+0000 7fca67fff700 1 -- 172.21.15.184:0/3751403959 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca74015020 con 0x7fca800cded0 2023-06-09T04:36:35.762 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-06-09T04:36:35.763 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cded0 msgr2=0x7fca80158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.763 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cded0 0x7fca80158320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fca74013000 tx=0x7fca74004750 comp rx=0 tx=0).stop 2023-06-09T04:36:35.763 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 shutdown_connections 2023-06-09T04:36:35.763 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca801591d0 0x7fca800c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.763 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca800cd300 0x7fca800c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.763 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 --2- 172.21.15.184:0/3751403959 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca800cded0 0x7fca80158320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 >> 172.21.15.184:0/3751403959 conn(0x7fca8006aec0 msgr2=0x7fca800b48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:35.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 shutdown_connections 2023-06-09T04:36:35.764 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.761+0000 7fca85d82700 1 -- 172.21.15.184:0/3751403959 wait complete. 2023-06-09T04:36:35.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 4589612a-ca2e-4243-89e6-617e6e5a81bf 2 2023-06-09T04:36:35.791 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:35.790+0000 7f3f73acf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:36:35.875 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:35.873+0000 7f3f73acf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:36:35.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.892+0000 7f3eb92dd700 1 Processor -- start 2023-06-09T04:36:35.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.892+0000 7f3eb92dd700 1 -- start start 2023-06-09T04:36:35.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.893+0000 7f3eb92dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb40cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.893+0000 7f3eb92dd700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb415c990 con 0x7f3eb4071640 2023-06-09T04:36:35.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.893+0000 7f3eb92dd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb40cd9a0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.893+0000 7f3eb92dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40cedb0 con 0x7f3eb406a4c0 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.893+0000 7f3eb2ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3eb415c5c0 0x7f3eb4069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46080/0 (socket says 172.21.15.184:46080) 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.893+0000 7f3eb27fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb40cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.893+0000 7f3eb2ffd700 1 -- 172.21.15.184:0/3711714014 learned_addr learned my addr 172.21.15.184:0/3711714014 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb1ffb700 1 -- 172.21.15.184:0/3711714014 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939707987 0 0) 0x7f3eb40cd9a0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb1ffb700 1 -- 172.21.15.184:0/3711714014 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e9c0035b0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb27fc700 1 -- 172.21.15.184:0/3711714014 >> v1:172.21.15.184:6789/0 conn(0x7f3eb415c5c0 legacy=0x7f3eb4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb27fc700 1 -- 172.21.15.184:0/3711714014 >> v1:172.21.15.149:6789/0 conn(0x7f3eb4071640 legacy=0x7f3eb40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb27fc700 1 -- 172.21.15.184:0/3711714014 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40723a0 con 0x7f3eb406a4c0 2023-06-09T04:36:35.898 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb27fc700 1 --2- 172.21.15.184:0/3711714014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb40cd460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009870 tx=0x7f3ea8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c294fa207b1246fa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:35.898 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb1ffb700 1 -- 172.21.15.184:0/3711714014 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8011830 con 0x7f3eb406a4c0 2023-06-09T04:36:35.898 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb1ffb700 1 -- 172.21.15.184:0/3711714014 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea8011990 con 0x7f3eb406a4c0 2023-06-09T04:36:35.898 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.894+0000 7f3eb1ffb700 1 -- 172.21.15.184:0/3711714014 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8011d20 con 0x7f3eb406a4c0 2023-06-09T04:36:35.898 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.895+0000 7f3eb92dd700 1 -- 172.21.15.184:0/3711714014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 msgr2=0x7f3eb40cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.898 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.895+0000 7f3eb92dd700 1 --2- 172.21.15.184:0/3711714014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb40cd460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8009870 tx=0x7f3ea8009b80 comp rx=0 tx=0).stop 2023-06-09T04:36:35.898 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.895+0000 7f3eb92dd700 1 -- 172.21.15.184:0/3711714014 shutdown_connections 2023-06-09T04:36:35.899 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.895+0000 7f3eb92dd700 1 --2- 172.21.15.184:0/3711714014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb40cd460 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.899 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.895+0000 7f3eb92dd700 1 -- 172.21.15.184:0/3711714014 >> 172.21.15.184:0/3711714014 conn(0x7f3eb406aec0 msgr2=0x7f3eb406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:35.899 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.895+0000 7f3eb92dd700 1 -- 172.21.15.184:0/3711714014 shutdown_connections 2023-06-09T04:36:35.899 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.895+0000 7f3eb92dd700 1 -- 172.21.15.184:0/3711714014 wait complete. 2023-06-09T04:36:35.899 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.896+0000 7f3eb92dd700 1 Processor -- start 2023-06-09T04:36:35.899 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.896+0000 7f3eb92dd700 1 -- start start 2023-06-09T04:36:35.901 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb92dd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.901 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb92dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eb4071640 0x7f3eb40c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.901 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb92dd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3eb415c5c0 0x7f3eb4154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:35.901 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb92dd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40c33d0 con 0x7f3eb4071640 2023-06-09T04:36:35.901 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb92dd700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4155480 con 0x7f3eb415c5c0 2023-06-09T04:36:35.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb92dd700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40c3600 con 0x7f3eb406a4c0 2023-06-09T04:36:35.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb2ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3eb415c5c0 0x7f3eb4154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb2ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb415b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54318/0 (socket says 172.21.15.184:54318) 2023-06-09T04:36:35.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb27fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eb4071640 0x7f3eb40c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:35.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.897+0000 7f3eb2ffd700 1 -- 172.21.15.184:0/668522466 learned_addr learned my addr 172.21.15.184:0/668522466 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:35.902 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb37fe700 1 -- 172.21.15.184:0/668522466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 msgr2=0x7f3eb415b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb37fe700 1 --2- 172.21.15.184:0/668522466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb415b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb37fe700 1 -- 172.21.15.184:0/668522466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eb4071640 msgr2=0x7f3eb40c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb37fe700 1 --2- 172.21.15.184:0/668522466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eb4071640 0x7f3eb40c2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb37fe700 1 -- 172.21.15.184:0/668522466 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80094a0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb37fe700 1 --2- 172.21.15.184:0/668522466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3eb415c5c0 0x7f3eb4154f40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00cb90 tx=0x7f3eac00cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3e9b7fe700 1 -- 172.21.15.184:0/668522466 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac003c00 con 0x7f3eb415c5c0 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3e9b7fe700 1 -- 172.21.15.184:0/668522466 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac003d60 con 0x7f3eb415c5c0 2023-06-09T04:36:35.903 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb40c38e0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.904 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3e9b7fe700 1 -- 172.21.15.184:0/668522466 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac00aa80 con 0x7f3eb415c5c0 2023-06-09T04:36:35.904 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb40c3ea0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.904 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3e9b7fe700 1 -- 172.21.15.184:0/668522466 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3eac0050d0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.904 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.898+0000 7f3e9b7fe700 1 -- 172.21.15.184:0/668522466 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3eac0057a0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.904 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.899+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb4073fa0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.904 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.901+0000 7f3e9b7fe700 1 -- 172.21.15.184:0/668522466 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3eac005380 con 0x7f3eb415c5c0 2023-06-09T04:36:35.939 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:35.937+0000 7fb8c161e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:36:35.986 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.984+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4589612a-ca2e-4243-89e6-617e6e5a81bf", "id": 2} v 0) v1 -- 0x7f3eb40b55d0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.994 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.992+0000 7f3e9b7fe700 1 -- 172.21.15.184:0/668522466 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4589612a-ca2e-4243-89e6-617e6e5a81bf", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3eac0055a0 con 0x7f3eb415c5c0 2023-06-09T04:36:35.994 INFO:teuthology.orchestra.run.smithi184.stdout:2 2023-06-09T04:36:35.995 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.993+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3eb415c5c0 msgr2=0x7f3eb4154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:35.995 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.993+0000 7f3eb92dd700 1 --2- 172.21.15.184:0/668522466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3eb415c5c0 0x7f3eb4154f40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00cb90 tx=0x7f3eac00cea0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.995 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.993+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 shutdown_connections 2023-06-09T04:36:35.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.993+0000 7f3eb92dd700 1 --2- 172.21.15.184:0/668522466 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3eb406a4c0 0x7f3eb415b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.993+0000 7f3eb92dd700 1 --2- 172.21.15.184:0/668522466 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3eb415c5c0 0x7f3eb4154f40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.993+0000 7f3eb92dd700 1 --2- 172.21.15.184:0/668522466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3eb4071640 0x7f3eb40c2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:35.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.993+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 >> 172.21.15.184:0/668522466 conn(0x7f3eb406aec0 msgr2=0x7f3eb4157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:35.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.994+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 shutdown_connections 2023-06-09T04:36:35.996 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:35.994+0000 7f3eb92dd700 1 -- 172.21.15.184:0/668522466 wait complete. 2023-06-09T04:36:36.007 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new d53efe1c-2809-4bc8-8957-22555b3ebf2d 3 2023-06-09T04:36:36.017 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:36.016+0000 7fb8c161e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:36:36.129 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.127+0000 7f951275d700 1 Processor -- start 2023-06-09T04:36:36.129 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.127+0000 7f951275d700 1 -- start start 2023-06-09T04:36:36.130 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f951275d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.130 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f951275d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f950c0ce310 0x7f950c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.131 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f951275d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950c0d0d30 con 0x7f950c15c270 2023-06-09T04:36:36.131 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f951275d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c06aec0 con 0x7f950c0ce310 2023-06-09T04:36:36.131 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f951275d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c0d1520 con 0x7f950c0cd840 2023-06-09T04:36:36.131 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f950b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.131 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f9510cfa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f950c0ce310 0x7f950c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.131 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f9510cfa700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f950c0ce310 0x7f950c0cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52272/0 (socket says 172.21.15.184:52272) 2023-06-09T04:36:36.132 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f950b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c0d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54326/0 (socket says 172.21.15.184:54326) 2023-06-09T04:36:36.132 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f9510cfa700 1 -- 172.21.15.184:0/559838411 learned_addr learned my addr 172.21.15.184:0/559838411 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:36.132 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f950b7fe700 1 -- 172.21.15.184:0/559838411 >> v2:172.21.15.184:3300/0 conn(0x7f950c0ce310 msgr2=0x7f950c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:36.132 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f950b7fe700 1 --2- 172.21.15.184:0/559838411 >> v2:172.21.15.184:3300/0 conn(0x7f950c0ce310 0x7f950c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.132 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f950b7fe700 1 -- 172.21.15.184:0/559838411 >> v1:172.21.15.184:6789/0 conn(0x7f950c15c270 legacy=0x7f950c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.132 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f950b7fe700 1 -- 172.21.15.184:0/559838411 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c0cb1a0 con 0x7f950c0cd840 2023-06-09T04:36:36.132 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f950affd700 1 -- 172.21.15.184:0/559838411 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630753579 0 0) 0x7f950c0d0d30 con 0x7f950c15c270 2023-06-09T04:36:36.133 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.128+0000 7f9510cfa700 1 --2- 172.21.15.184:0/559838411 >> v2:172.21.15.184:3300/0 conn(0x7f950c0ce310 0x7f950c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:36.133 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f950b7fe700 1 --2- 172.21.15.184:0/559838411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c0d07f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9500009840 tx=0x7f9500009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d15e7cbbe0a6c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.133 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f950affd700 1 -- 172.21.15.184:0/559838411 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500011830 con 0x7f950c0cd840 2023-06-09T04:36:36.133 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f950affd700 1 -- 172.21.15.184:0/559838411 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500011990 con 0x7f950c0cd840 2023-06-09T04:36:36.133 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f950affd700 1 -- 172.21.15.184:0/559838411 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500011d20 con 0x7f950c0cd840 2023-06-09T04:36:36.135 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 -- 172.21.15.184:0/559838411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 msgr2=0x7f950c0d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 --2- 172.21.15.184:0/559838411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c0d07f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9500009840 tx=0x7f9500009b50 comp rx=0 tx=0).stop 2023-06-09T04:36:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 -- 172.21.15.184:0/559838411 shutdown_connections 2023-06-09T04:36:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 --2- 172.21.15.184:0/559838411 >> v2:172.21.15.184:3300/0 conn(0x7f950c0ce310 0x7f950c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 --2- 172.21.15.184:0/559838411 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c0d07f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 -- 172.21.15.184:0/559838411 >> 172.21.15.184:0/559838411 conn(0x7f950c069db0 msgr2=0x7f950c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.136 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 -- 172.21.15.184:0/559838411 shutdown_connections 2023-06-09T04:36:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.129+0000 7f951275d700 1 -- 172.21.15.184:0/559838411 wait complete. 2023-06-09T04:36:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 Processor -- start 2023-06-09T04:36:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 -- start start 2023-06-09T04:36:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c14cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c0ce310 0x7f950c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c15c270 0x7f950c0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.137 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c14d250 con 0x7f950c15c270 2023-06-09T04:36:36.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c1595d0 con 0x7f950c0ce310 2023-06-09T04:36:36.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.131+0000 7f951275d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c1589c0 con 0x7f950c0cd840 2023-06-09T04:36:36.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c14cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950b7fe700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c0ce310 0x7f950c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c14cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54330/0 (socket says 172.21.15.184:54330) 2023-06-09T04:36:36.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950bfff700 1 -- 172.21.15.184:0/2502258938 learned_addr learned my addr 172.21.15.184:0/2502258938 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:36.138 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f9510cfa700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c15c270 0x7f950c0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950b7fe700 1 -- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 msgr2=0x7f950c14cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950b7fe700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c14cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950b7fe700 1 -- 172.21.15.184:0/2502258938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c15c270 msgr2=0x7f950c0b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950b7fe700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c15c270 0x7f950c0b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950b7fe700 1 -- 172.21.15.184:0/2502258938 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504009b30 con 0x7f950c0ce310 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950bfff700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f950b7fe700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c0ce310 0x7f950c0b1300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9500016000 tx=0x7f9500004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f9508ff9700 1 -- 172.21.15.184:0/2502258938 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95000036a0 con 0x7f950c0ce310 2023-06-09T04:36:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f9508ff9700 1 -- 172.21.15.184:0/2502258938 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950001f070 con 0x7f950c0ce310 2023-06-09T04:36:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95000094a0 con 0x7f950c0ce310 2023-06-09T04:36:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f9508ff9700 1 -- 172.21.15.184:0/2502258938 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500003a00 con 0x7f950c0ce310 2023-06-09T04:36:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c158f80 con 0x7f950c0ce310 2023-06-09T04:36:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f9508ff9700 1 -- 172.21.15.184:0/2502258938 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9500026480 con 0x7f950c0ce310 2023-06-09T04:36:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.132+0000 7f9508ff9700 1 -- 172.21.15.184:0/2502258938 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f9500021070 con 0x7f950c0ce310 2023-06-09T04:36:36.140 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.133+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c073fa0 con 0x7f950c0ce310 2023-06-09T04:36:36.141 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.135+0000 7f9508ff9700 1 -- 172.21.15.184:0/2502258938 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9500015020 con 0x7f950c0ce310 2023-06-09T04:36:36.145 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:36.143+0000 7fb8c161e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:36:36.221 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.219+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d53efe1c-2809-4bc8-8957-22555b3ebf2d", "id": 3} v 0) v1 -- 0x7f950c0b2790 con 0x7f950c0ce310 2023-06-09T04:36:36.228 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:36.227+0000 7fb8c161e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:36:36.229 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.227+0000 7f9508ff9700 1 -- 172.21.15.184:0/2502258938 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d53efe1c-2809-4bc8-8957-22555b3ebf2d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9500026940 con 0x7f950c0ce310 2023-06-09T04:36:36.229 INFO:teuthology.orchestra.run.smithi184.stdout:3 2023-06-09T04:36:36.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.228+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c0ce310 msgr2=0x7f950c0b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.228+0000 7f951275d700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c0ce310 0x7f950c0b1300 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9500016000 tx=0x7f9500004750 comp rx=0 tx=0).stop 2023-06-09T04:36:36.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.228+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 shutdown_connections 2023-06-09T04:36:36.230 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.228+0000 7f951275d700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f950c0cd840 0x7f950c14cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.228+0000 7f951275d700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c15c270 0x7f950c0b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.228+0000 7f951275d700 1 --2- 172.21.15.184:0/2502258938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f950c0ce310 0x7f950c0b1300 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.228+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 >> 172.21.15.184:0/2502258938 conn(0x7f950c069db0 msgr2=0x7f950c0cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.229+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 shutdown_connections 2023-06-09T04:36:36.231 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.229+0000 7f951275d700 1 -- 172.21.15.184:0/2502258938 wait complete. 2023-06-09T04:36:36.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 898e9fe4-d5ef-4c97-a827-ef5dd658567f 4 2023-06-09T04:36:36.342 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:36.341+0000 7f3f73acf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:36:36.403 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.402+0000 7fd3b2b0f700 1 Processor -- start 2023-06-09T04:36:36.404 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.402+0000 7fd3b2b0f700 1 -- start start 2023-06-09T04:36:36.406 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b2b0f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd3ac0b60a0 0x7fd3ac0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.406 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b2b0f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd3ac15e340 0x7fd3ac0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.406 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b2b0f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac0cda20 con 0x7fd3ac0cf5b0 2023-06-09T04:36:36.406 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b2b0f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0b6470 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.406 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b2b0f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac15e7a0 con 0x7fd3ac15e340 2023-06-09T04:36:36.406 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b10ac700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd3ac15e340 0x7fd3ac0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3abfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd3ac0cf5b0 0x7fd3ac15dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46104/0 (socket says 172.21.15.184:46104) 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b10ac700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd3ac15e340 0x7fd3ac0cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52284/0 (socket says 172.21.15.184:52284) 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3abfff700 1 -- 172.21.15.184:0/3654271825 learned_addr learned my addr 172.21.15.184:0/3654271825 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b08ab700 1 --2- 172.21.15.184:0/3654271825 >> v2:172.21.15.149:3300/0 conn(0x7fd3ac0b60a0 0x7fd3ac0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b10ac700 1 -- 172.21.15.184:0/3654271825 >> v2:172.21.15.149:3300/0 conn(0x7fd3ac0b60a0 msgr2=0x7fd3ac0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b10ac700 1 --2- 172.21.15.184:0/3654271825 >> v2:172.21.15.149:3300/0 conn(0x7fd3ac0b60a0 0x7fd3ac0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b10ac700 1 -- 172.21.15.184:0/3654271825 >> v1:172.21.15.184:6789/0 conn(0x7fd3ac0cf5b0 legacy=0x7fd3ac15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.407 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b10ac700 1 -- 172.21.15.184:0/3654271825 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac15a520 con 0x7fd3ac15e340 2023-06-09T04:36:36.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3ab7fe700 1 -- 172.21.15.184:0/3654271825 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651898649 0 0) 0x7fd3ac0cda20 con 0x7fd3ac0cf5b0 2023-06-09T04:36:36.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b08ab700 1 --2- 172.21.15.184:0/3654271825 >> v2:172.21.15.149:3300/0 conn(0x7fd3ac0b60a0 0x7fd3ac0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:36.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3b10ac700 1 --2- 172.21.15.184:0/3654271825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac15e340 0x7fd3ac0cfb00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac071ff0 tx=0x7fd3a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d288aea74ce59b5d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.403+0000 7fd3ab7fe700 1 -- 172.21.15.184:0/3654271825 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400e070 con 0x7fd3ac15e340 2023-06-09T04:36:36.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3ab7fe700 1 -- 172.21.15.184:0/3654271825 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400bbd0 con 0x7fd3ac15e340 2023-06-09T04:36:36.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3ab7fe700 1 -- 172.21.15.184:0/3654271825 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4012430 con 0x7fd3ac15e340 2023-06-09T04:36:36.408 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/3654271825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac15e340 msgr2=0x7fd3ac0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 --2- 172.21.15.184:0/3654271825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac15e340 0x7fd3ac0cfb00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac071ff0 tx=0x7fd3a400b330 comp rx=0 tx=0).stop 2023-06-09T04:36:36.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/3654271825 shutdown_connections 2023-06-09T04:36:36.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 --2- 172.21.15.184:0/3654271825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac15e340 0x7fd3ac0cfb00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 --2- 172.21.15.184:0/3654271825 >> v2:172.21.15.149:3300/0 conn(0x7fd3ac0b60a0 0x7fd3ac0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/3654271825 >> 172.21.15.184:0/3654271825 conn(0x7fd3ac069db0 msgr2=0x7fd3ac06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/3654271825 shutdown_connections 2023-06-09T04:36:36.409 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.404+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/3654271825 wait complete. 2023-06-09T04:36:36.411 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.406+0000 7fd3b2b0f700 1 Processor -- start 2023-06-09T04:36:36.411 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.406+0000 7fd3b2b0f700 1 -- start start 2023-06-09T04:36:36.411 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b2b0f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac0b60a0 0x7fd3ac1ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.411 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b2b0f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3ac0cf5b0 0x7fd3ac14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.412 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b2b0f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3ac15e340 0x7fd3ac0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.412 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b2b0f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac14f200 con 0x7fd3ac15e340 2023-06-09T04:36:36.412 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b2b0f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac15bd60 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.412 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b2b0f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0c8ec0 con 0x7fd3ac0cf5b0 2023-06-09T04:36:36.412 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3abfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3ac0cf5b0 0x7fd3ac14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.412 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac0b60a0 0x7fd3ac1ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.412 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3abfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3ac0cf5b0 0x7fd3ac14ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54344/0 (socket says 172.21.15.184:54344) 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac0b60a0 0x7fd3ac1ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52286/0 (socket says 172.21.15.184:52286) 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3abfff700 1 -- 172.21.15.184:0/1213691295 learned_addr learned my addr 172.21.15.184:0/1213691295 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b10ac700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3ac15e340 0x7fd3ac0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 -- 172.21.15.184:0/1213691295 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3ac0cf5b0 msgr2=0x7fd3ac14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3ac0cf5b0 0x7fd3ac14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 -- 172.21.15.184:0/1213691295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3ac15e340 msgr2=0x7fd3ac0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3ac15e340 0x7fd3ac0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.413 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 -- 172.21.15.184:0/1213691295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009a70 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.407+0000 7fd3b08ab700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac0b60a0 0x7fd3ac1ef760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000e7e0 tx=0x7fd3a000eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.408+0000 7fd3a97fa700 1 -- 172.21.15.184:0/1213691295 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000c070 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.408+0000 7fd3a97fa700 1 -- 172.21.15.184:0/1213691295 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0013610 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.408+0000 7fd3a97fa700 1 -- 172.21.15.184:0/1213691295 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0013980 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.408+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac15c000 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.408+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac0c91a0 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.408+0000 7fd3a97fa700 1 -- 172.21.15.184:0/1213691295 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd3a001c400 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.414 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.408+0000 7fd3a97fa700 1 -- 172.21.15.184:0/1213691295 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd3a001cbc0 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.415 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.409+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac15c650 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.415 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.411+0000 7fd3a97fa700 1 -- 172.21.15.184:0/1213691295 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd3a0017020 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.494 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.493+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "898e9fe4-d5ef-4c97-a827-ef5dd658567f", "id": 4} v 0) v1 -- 0x7fd3ac073fa0 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.500 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.499+0000 7fd3a97fa700 1 -- 172.21.15.184:0/1213691295 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "898e9fe4-d5ef-4c97-a827-ef5dd658567f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3a000f040 con 0x7fd3ac0b60a0 2023-06-09T04:36:36.500 INFO:teuthology.orchestra.run.smithi184.stdout:4 2023-06-09T04:36:36.501 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac0b60a0 msgr2=0x7fd3ac1ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.501 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac0b60a0 0x7fd3ac1ef760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000e7e0 tx=0x7fd3a000eaf0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.501 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 shutdown_connections 2023-06-09T04:36:36.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3ac15e340 0x7fd3ac0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3ac0b60a0 0x7fd3ac1ef760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 --2- 172.21.15.184:0/1213691295 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd3ac0cf5b0 0x7fd3ac14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 >> 172.21.15.184:0/1213691295 conn(0x7fd3ac069db0 msgr2=0x7fd3ac0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 shutdown_connections 2023-06-09T04:36:36.502 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.500+0000 7fd3b2b0f700 1 -- 172.21.15.184:0/1213691295 wait complete. 2023-06-09T04:36:36.512 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 83817238-e73f-425c-8f9d-7b9e96afd4cb 5 2023-06-09T04:36:36.632 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.631+0000 7f2b2ee75700 1 Processor -- start 2023-06-09T04:36:36.633 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.631+0000 7f2b2ee75700 1 -- start start 2023-06-09T04:36:36.634 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b2ee75700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2b2815c520 0x7f2b28071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.634 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b2ee75700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b280cee20 0x7f2b28069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b2ee75700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2815c8f0 con 0x7f2b2806a2f0 2023-06-09T04:36:36.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b2ee75700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b280cd940 con 0x7f2b2815c520 2023-06-09T04:36:36.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b2ee75700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b280b20f0 con 0x7f2b280cee20 2023-06-09T04:36:36.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b27fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b280cee20 0x7f2b28069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b27fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b280cee20 0x7f2b28069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52294/0 (socket says 172.21.15.184:52294) 2023-06-09T04:36:36.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b27fff700 1 -- 172.21.15.184:0/2747798687 learned_addr learned my addr 172.21.15.184:0/2747798687 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:36.635 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b2cc11700 1 --2- 172.21.15.184:0/2747798687 >> v2:172.21.15.149:3300/0 conn(0x7f2b2815c520 0x7f2b28071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b27fff700 1 -- 172.21.15.184:0/2747798687 >> v2:172.21.15.149:3300/0 conn(0x7f2b2815c520 msgr2=0x7f2b28071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:36.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b27fff700 1 --2- 172.21.15.184:0/2747798687 >> v2:172.21.15.149:3300/0 conn(0x7f2b2815c520 0x7f2b28071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b27fff700 1 -- 172.21.15.184:0/2747798687 >> v1:172.21.15.149:6789/0 conn(0x7f2b2806a2f0 legacy=0x7f2b280b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b27fff700 1 -- 172.21.15.184:0/2747798687 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2806a720 con 0x7f2b280cee20 2023-06-09T04:36:36.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.632+0000 7f2b277fe700 1 -- 172.21.15.184:0/2747798687 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430333249 0 0) 0x7f2b20001490 con 0x7f2b2806a2f0 2023-06-09T04:36:36.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b27fff700 1 --2- 172.21.15.184:0/2747798687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b280cee20 0x7f2b28069db0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b280705e0 tx=0x7f2b14009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65b0613ca6bfc18a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.636 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b277fe700 1 -- 172.21.15.184:0/2747798687 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14011830 con 0x7f2b280cee20 2023-06-09T04:36:36.637 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b277fe700 1 -- 172.21.15.184:0/2747798687 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b14011990 con 0x7f2b280cee20 2023-06-09T04:36:36.637 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b277fe700 1 -- 172.21.15.184:0/2747798687 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14011d20 con 0x7f2b280cee20 2023-06-09T04:36:36.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 -- 172.21.15.184:0/2747798687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b280cee20 msgr2=0x7f2b28069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 --2- 172.21.15.184:0/2747798687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b280cee20 0x7f2b28069db0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2b280705e0 tx=0x7f2b14009bd0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 -- 172.21.15.184:0/2747798687 shutdown_connections 2023-06-09T04:36:36.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 --2- 172.21.15.184:0/2747798687 >> v2:172.21.15.149:3300/0 conn(0x7f2b2815c520 0x7f2b28071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.639 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 --2- 172.21.15.184:0/2747798687 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b280cee20 0x7f2b28069db0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 -- 172.21.15.184:0/2747798687 >> 172.21.15.184:0/2747798687 conn(0x7f2b2806aec0 msgr2=0x7f2b2806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 -- 172.21.15.184:0/2747798687 shutdown_connections 2023-06-09T04:36:36.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.633+0000 7f2b2ee75700 1 -- 172.21.15.184:0/2747798687 wait complete. 2023-06-09T04:36:36.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 Processor -- start 2023-06-09T04:36:36.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 -- start start 2023-06-09T04:36:36.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b2806a2f0 0x7f2b281f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.640 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b280cee20 0x7f2b280c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b2815c520 0x7f2b280b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815ca90 con 0x7f2b280cee20 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815cd30 con 0x7f2b2815c520 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.635+0000 7f2b2ee75700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815d010 con 0x7f2b2806a2f0 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b2806a2f0 0x7f2b281f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2d412700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b2815c520 0x7f2b280b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b2806a2f0 0x7f2b281f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54354/0 (socket says 172.21.15.184:54354) 2023-06-09T04:36:36.641 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 -- 172.21.15.184:0/3372611600 learned_addr learned my addr 172.21.15.184:0/3372611600 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:36.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b27fff700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b280cee20 0x7f2b280c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 -- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b2815c520 msgr2=0x7f2b280b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b2815c520 0x7f2b280b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 -- 172.21.15.184:0/3372611600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b280cee20 msgr2=0x7f2b280c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b280cee20 0x7f2b280c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 -- 172.21.15.184:0/3372611600 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14009550 con 0x7f2b2806a2f0 2023-06-09T04:36:36.642 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2d412700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b2815c520 0x7f2b280b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2cc11700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b2806a2f0 0x7f2b281f5410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00e850 tx=0x7f2b1c00eb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b257fa700 1 -- 172.21.15.184:0/3372611600 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c0095b0 con 0x7f2b2806a2f0 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b257fa700 1 -- 172.21.15.184:0/3372611600 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c013680 con 0x7f2b2806a2f0 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b257fa700 1 -- 172.21.15.184:0/3372611600 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c013a10 con 0x7f2b2806a2f0 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2815d2f0 con 0x7f2b2806a2f0 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b281f5950 con 0x7f2b2806a2f0 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b257fa700 1 -- 172.21.15.184:0/3372611600 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2b1c005a20 con 0x7f2b2806a2f0 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.636+0000 7f2b257fa700 1 -- 172.21.15.184:0/3372611600 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f2b1c006700 con 0x7f2b2806a2f0 2023-06-09T04:36:36.644 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.637+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b28072060 con 0x7f2b2806a2f0 2023-06-09T04:36:36.644 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.639+0000 7f2b257fa700 1 -- 172.21.15.184:0/3372611600 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2b1c021060 con 0x7f2b2806a2f0 2023-06-09T04:36:36.680 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:36.679+0000 7fb8c161e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:36:36.724 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.723+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "83817238-e73f-425c-8f9d-7b9e96afd4cb", "id": 5} v 0) v1 -- 0x7f2b28073fa0 con 0x7f2b2806a2f0 2023-06-09T04:36:36.733 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.731+0000 7f2b257fa700 1 -- 172.21.15.184:0/3372611600 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83817238-e73f-425c-8f9d-7b9e96afd4cb", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b1c017070 con 0x7f2b2806a2f0 2023-06-09T04:36:36.733 INFO:teuthology.orchestra.run.smithi184.stdout:5 2023-06-09T04:36:36.734 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b2806a2f0 msgr2=0x7f2b281f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.734 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b2806a2f0 0x7f2b281f5410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00e850 tx=0x7f2b1c00eb60 comp rx=0 tx=0).stop 2023-06-09T04:36:36.734 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 shutdown_connections 2023-06-09T04:36:36.734 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b2806a2f0 0x7f2b281f5410 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.735 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b2815c520 0x7f2b280b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.735 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 --2- 172.21.15.184:0/3372611600 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b280cee20 0x7f2b280c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.735 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 >> 172.21.15.184:0/3372611600 conn(0x7f2b2806aec0 msgr2=0x7f2b2806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.735 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 shutdown_connections 2023-06-09T04:36:36.735 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.732+0000 7f2b2ee75700 1 -- 172.21.15.184:0/3372611600 wait complete. 2023-06-09T04:36:36.747 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 967a22c1-172f-4201-889f-3d3807bbe2fc 6 2023-06-09T04:36:36.868 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.867+0000 7f1e78bdc700 1 Processor -- start 2023-06-09T04:36:36.887 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.867+0000 7f1e78bdc700 1 -- start start 2023-06-09T04:36:36.890 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e78bdc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1e740ce310 0x7f1e740d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.890 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e78bdc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e740d0d30 con 0x7f1e740cd840 2023-06-09T04:36:36.891 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e78bdc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e740d1520 con 0x7f1e7415c270 2023-06-09T04:36:36.891 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e78bdc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7406aec0 con 0x7f1e740ce310 2023-06-09T04:36:36.891 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e72d9d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1e740ce310 0x7f1e740d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.891 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e7259c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f1e7415c270 0x7f1e740cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46128/0 (socket says 172.21.15.184:46128) 2023-06-09T04:36:36.891 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e7259c700 1 -- 172.21.15.184:0/415592970 learned_addr learned my addr 172.21.15.184:0/415592970 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-06-09T04:36:36.891 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e72d9d700 1 -- 172.21.15.184:0/415592970 >> v1:172.21.15.184:6789/0 conn(0x7f1e7415c270 legacy=0x7f1e740cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.891 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e72d9d700 1 -- 172.21.15.184:0/415592970 >> v1:172.21.15.149:6789/0 conn(0x7f1e740cd840 legacy=0x7f1e740cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e7159a700 1 -- 172.21.15.184:0/415592970 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679285881 0 0) 0x7f1e740d1520 con 0x7f1e7415c270 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e72d9d700 1 -- 172.21.15.184:0/415592970 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740cb1a0 con 0x7f1e740ce310 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.868+0000 7f1e72d9d700 1 --2- 172.21.15.184:0/415592970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e740ce310 0x7f1e740d07f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009d90 tx=0x7f1e6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7508bc184cc8a8e0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e7159a700 1 -- 172.21.15.184:0/415592970 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00e070 con 0x7f1e740ce310 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e7159a700 1 -- 172.21.15.184:0/415592970 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00bad0 con 0x7f1e740ce310 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e7159a700 1 -- 172.21.15.184:0/415592970 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00be80 con 0x7f1e740ce310 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e78bdc700 1 -- 172.21.15.184:0/415592970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e740ce310 msgr2=0x7f1e740d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.892 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e78bdc700 1 --2- 172.21.15.184:0/415592970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e740ce310 0x7f1e740d07f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009d90 tx=0x7f1e6c00b330 comp rx=0 tx=0).stop 2023-06-09T04:36:36.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e78bdc700 1 -- 172.21.15.184:0/415592970 shutdown_connections 2023-06-09T04:36:36.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e78bdc700 1 --2- 172.21.15.184:0/415592970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e740ce310 0x7f1e740d07f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e78bdc700 1 -- 172.21.15.184:0/415592970 >> 172.21.15.184:0/415592970 conn(0x7f1e74069db0 msgr2=0x7f1e7406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e78bdc700 1 -- 172.21.15.184:0/415592970 shutdown_connections 2023-06-09T04:36:36.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.869+0000 7f1e78bdc700 1 -- 172.21.15.184:0/415592970 wait complete. 2023-06-09T04:36:36.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 Processor -- start 2023-06-09T04:36:36.893 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 -- start start 2023-06-09T04:36:36.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e740cd840 0x7f1e740b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e740ce310 0x7f1e741587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e7415c270 0x7f1e74156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:36.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740b6230 con 0x7f1e740ce310 2023-06-09T04:36:36.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741581e0 con 0x7f1e7415c270 2023-06-09T04:36:36.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e78bdc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741584c0 con 0x7f1e740cd840 2023-06-09T04:36:36.894 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.871+0000 7f1e7259c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e740cd840 0x7f1e740b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e740cd840 0x7f1e740b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.184:54366/0 (socket says 172.21.15.184:54366) 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e71d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e740ce310 0x7f1e741587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 -- 172.21.15.184:0/401893295 learned_addr learned my addr 172.21.15.184:0/401893295 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e72d9d700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e7415c270 0x7f1e74156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 -- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e7415c270 msgr2=0x7f1e74156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e7415c270 0x7f1e74156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 -- 172.21.15.184:0/401893295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e740ce310 msgr2=0x7f1e741587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.895 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e740ce310 0x7f1e741587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 -- 172.21.15.184:0/401893295 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009a70 con 0x7f1e740cd840 2023-06-09T04:36:36.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e72d9d700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e7415c270 0x7f1e74156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:36.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e7259c700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e740cd840 0x7f1e740b5cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e640011e0 tx=0x7f1e6400ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:36.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e62ffd700 1 -- 172.21.15.184:0/401893295 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64004c80 con 0x7f1e740cd840 2023-06-09T04:36:36.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e62ffd700 1 -- 172.21.15.184:0/401893295 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64004e00 con 0x7f1e740cd840 2023-06-09T04:36:36.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e740b54f0 con 0x7f1e740cd840 2023-06-09T04:36:36.896 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e62ffd700 1 -- 172.21.15.184:0/401893295 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64007310 con 0x7f1e740cd840 2023-06-09T04:36:36.897 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e740b5200 con 0x7f1e740cd840 2023-06-09T04:36:36.897 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e62ffd700 1 -- 172.21.15.184:0/401893295 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1e6401d3f0 con 0x7f1e740cd840 2023-06-09T04:36:36.897 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.872+0000 7f1e62ffd700 1 -- 172.21.15.184:0/401893295 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1e640139b0 con 0x7f1e740cd840 2023-06-09T04:36:36.897 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.873+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74073fa0 con 0x7f1e740cd840 2023-06-09T04:36:36.897 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.875+0000 7f1e62ffd700 1 -- 172.21.15.184:0/401893295 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1e64013cc0 con 0x7f1e740cd840 2023-06-09T04:36:36.921 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:36.920+0000 7f3f73acf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-09T04:36:36.960 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.958+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd new", "uuid": "967a22c1-172f-4201-889f-3d3807bbe2fc", "id": 6} v 0) v1 -- 0x7f1e740b2790 con 0x7f1e740cd840 2023-06-09T04:36:36.968 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.966+0000 7f1e62ffd700 1 -- 172.21.15.184:0/401893295 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "967a22c1-172f-4201-889f-3d3807bbe2fc", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1e640133c0 con 0x7f1e740cd840 2023-06-09T04:36:36.968 INFO:teuthology.orchestra.run.smithi184.stdout:6 2023-06-09T04:36:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e740cd840 msgr2=0x7f1e740b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e740cd840 0x7f1e740b5cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e640011e0 tx=0x7f1e6400ca30 comp rx=0 tx=0).stop 2023-06-09T04:36:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 shutdown_connections 2023-06-09T04:36:36.969 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1e740cd840 0x7f1e740b5cf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e7415c270 0x7f1e74156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 --2- 172.21.15.184:0/401893295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1e740ce310 0x7f1e741587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 >> 172.21.15.184:0/401893295 conn(0x7f1e74069db0 msgr2=0x7f1e7406c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 shutdown_connections 2023-06-09T04:36:36.970 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:36.967+0000 7f1e78bdc700 1 -- 172.21.15.184:0/401893295 wait complete. 2023-06-09T04:36:36.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 2e80a178-e8a5-4d68-9e25-0db401c0337e 7 2023-06-09T04:36:37.085 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:37.084+0000 7f3f73acf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:36:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.118+0000 7f6284197700 1 Processor -- start 2023-06-09T04:36:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.119+0000 7f6284197700 1 -- start start 2023-06-09T04:36:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6284197700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071b90 0x7f627c16d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.145 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6284197700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f627c0b07d0 0x7f627c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6284197700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c16da30 con 0x7f627c071f60 2023-06-09T04:36:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6284197700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c0cae50 con 0x7f627c0b07d0 2023-06-09T04:36:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6284197700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0c8cb0 con 0x7f627c071b90 2023-06-09T04:36:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6281732700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f627c071f60 0x7f627c0b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46140/0 (socket says 172.21.15.184:46140) 2023-06-09T04:36:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6281732700 1 -- 172.21.15.184:0/3912796692 learned_addr learned my addr 172.21.15.184:0/3912796692 (peer_addr_for_me v1:172.21.15.184:0/0) 2023-06-09T04:36:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6281f33700 1 --2- 172.21.15.184:0/3912796692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071b90 0x7f627c16d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.146 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6282734700 1 --2- 172.21.15.184:0/3912796692 >> v2:172.21.15.149:3300/0 conn(0x7f627c0b07d0 0x7f627c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.120+0000 7f6280f31700 1 -- 172.21.15.184:0/3912796692 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442269495 0 0) 0x7f626c001110 con 0x7f627c071f60 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6280f31700 1 -- 172.21.15.184:0/3912796692 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62680035b0 con 0x7f627c071f60 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6281f33700 1 -- 172.21.15.184:0/3912796692 >> v2:172.21.15.149:3300/0 conn(0x7f627c0b07d0 msgr2=0x7f627c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6281f33700 1 --2- 172.21.15.184:0/3912796692 >> v2:172.21.15.149:3300/0 conn(0x7f627c0b07d0 0x7f627c0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6281f33700 1 -- 172.21.15.184:0/3912796692 >> v1:172.21.15.184:6789/0 conn(0x7f627c071f60 legacy=0x7f627c0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6281f33700 1 -- 172.21.15.184:0/3912796692 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0cab70 con 0x7f627c071b90 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6281f33700 1 --2- 172.21.15.184:0/3912796692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071b90 0x7f627c16d4f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f627800a8e0 tx=0x7f627800abf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6500ee82ac91780 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:37.147 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6280f31700 1 -- 172.21.15.184:0/3912796692 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800b6e0 con 0x7f627c071b90 2023-06-09T04:36:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6280f31700 1 -- 172.21.15.184:0/3912796692 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627800b840 con 0x7f627c071b90 2023-06-09T04:36:37.148 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.143+0000 7f6280f31700 1 -- 172.21.15.184:0/3912796692 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800bbd0 con 0x7f627c071b90 2023-06-09T04:36:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 -- 172.21.15.184:0/3912796692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071b90 msgr2=0x7f627c16d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 --2- 172.21.15.184:0/3912796692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071b90 0x7f627c16d4f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f627800a8e0 tx=0x7f627800abf0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.150 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 -- 172.21.15.184:0/3912796692 shutdown_connections 2023-06-09T04:36:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 --2- 172.21.15.184:0/3912796692 >> v2:172.21.15.149:3300/0 conn(0x7f627c0b07d0 0x7f627c0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 --2- 172.21.15.184:0/3912796692 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071b90 0x7f627c16d4f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 -- 172.21.15.184:0/3912796692 >> 172.21.15.184:0/3912796692 conn(0x7f627c06c160 msgr2=0x7f627c06c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 -- 172.21.15.184:0/3912796692 shutdown_connections 2023-06-09T04:36:37.151 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.144+0000 7f6284197700 1 -- 172.21.15.184:0/3912796692 wait complete. 2023-06-09T04:36:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.145+0000 7f6284197700 1 Processor -- start 2023-06-09T04:36:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.145+0000 7f6284197700 1 -- start start 2023-06-09T04:36:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6284197700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c071b90 0x7f627c088bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6284197700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071f60 0x7f627c16a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6284197700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0b07d0 0x7f627c15f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6284197700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c169cb0 con 0x7f627c071b90 2023-06-09T04:36:37.152 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6284197700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c16bc80 con 0x7f627c0b07d0 2023-06-09T04:36:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6284197700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c16bf60 con 0x7f627c071f60 2023-06-09T04:36:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6282734700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0b07d0 0x7f627c15f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6282734700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0b07d0 0x7f627c15f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:52326/0 (socket says 172.21.15.184:52326) 2023-06-09T04:36:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6282734700 1 -- 172.21.15.184:0/1880131014 learned_addr learned my addr 172.21.15.184:0/1880131014 (peer_addr_for_me v2:172.21.15.184:0/0) 2023-06-09T04:36:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6281f33700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c071b90 0x7f627c088bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.146+0000 7f6281732700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071f60 0x7f627c16a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.153 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6282734700 1 -- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071f60 msgr2=0x7f627c16a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6282734700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071f60 0x7f627c16a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6282734700 1 -- 172.21.15.184:0/1880131014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c071b90 msgr2=0x7f627c088bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6282734700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c071b90 0x7f627c088bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6282734700 1 -- 172.21.15.184:0/1880131014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627800a550 con 0x7f627c0b07d0 2023-06-09T04:36:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6281732700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071f60 0x7f627c16a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6282734700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0b07d0 0x7f627c15f120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6274011e90 tx=0x7f627400f640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:37.154 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f62727fc700 1 -- 172.21.15.184:0/1880131014 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274012450 con 0x7f627c0b07d0 2023-06-09T04:36:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f62727fc700 1 -- 172.21.15.184:0/1880131014 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62740125b0 con 0x7f627c0b07d0 2023-06-09T04:36:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c169f00 con 0x7f627c0b07d0 2023-06-09T04:36:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f62727fc700 1 -- 172.21.15.184:0/1880131014 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274012960 con 0x7f627c0b07d0 2023-06-09T04:36:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c0b26e0 con 0x7f627c0b07d0 2023-06-09T04:36:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f62727fc700 1 -- 172.21.15.184:0/1880131014 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f62740233f0 con 0x7f627c0b07d0 2023-06-09T04:36:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.147+0000 7f62727fc700 1 -- 172.21.15.184:0/1880131014 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6274012dc0 con 0x7f627c0b07d0 2023-06-09T04:36:37.155 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.148+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c073fa0 con 0x7f627c0b07d0 2023-06-09T04:36:37.156 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.150+0000 7f62727fc700 1 -- 172.21.15.184:0/1880131014 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6274028060 con 0x7f627c0b07d0 2023-06-09T04:36:37.247 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.246+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e80a178-e8a5-4d68-9e25-0db401c0337e", "id": 7} v 0) v1 -- 0x7f627c06e5d0 con 0x7f627c0b07d0 2023-06-09T04:36:37.253 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.252+0000 7f62727fc700 1 -- 172.21.15.184:0/1880131014 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e80a178-e8a5-4d68-9e25-0db401c0337e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f627401ac10 con 0x7f627c0b07d0 2023-06-09T04:36:37.254 INFO:teuthology.orchestra.run.smithi184.stdout:7 2023-06-09T04:36:37.254 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0b07d0 msgr2=0x7f627c15f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0b07d0 0x7f627c15f120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6274011e90 tx=0x7f627400f640 comp rx=0 tx=0).stop 2023-06-09T04:36:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 shutdown_connections 2023-06-09T04:36:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f627c0b07d0 0x7f627c15f120 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f627c071b90 0x7f627c088bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 --2- 172.21.15.184:0/1880131014 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f627c071f60 0x7f627c16a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.255 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 >> 172.21.15.184:0/1880131014 conn(0x7f627c06c160 msgr2=0x7f627c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 shutdown_connections 2023-06-09T04:36:37.256 INFO:teuthology.orchestra.run.smithi184.stderr:2023-06-09T04:36:37.253+0000 7f6284197700 1 -- 172.21.15.184:0/1880131014 wait complete. 2023-06-09T04:36:37.266 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-09T04:36:37.267 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-09T04:36:37.269 INFO:tasks.ceph.osd.0:Started 2023-06-09T04:36:37.269 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-09T04:36:37.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-09T04:36:37.271 INFO:tasks.ceph.osd.1:Started 2023-06-09T04:36:37.271 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-09T04:36:37.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-09T04:36:37.273 INFO:tasks.ceph.osd.2:Started 2023-06-09T04:36:37.274 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-09T04:36:37.274 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-09T04:36:37.276 INFO:tasks.ceph.osd.3:Started 2023-06-09T04:36:37.276 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-09T04:36:37.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-09T04:36:37.277 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:37.276+0000 7fb8c161e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-09T04:36:37.278 INFO:tasks.ceph.osd.4:Started 2023-06-09T04:36:37.279 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-09T04:36:37.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-09T04:36:37.281 INFO:tasks.ceph.osd.5:Started 2023-06-09T04:36:37.281 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-09T04:36:37.281 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-09T04:36:37.283 INFO:tasks.ceph.osd.6:Started 2023-06-09T04:36:37.283 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-09T04:36:37.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-09T04:36:37.285 INFO:tasks.ceph.osd.7:Started 2023-06-09T04:36:37.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:37.451 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:37.450+0000 7fb8c161e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:36:37.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.472+0000 7f3e5cedc700 1 Processor -- start 2023-06-09T04:36:37.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.472+0000 7f3e5cedc700 1 -- start start 2023-06-09T04:36:37.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e5cedc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e58071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e5cedc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5815c8f0 con 0x7f3e5806a4c0 2023-06-09T04:36:37.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e5cedc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e580cd3c0 con 0x7f3e580cee20 2023-06-09T04:36:37.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e5cedc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e580cd940 con 0x7f3e5815c520 2023-06-09T04:36:37.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e56d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3e5806a4c0 0x7f3e580b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59212/0 (socket says 172.21.15.149:59212) 2023-06-09T04:36:37.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e56d9d700 1 -- 172.21.15.149:0/506962665 learned_addr learned my addr 172.21.15.149:0/506962665 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:37.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e5659c700 1 --2- 172.21.15.149:0/506962665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e58071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e5559a700 1 -- 172.21.15.149:0/506962665 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762302665 0 0) 0x7f3e50001490 con 0x7f3e5806a4c0 2023-06-09T04:36:37.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.473+0000 7f3e5559a700 1 -- 172.21.15.149:0/506962665 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e400035b0 con 0x7f3e5806a4c0 2023-06-09T04:36:37.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5559a700 1 -- 172.21.15.149:0/506962665 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396973943 0 0) 0x7f3e580cd3c0 con 0x7f3e580cee20 2023-06-09T04:36:37.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5559a700 1 -- 172.21.15.149:0/506962665 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e50001490 con 0x7f3e580cee20 2023-06-09T04:36:37.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5659c700 1 -- 172.21.15.149:0/506962665 >> v1:172.21.15.184:6789/0 conn(0x7f3e580cee20 legacy=0x7f3e58069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5659c700 1 -- 172.21.15.149:0/506962665 >> v1:172.21.15.149:6789/0 conn(0x7f3e5806a4c0 legacy=0x7f3e580b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5659c700 1 -- 172.21.15.149:0/506962665 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e580b1e10 con 0x7f3e5815c520 2023-06-09T04:36:37.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5659c700 1 --2- 172.21.15.149:0/506962665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e58071560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009870 tx=0x7f3e48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525d8553aa439fb8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5559a700 1 -- 172.21.15.149:0/506962665 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011830 con 0x7f3e5815c520 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5559a700 1 -- 172.21.15.149:0/506962665 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e48011990 con 0x7f3e5815c520 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5559a700 1 -- 172.21.15.149:0/506962665 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48011d20 con 0x7f3e5815c520 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5cedc700 1 -- 172.21.15.149:0/506962665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 msgr2=0x7f3e58071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.474+0000 7f3e5cedc700 1 --2- 172.21.15.149:0/506962665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e58071560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009870 tx=0x7f3e48009b80 comp rx=0 tx=0).stop 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.475+0000 7f3e5cedc700 1 -- 172.21.15.149:0/506962665 shutdown_connections 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.475+0000 7f3e5cedc700 1 --2- 172.21.15.149:0/506962665 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e58071560 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.475+0000 7f3e5cedc700 1 -- 172.21.15.149:0/506962665 >> 172.21.15.149:0/506962665 conn(0x7f3e5806aec0 msgr2=0x7f3e5806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:37.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.475+0000 7f3e5cedc700 1 -- 172.21.15.149:0/506962665 shutdown_connections 2023-06-09T04:36:37.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.475+0000 7f3e5cedc700 1 -- 172.21.15.149:0/506962665 wait complete. 2023-06-09T04:36:37.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.476+0000 7f3e5cedc700 1 Processor -- start 2023-06-09T04:36:37.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.476+0000 7f3e5cedc700 1 -- start start 2023-06-09T04:36:37.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5cedc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e5806a4c0 0x7f3e581ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5cedc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cee20 0x7f3e581522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5cedc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e581f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:37.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5cedc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e581f2090 con 0x7f3e5806a4c0 2023-06-09T04:36:37.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5cedc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58152e20 con 0x7f3e580cee20 2023-06-09T04:36:37.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5cedc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e58153100 con 0x7f3e5815c520 2023-06-09T04:36:37.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e5806a4c0 0x7f3e581ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e5806a4c0 0x7f3e581ef2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35350/0 (socket says 172.21.15.149:35350) 2023-06-09T04:36:37.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5659c700 1 -- 172.21.15.149:0/2805811067 learned_addr learned my addr 172.21.15.149:0/2805811067 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:37.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e55d9b700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cee20 0x7f3e581522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e56d9d700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e581f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:37.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e55d9b700 1 -- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 msgr2=0x7f3e581f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e55d9b700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e581f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e55d9b700 1 -- 172.21.15.149:0/2805811067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e5806a4c0 msgr2=0x7f3e581ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e55d9b700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e5806a4c0 0x7f3e581ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e55d9b700 1 -- 172.21.15.149:0/2805811067 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480094a0 con 0x7f3e580cee20 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.477+0000 7f3e5659c700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e5806a4c0 0x7f3e581ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e55d9b700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cee20 0x7f3e581522c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c450 tx=0x7f3e4c00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e46ffd700 1 -- 172.21.15.149:0/2805811067 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0052d0 con 0x7f3e580cee20 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e46ffd700 1 -- 172.21.15.149:0/2805811067 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c005430 con 0x7f3e580cee20 2023-06-09T04:36:37.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e46ffd700 1 -- 172.21.15.149:0/2805811067 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0038c0 con 0x7f3e580cee20 2023-06-09T04:36:37.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e581533e0 con 0x7f3e580cee20 2023-06-09T04:36:37.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e581ef800 con 0x7f3e580cee20 2023-06-09T04:36:37.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e46ffd700 1 -- 172.21.15.149:0/2805811067 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e4c003d20 con 0x7f3e580cee20 2023-06-09T04:36:37.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.478+0000 7f3e46ffd700 1 -- 172.21.15.149:0/2805811067 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3e4c012af0 con 0x7f3e580cee20 2023-06-09T04:36:37.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.479+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e581f21d0 con 0x7f3e580cee20 2023-06-09T04:36:37.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.481+0000 7f3e46ffd700 1 -- 172.21.15.149:0/2805811067 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3e581f21d0 con 0x7f3e580cee20 2023-06-09T04:36:37.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.550+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e581ef990 con 0x7f3e580cee20 2023-06-09T04:36:37.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.551+0000 7f3e46ffd700 1 -- 172.21.15.149:0/2805811067 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3e4c017070 con 0x7f3e580cee20 2023-06-09T04:36:37.553 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:37.553 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":10,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:37.248881+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:37.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cee20 msgr2=0x7f3e581522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:37.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cee20 0x7f3e581522c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00c450 tx=0x7f3e4c00c760 comp rx=0 tx=0).stop 2023-06-09T04:36:37.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 shutdown_connections 2023-06-09T04:36:37.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3e5815c520 0x7f3e581f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e5806a4c0 0x7f3e581ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 --2- 172.21.15.149:0/2805811067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e580cee20 0x7f3e581522c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:37.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 >> 172.21.15.149:0/2805811067 conn(0x7f3e5806aec0 msgr2=0x7f3e580accd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:37.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 shutdown_connections 2023-06-09T04:36:37.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:37.552+0000 7f3e5cedc700 1 -- 172.21.15.149:0/2805811067 wait complete. 2023-06-09T04:36:37.566 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-09T04:36:37.566 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-09T04:36:37.659 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T04:36:37.658+0000 7f7c0cc87640 -1 Falling back to public interface 2023-06-09T04:36:37.847 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:37.846+0000 7f3f73acf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:36:37.884 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T04:36:37.882+0000 7f7040df9640 -1 Falling back to public interface 2023-06-09T04:36:37.886 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T04:36:37.885+0000 7fc10d93e640 -1 Falling back to public interface 2023-06-09T04:36:37.911 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T04:36:37.910+0000 7f9fcd10a640 -1 Falling back to public interface 2023-06-09T04:36:37.915 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T04:36:37.913+0000 7f5a9de2b640 -1 Falling back to public interface 2023-06-09T04:36:37.915 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T04:36:37.913+0000 7fe30f254640 -1 Falling back to public interface 2023-06-09T04:36:37.915 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T04:36:37.914+0000 7fa284c69640 -1 Falling back to public interface 2023-06-09T04:36:37.919 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T04:36:37.919+0000 7f18df934640 -1 Falling back to public interface 2023-06-09T04:36:37.927 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:37.926+0000 7f3f73acf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:36:38.071 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:38.070+0000 7f3f73acf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:36:38.149 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:38.147+0000 7fb8c161e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:36:38.228 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:38.227+0000 7fb8c161e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:36:38.311 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:38.310+0000 7f3f73acf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-09T04:36:38.366 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:38.365+0000 7fb8c161e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:36:38.371 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:38.388 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:38.387+0000 7f3f73acf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:36:38.487 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.486+0000 7f7685922700 1 Processor -- start 2023-06-09T04:36:38.487 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.486+0000 7f7685922700 1 -- start start 2023-06-09T04:36:38.489 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f7685922700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76800661f0 0x7f768015d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:38.489 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f7685922700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768006b6b0 con 0x7f768015c1b0 2023-06-09T04:36:38.489 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f7685922700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768015d650 con 0x7f768006d8b0 2023-06-09T04:36:38.489 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f7685922700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768015c580 con 0x7f76800661f0 2023-06-09T04:36:38.489 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f76800661f0 0x7f768015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:38.490 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767effd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f768015c1b0 0x7f7680069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59220/0 (socket says 172.21.15.149:59220) 2023-06-09T04:36:38.490 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767effd700 1 -- 172.21.15.149:0/2571537736 learned_addr learned my addr 172.21.15.149:0/2571537736 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:38.490 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767dffb700 1 -- 172.21.15.149:0/2571537736 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928930102 0 0) 0x7f768015d650 con 0x7f768006d8b0 2023-06-09T04:36:38.490 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767f7fe700 1 -- 172.21.15.149:0/2571537736 >> v1:172.21.15.184:6789/0 conn(0x7f768006d8b0 legacy=0x7f7680065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:38.490 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767f7fe700 1 -- 172.21.15.149:0/2571537736 >> v1:172.21.15.149:6789/0 conn(0x7f768015c1b0 legacy=0x7f7680069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:38.490 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767f7fe700 1 -- 172.21.15.149:0/2571537736 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768006dd20 con 0x7f76800661f0 2023-06-09T04:36:38.490 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767f7fe700 1 --2- 172.21.15.149:0/2571537736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76800661f0 0x7f768015d110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7678009d90 tx=0x7f767800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf01330d7395727 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:38.491 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767dffb700 1 -- 172.21.15.149:0/2571537736 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800e070 con 0x7f76800661f0 2023-06-09T04:36:38.491 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767dffb700 1 -- 172.21.15.149:0/2571537736 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767800bad0 con 0x7f76800661f0 2023-06-09T04:36:38.491 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.487+0000 7f767dffb700 1 -- 172.21.15.149:0/2571537736 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767800be80 con 0x7f76800661f0 2023-06-09T04:36:38.493 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.488+0000 7f7685922700 1 -- 172.21.15.149:0/2571537736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76800661f0 msgr2=0x7f768015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:38.494 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.488+0000 7f7685922700 1 --2- 172.21.15.149:0/2571537736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76800661f0 0x7f768015d110 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7678009d90 tx=0x7f767800b330 comp rx=0 tx=0).stop 2023-06-09T04:36:38.494 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.488+0000 7f7685922700 1 -- 172.21.15.149:0/2571537736 shutdown_connections 2023-06-09T04:36:38.494 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.488+0000 7f7685922700 1 --2- 172.21.15.149:0/2571537736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76800661f0 0x7f768015d110 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:38.494 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.488+0000 7f7685922700 1 -- 172.21.15.149:0/2571537736 >> 172.21.15.149:0/2571537736 conn(0x7f76800cef00 msgr2=0x7f76800cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:38.494 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.488+0000 7f7685922700 1 -- 172.21.15.149:0/2571537736 shutdown_connections 2023-06-09T04:36:38.494 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.488+0000 7f7685922700 1 -- 172.21.15.149:0/2571537736 wait complete. 2023-06-09T04:36:38.494 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.489+0000 7f7685922700 1 Processor -- start 2023-06-09T04:36:38.495 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.490+0000 7f7685922700 1 -- start start 2023-06-09T04:36:38.495 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.490+0000 7f7685922700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76800661f0 0x7f76801f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:38.495 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.490+0000 7f7685922700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f768006d8b0 0x7f76800c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:38.495 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.490+0000 7f7685922700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768015c1b0 0x7f76800b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:38.495 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.490+0000 7f7685922700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76801f2dd0 con 0x7f768006d8b0 2023-06-09T04:36:38.495 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.490+0000 7f7685922700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800c8d20 con 0x7f768015c1b0 2023-06-09T04:36:38.495 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.490+0000 7f7685922700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800c6170 con 0x7f76800661f0 2023-06-09T04:36:38.496 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f768006d8b0 0x7f76800c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:38.496 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f768006d8b0 0x7f76800c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35362/0 (socket says 172.21.15.149:35362) 2023-06-09T04:36:38.496 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 -- 172.21.15.149:0/601618255 learned_addr learned my addr 172.21.15.149:0/601618255 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:38.496 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767f7fe700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768015c1b0 0x7f76800b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:38.496 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767effd700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76800661f0 0x7f76801f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:38.496 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 -- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76800661f0 msgr2=0x7f76801f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:38.496 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76800661f0 0x7f76801f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:38.497 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 -- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768015c1b0 msgr2=0x7f76800b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:38.497 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768015c1b0 0x7f76800b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:38.497 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 -- 172.21.15.149:0/601618255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678009a70 con 0x7f768006d8b0 2023-06-09T04:36:38.497 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f767e7fc700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f768006d8b0 0x7f76800c6f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f767400c580 tx=0x7f767400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:38.497 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f7667fff700 1 -- 172.21.15.149:0/601618255 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740054e0 con 0x7f768006d8b0 2023-06-09T04:36:38.498 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f7667fff700 1 -- 172.21.15.149:0/601618255 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674003680 con 0x7f768006d8b0 2023-06-09T04:36:38.498 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76800c6450 con 0x7f768006d8b0 2023-06-09T04:36:38.498 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f7667fff700 1 -- 172.21.15.149:0/601618255 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674003a30 con 0x7f768006d8b0 2023-06-09T04:36:38.498 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.491+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76800c6a10 con 0x7f768006d8b0 2023-06-09T04:36:38.498 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.492+0000 7f7667fff700 1 -- 172.21.15.149:0/601618255 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f767401c440 con 0x7f768006d8b0 2023-06-09T04:36:38.498 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.492+0000 7f7667fff700 1 -- 172.21.15.149:0/601618255 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f767401cdc0 con 0x7f768006d8b0 2023-06-09T04:36:38.499 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.493+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76800ce0a0 con 0x7f768006d8b0 2023-06-09T04:36:38.499 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.495+0000 7f7667fff700 1 -- 172.21.15.149:0/601618255 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7674017070 con 0x7f768006d8b0 2023-06-09T04:36:38.575 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.573+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7680074000 con 0x7f768006d8b0 2023-06-09T04:36:38.575 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.574+0000 7f7667fff700 1 -- 172.21.15.149:0/601618255 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f767401c6f0 con 0x7f768006d8b0 2023-06-09T04:36:38.576 INFO:teuthology.misc.health.smithi149.stdout: 2023-06-09T04:36:38.576 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":10,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:37.248881+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:38.577 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f768006d8b0 msgr2=0x7f76800c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:38.577 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f768006d8b0 0x7f76800c6f30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f767400c580 tx=0x7f767400c890 comp rx=0 tx=0).stop 2023-06-09T04:36:38.577 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 shutdown_connections 2023-06-09T04:36:38.577 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f76800661f0 0x7f76801f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:38.578 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f768015c1b0 0x7f76800b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:38.578 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 --2- 172.21.15.149:0/601618255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f768006d8b0 0x7f76800c6f30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:38.578 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 >> 172.21.15.149:0/601618255 conn(0x7f76800cef00 msgr2=0x7f768015e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:38.578 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 shutdown_connections 2023-06-09T04:36:38.578 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:38.575+0000 7f7685922700 1 -- 172.21.15.149:0/601618255 wait complete. 2023-06-09T04:36:38.587 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T04:36:38.602 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:38.600+0000 7fb8c161e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-09T04:36:38.674 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:38.673+0000 7f3f73acf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:36:38.675 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:38.673+0000 7fb8c161e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:36:38.892 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:38.891+0000 7f3f73acf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:36:38.950 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:38.949+0000 7fb8c161e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:36:39.046 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:39.045+0000 7f3f73acf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:36:39.160 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:39.159+0000 7f3f73acf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:36:39.169 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:39.167+0000 7fb8c161e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:36:39.325 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:39.323+0000 7fb8c161e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:36:39.436 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:39.435+0000 7fb8c161e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:36:39.487 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:39.486+0000 7f3f73acf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:36:39.587 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:39.586+0000 7f3f73acf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:36:39.763 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:39.761+0000 7fb8c161e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:36:39.769 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:39.768+0000 7f3f73acf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:36:39.864 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:39.863+0000 7fb8c161e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:36:40.044 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:40.042+0000 7fb8c161e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:36:40.366 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:40.365+0000 7f3f73acf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:36:40.683 INFO:tasks.ceph.mgr.x.smithi184.stderr:2023-06-09T04:36:40.681+0000 7fb8c161e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:36:41.141 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T04:36:41.139+0000 7f7040df9640 -1 osd.4 0 log_to_monitors true 2023-06-09T04:36:41.210 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T04:36:41.209+0000 7f7c0cc87640 -1 osd.0 0 log_to_monitors true 2023-06-09T04:36:41.395 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:41.394+0000 7f3f2bcfb700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-09T04:36:41.395 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T04:36:41.394+0000 7f3f2bcfb700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-09T04:36:41.403 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T04:36:41.402+0000 7fc10d93e640 -1 osd.5 0 log_to_monitors true 2023-06-09T04:36:41.424 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T04:36:41.423+0000 7fe30f254640 -1 osd.7 0 log_to_monitors true 2023-06-09T04:36:41.470 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T04:36:41.469+0000 7f5a9de2b640 -1 osd.6 0 log_to_monitors true 2023-06-09T04:36:41.486 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T04:36:41.484+0000 7f18df934640 -1 osd.3 0 log_to_monitors true 2023-06-09T04:36:41.486 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T04:36:41.485+0000 7f9fcd10a640 -1 osd.2 0 log_to_monitors true 2023-06-09T04:36:41.487 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T04:36:41.486+0000 7fa284c69640 -1 osd.1 0 log_to_monitors true 2023-06-09T04:36:44.176 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T04:36:44.176+0000 7fc101cf6700 -1 osd.5 0 waiting for initial osdmap 2023-06-09T04:36:44.190 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T04:36:44.190+0000 7fc0f98d0700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:44.202 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T04:36:44.202+0000 7f70351b1700 -1 osd.4 0 waiting for initial osdmap 2023-06-09T04:36:44.219 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T04:36:44.219+0000 7f702cd8b700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:44.293 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T04:36:44.292+0000 7f7c0103f700 -1 osd.0 0 waiting for initial osdmap 2023-06-09T04:36:44.324 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T04:36:44.323+0000 7f7bf8c19700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:44.349 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T04:36:44.348+0000 7fe30360c700 -1 osd.7 0 waiting for initial osdmap 2023-06-09T04:36:44.366 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T04:36:44.366+0000 7fe2fb1e6700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:44.529 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T04:36:44.529+0000 7f5a921e3700 -1 osd.6 0 waiting for initial osdmap 2023-06-09T04:36:44.540 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T04:36:44.540+0000 7f5a89dbd700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:45.085 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T04:36:45.084+0000 7f9fc14c2700 -1 osd.2 0 waiting for initial osdmap 2023-06-09T04:36:45.096 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T04:36:45.095+0000 7f9fb909c700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:45.149 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T04:36:45.148+0000 7f18d3cec700 -1 osd.3 0 waiting for initial osdmap 2023-06-09T04:36:45.163 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T04:36:45.162+0000 7f18cb8c6700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:45.164 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T04:36:45.163+0000 7fa279021700 -1 osd.1 0 waiting for initial osdmap 2023-06-09T04:36:45.180 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T04:36:45.179+0000 7fa270bfb700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:36:45.393 DEBUG:teuthology.orchestra.run.smithi149:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:45.506 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.505+0000 7f487f4eb700 1 Processor -- start 2023-06-09T04:36:45.506 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.505+0000 7f487f4eb700 1 -- start start 2023-06-09T04:36:45.508 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487f4eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878158740 0x7f487806d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.508 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487f4eb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f487815ce60 0x7f487806c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.508 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487f4eb700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487815d2d0 con 0x7f4878069db0 2023-06-09T04:36:45.508 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487f4eb700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487806c5a0 con 0x7f487815ce60 2023-06-09T04:36:45.508 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487f4eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487806c790 con 0x7f4878158740 2023-06-09T04:36:45.508 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487ca86700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f487815ce60 0x7f487806c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.509 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487da88700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4878069db0 0x7f4878070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59348/0 (socket says 172.21.15.149:59348) 2023-06-09T04:36:45.509 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487da88700 1 -- 172.21.15.149:0/3220198133 learned_addr learned my addr 172.21.15.149:0/3220198133 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:45.509 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487d287700 1 --2- 172.21.15.149:0/3220198133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878158740 0x7f487806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.509 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487ca86700 1 -- 172.21.15.149:0/3220198133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878158740 msgr2=0x7f487806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:45.509 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487ca86700 1 --2- 172.21.15.149:0/3220198133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878158740 0x7f487806d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.509 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487ca86700 1 -- 172.21.15.149:0/3220198133 >> v1:172.21.15.149:6789/0 conn(0x7f4878069db0 legacy=0x7f4878070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.509 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487ca86700 1 -- 172.21.15.149:0/3220198133 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487806ca70 con 0x7f487815ce60 2023-06-09T04:36:45.510 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f486ffff700 1 -- 172.21.15.149:0/3220198133 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285996838 0 0) 0x7f487815d2d0 con 0x7f4878069db0 2023-06-09T04:36:45.510 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f487ca86700 1 --2- 172.21.15.149:0/3220198133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f487806c060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f486800a9c0 tx=0x7f486800acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb302e0703b8cc3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:45.510 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.506+0000 7f486ffff700 1 -- 172.21.15.149:0/3220198133 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868005e30 con 0x7f487815ce60 2023-06-09T04:36:45.510 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f486ffff700 1 -- 172.21.15.149:0/3220198133 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486800c760 con 0x7f487815ce60 2023-06-09T04:36:45.510 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f486ffff700 1 -- 172.21.15.149:0/3220198133 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800caf0 con 0x7f487815ce60 2023-06-09T04:36:45.512 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 -- 172.21.15.149:0/3220198133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 msgr2=0x7f487806c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.512 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 --2- 172.21.15.149:0/3220198133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f487806c060 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f486800a9c0 tx=0x7f486800acd0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.513 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 -- 172.21.15.149:0/3220198133 shutdown_connections 2023-06-09T04:36:45.513 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 --2- 172.21.15.149:0/3220198133 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878158740 0x7f487806d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.513 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 --2- 172.21.15.149:0/3220198133 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f487806c060 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.513 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 -- 172.21.15.149:0/3220198133 >> 172.21.15.149:0/3220198133 conn(0x7f48780cbd60 msgr2=0x7f48780ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:45.513 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 -- 172.21.15.149:0/3220198133 shutdown_connections 2023-06-09T04:36:45.513 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.507+0000 7f487f4eb700 1 -- 172.21.15.149:0/3220198133 wait complete. 2023-06-09T04:36:45.513 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.508+0000 7f487f4eb700 1 Processor -- start 2023-06-09T04:36:45.514 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.508+0000 7f487f4eb700 1 -- start start 2023-06-09T04:36:45.514 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487f4eb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878069db0 0x7f48781f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.514 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487f4eb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4878158740 0x7f48780c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.514 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487f4eb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f48780b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.514 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487f4eb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780b3a00 con 0x7f487815ce60 2023-06-09T04:36:45.514 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487f4eb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48780c4de0 con 0x7f4878158740 2023-06-09T04:36:45.514 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487f4eb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48780b4360 con 0x7f4878069db0 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487da88700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f48780b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487da88700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f48780b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35490/0 (socket says 172.21.15.149:35490) 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487da88700 1 -- 172.21.15.149:0/1085877078 learned_addr learned my addr 172.21.15.149:0/1085877078 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487d287700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878069db0 0x7f48781f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.509+0000 7f487ca86700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4878158740 0x7f48780c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487da88700 1 -- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878069db0 msgr2=0x7f48781f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487da88700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878069db0 0x7f48781f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.515 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487da88700 1 -- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4878158740 msgr2=0x7f48780c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487da88700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4878158740 0x7f48780c48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487da88700 1 -- 172.21.15.149:0/1085877078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486800a5d0 con 0x7f487815ce60 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487da88700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f48780b3e20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4870002230 tx=0x7f487000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f486dffb700 1 -- 172.21.15.149:0/1085877078 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487000aac0 con 0x7f487815ce60 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f486dffb700 1 -- 172.21.15.149:0/1085877078 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487000ac40 con 0x7f487815ce60 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48780b2d80 con 0x7f487815ce60 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f486dffb700 1 -- 172.21.15.149:0/1085877078 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48700070d0 con 0x7f487815ce60 2023-06-09T04:36:45.516 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.510+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48780b3340 con 0x7f487815ce60 2023-06-09T04:36:45.517 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.511+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48780b3b40 con 0x7f487815ce60 2023-06-09T04:36:45.517 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.511+0000 7f486dffb700 1 -- 172.21.15.149:0/1085877078 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f4870007250 con 0x7f487815ce60 2023-06-09T04:36:45.517 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.512+0000 7f486dffb700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f485c06ac50 0x7f485c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.518 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.512+0000 7f486dffb700 1 -- 172.21.15.149:0/1085877078 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f4870088720 con 0x7f487815ce60 2023-06-09T04:36:45.518 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.512+0000 7f487d287700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f485c06ac50 0x7f485c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.518 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.512+0000 7f487d287700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f485c06ac50 0x7f485c06d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4874006b20 tx=0x7f4874008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:45.518 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.516+0000 7f486dffb700 1 -- 172.21.15.149:0/1085877078 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4870054340 con 0x7f487815ce60 2023-06-09T04:36:45.714 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.713+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4878074000 con 0x7f487815ce60 2023-06-09T04:36:45.715 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.714+0000 7f486dffb700 1 -- 172.21.15.149:0/1085877078 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11012 (secure 0 0 0) 0x7f4870018020 con 0x7f487815ce60 2023-06-09T04:36:45.715 INFO:teuthology.misc.health.smithi149.stdout: 2023-06-09T04:36:45.715 INFO:teuthology.misc.health.smithi149.stdout:{"epoch":15,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:45.555880+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:45.717 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f485c06ac50 msgr2=0x7f485c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.718 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f485c06ac50 0x7f485c06d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4874006b20 tx=0x7f4874008040 comp rx=0 tx=0).stop 2023-06-09T04:36:45.718 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 msgr2=0x7f48780b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.718 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f48780b3e20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4870002230 tx=0x7f487000cf50 comp rx=0 tx=0).stop 2023-06-09T04:36:45.718 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 shutdown_connections 2023-06-09T04:36:45.718 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f485c06ac50 0x7f485c06d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.718 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4878069db0 0x7f48781f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.718 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f487815ce60 0x7f48780b3e20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.719 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 --2- 172.21.15.149:0/1085877078 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4878158740 0x7f48780c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.719 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 >> 172.21.15.149:0/1085877078 conn(0x7f48780cbd60 msgr2=0x7f48780ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:45.719 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 shutdown_connections 2023-06-09T04:36:45.719 INFO:teuthology.misc.health.smithi149.stderr:2023-06-09T04:36:45.716+0000 7f487f4eb700 1 -- 172.21.15.149:0/1085877078 wait complete. 2023-06-09T04:36:45.728 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-09T04:36:45.729 INFO:tasks.ceph:Creating RBD pool 2023-06-09T04:36:45.729 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-09T04:36:45.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.852+0000 7f192f44b700 1 Processor -- start 2023-06-09T04:36:45.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.852+0000 7f192f44b700 1 -- start start 2023-06-09T04:36:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192f44b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192f44b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f192806a4c0 0x7f19280b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192f44b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1928071290 con 0x7f1928071770 2023-06-09T04:36:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192f44b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280b2050 con 0x7f192806a4c0 2023-06-09T04:36:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192f44b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280cd2c0 con 0x7f192815c320 2023-06-09T04:36:45.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192d9e8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f192806a4c0 0x7f19280b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192c9e6700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1928071770 0x7f1928069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59476/0 (socket says 172.21.15.149:59476) 2023-06-09T04:36:45.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192c9e6700 1 -- 172.21.15.149:0/146058960 learned_addr learned my addr 172.21.15.149:0/146058960 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:45.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192d1e7700 1 --2- 172.21.15.149:0/146058960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192d9e8700 1 -- 172.21.15.149:0/146058960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 msgr2=0x7f19280cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:45.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192d9e8700 1 --2- 172.21.15.149:0/146058960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192d9e8700 1 -- 172.21.15.149:0/146058960 >> v1:172.21.15.149:6789/0 conn(0x7f1928071770 legacy=0x7f1928069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f191ffff700 1 -- 172.21.15.149:0/146058960 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701993998 0 0) 0x7f1928071290 con 0x7f1928071770 2023-06-09T04:36:45.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.853+0000 7f192d9e8700 1 -- 172.21.15.149:0/146058960 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280cd5a0 con 0x7f192806a4c0 2023-06-09T04:36:45.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192d9e8700 1 --2- 172.21.15.149:0/146058960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19280b24a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1920009d90 tx=0x7f192000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ac41b2c76d057c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:45.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f191ffff700 1 -- 172.21.15.149:0/146058960 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192000e070 con 0x7f192806a4c0 2023-06-09T04:36:45.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f191ffff700 1 -- 172.21.15.149:0/146058960 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192000bb20 con 0x7f192806a4c0 2023-06-09T04:36:45.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f191ffff700 1 -- 172.21.15.149:0/146058960 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920012430 con 0x7f192806a4c0 2023-06-09T04:36:45.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 -- 172.21.15.149:0/146058960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 msgr2=0x7f19280b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 --2- 172.21.15.149:0/146058960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19280b24a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1920009d90 tx=0x7f192000b330 comp rx=0 tx=0).stop 2023-06-09T04:36:45.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 -- 172.21.15.149:0/146058960 shutdown_connections 2023-06-09T04:36:45.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 --2- 172.21.15.149:0/146058960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19280b24a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 --2- 172.21.15.149:0/146058960 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 -- 172.21.15.149:0/146058960 >> 172.21.15.149:0/146058960 conn(0x7f192806aec0 msgr2=0x7f192806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:45.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 -- 172.21.15.149:0/146058960 shutdown_connections 2023-06-09T04:36:45.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.854+0000 7f192f44b700 1 -- 172.21.15.149:0/146058960 wait complete. 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 Processor -- start 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 -- start start 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19281538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1928071770 0x7f19280b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280c5900 con 0x7f192806a4c0 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19280ae020 con 0x7f1928071770 2023-06-09T04:36:45.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192f44b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19280c5e30 con 0x7f192815c320 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192d1e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19281538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192d1e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19281538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35618/0 (socket says 172.21.15.149:35618) 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.856+0000 7f192d1e7700 1 -- 172.21.15.149:0/1567284185 learned_addr learned my addr 172.21.15.149:0/1567284185 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192d9e8700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192c9e6700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1928071770 0x7f19280b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192d1e7700 1 -- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 msgr2=0x7f19280b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192d1e7700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192d1e7700 1 -- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1928071770 msgr2=0x7f19280b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192d1e7700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1928071770 0x7f19280b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192d1e7700 1 -- 172.21.15.149:0/1567284185 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920009a70 con 0x7f192806a4c0 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192c9e6700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1928071770 0x7f19280b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192d1e7700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19281538a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f192400e850 tx=0x7f192400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f191dffb700 1 -- 172.21.15.149:0/1567284185 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240095b0 con 0x7f192806a4c0 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f191dffb700 1 -- 172.21.15.149:0/1567284185 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400ee50 con 0x7f192806a4c0 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f191dffb700 1 -- 172.21.15.149:0/1567284185 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400ca70 con 0x7f192806a4c0 2023-06-09T04:36:45.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19280c5b50 con 0x7f192806a4c0 2023-06-09T04:36:45.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.857+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19280ae5a0 con 0x7f192806a4c0 2023-06-09T04:36:45.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.858+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1928073fa0 con 0x7f192806a4c0 2023-06-09T04:36:45.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.858+0000 7f191dffb700 1 -- 172.21.15.149:0/1567284185 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f192400cbd0 con 0x7f192806a4c0 2023-06-09T04:36:45.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.859+0000 7f191dffb700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f190c06ac50 0x7f190c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:45.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.859+0000 7f191dffb700 1 -- 172.21.15.149:0/1567284185 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f1924088cb0 con 0x7f192806a4c0 2023-06-09T04:36:45.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.859+0000 7f192c9e6700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f190c06ac50 0x7f190c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:45.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.859+0000 7f192c9e6700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f190c06ac50 0x7f190c06d100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19280c4f10 tx=0x7f1918009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:45.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:45.864+0000 7f191dffb700 1 -- 172.21.15.149:0/1567284185 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1924054500 con 0x7f192806a4c0 2023-06-09T04:36:46.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.050+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1928156150 con 0x7f192806a4c0 2023-06-09T04:36:46.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.605+0000 7f191dffb700 1 -- 172.21.15.149:0/1567284185 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f19240210a0 con 0x7f192806a4c0 2023-06-09T04:36:46.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.607+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f190c06ac50 msgr2=0x7f190c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:46.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.607+0000 7f192f44b700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f190c06ac50 0x7f190c06d100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f19280c4f10 tx=0x7f1918009040 comp rx=0 tx=0).stop 2023-06-09T04:36:46.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.607+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 msgr2=0x7f19281538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:46.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.607+0000 7f192f44b700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19281538a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f192400e850 tx=0x7f192400ec10 comp rx=0 tx=0).stop 2023-06-09T04:36:46.609 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 shutdown_connections 2023-06-09T04:36:46.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f190c06ac50 0x7f190c06d100 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f192815c320 0x7f19280b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f192806a4c0 0x7f19281538a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 --2- 172.21.15.149:0/1567284185 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1928071770 0x7f19280b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 >> 172.21.15.149:0/1567284185 conn(0x7f192806aec0 msgr2=0x7f192815b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:46.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 shutdown_connections 2023-06-09T04:36:46.610 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.608+0000 7f192f44b700 1 -- 172.21.15.149:0/1567284185 wait complete. 2023-06-09T04:36:46.611 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'rbd' created 2023-06-09T04:36:46.623 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-09T04:36:46.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.746+0000 7f09a6d63700 1 Processor -- start 2023-06-09T04:36:46.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.746+0000 7f09a6d63700 1 -- start start 2023-06-09T04:36:46.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f09a6d63700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f09a0159280 0x7f09a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:46.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f09a6d63700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f09a00ae830 0x7f09a00cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:46.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f09a6d63700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a006e100 con 0x7f09a00cd880 2023-06-09T04:36:46.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f09a6d63700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a0159650 con 0x7f09a00ae830 2023-06-09T04:36:46.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f09a6d63700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a00ace50 con 0x7f09a0159280 2023-06-09T04:36:46.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f099ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f09a00ae830 0x7f09a00cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:46.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f099ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f09a00ae830 0x7f09a00cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35656/0 (socket says 172.21.15.149:35656) 2023-06-09T04:36:46.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f099ffff700 1 -- 172.21.15.149:0/555666551 learned_addr learned my addr 172.21.15.149:0/555666551 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:46.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.747+0000 7f099ffff700 1 -- 172.21.15.149:0/555666551 >> v2:172.21.15.184:3300/0 conn(0x7f09a0159280 msgr2=0x7f09a006d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:46.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f099ffff700 1 --2- 172.21.15.149:0/555666551 >> v2:172.21.15.184:3300/0 conn(0x7f09a0159280 0x7f09a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f099ffff700 1 -- 172.21.15.149:0/555666551 >> v1:172.21.15.184:6789/0 conn(0x7f09a00cd880 legacy=0x7f09a00cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:46.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f099ffff700 1 -- 172.21.15.149:0/555666551 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a006ded0 con 0x7f09a00ae830 2023-06-09T04:36:46.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f099ffff700 1 --2- 172.21.15.149:0/555666551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00cd340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f09a00710a0 tx=0x7f098c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ded42b26fb8fc39 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:46.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f099f7fe700 1 -- 172.21.15.149:0/555666551 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c004230 con 0x7f09a00ae830 2023-06-09T04:36:46.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f099f7fe700 1 -- 172.21.15.149:0/555666551 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c004390 con 0x7f09a00ae830 2023-06-09T04:36:46.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f099f7fe700 1 -- 172.21.15.149:0/555666551 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c0036a0 con 0x7f09a00ae830 2023-06-09T04:36:46.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 -- 172.21.15.149:0/555666551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 msgr2=0x7f09a00cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:46.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 --2- 172.21.15.149:0/555666551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00cd340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f09a00710a0 tx=0x7f098c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 -- 172.21.15.149:0/555666551 shutdown_connections 2023-06-09T04:36:46.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 --2- 172.21.15.149:0/555666551 >> v2:172.21.15.184:3300/0 conn(0x7f09a0159280 0x7f09a006d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 --2- 172.21.15.149:0/555666551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00cd340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 -- 172.21.15.149:0/555666551 >> 172.21.15.149:0/555666551 conn(0x7f09a0098b20 msgr2=0x7f09a006b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:46.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 -- 172.21.15.149:0/555666551 shutdown_connections 2023-06-09T04:36:46.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.748+0000 7f09a6d63700 1 -- 172.21.15.149:0/555666551 wait complete. 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 Processor -- start 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 -- start start 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a00cd880 0x7f09a0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a0159280 0x7f09a006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00ca7f0 con 0x7f09a00ae830 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c5300 con 0x7f09a0159280 2023-06-09T04:36:46.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.750+0000 7f09a6d63700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00c55e0 con 0x7f09a00cd880 2023-06-09T04:36:46.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:46.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35660/0 (socket says 172.21.15.149:35660) 2023-06-09T04:36:46.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 -- 172.21.15.149:0/1552380192 learned_addr learned my addr 172.21.15.149:0/1552380192 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:46.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a5300700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a0159280 0x7f09a006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:46.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f099ffff700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a00cd880 0x7f09a0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:46.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 -- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a00cd880 msgr2=0x7f09a0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:46.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a00cd880 0x7f09a0069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 -- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a0159280 msgr2=0x7f09a006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a0159280 0x7f09a006a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 -- 172.21.15.149:0/1552380192 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c009550 con 0x7f09a00ae830 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a4aff700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00c9da0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f099400b480 tx=0x7f099400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f099d7fa700 1 -- 172.21.15.149:0/1552380192 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994005a00 con 0x7f09a00ae830 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f099d7fa700 1 -- 172.21.15.149:0/1552380192 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0994005b60 con 0x7f09a00ae830 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a00c58c0 con 0x7f09a00ae830 2023-06-09T04:36:46.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f099d7fa700 1 -- 172.21.15.149:0/1552380192 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0994011630 con 0x7f09a00ae830 2023-06-09T04:36:46.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.751+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a00ca2e0 con 0x7f09a00ae830 2023-06-09T04:36:46.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.752+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a00ccc40 con 0x7f09a00ae830 2023-06-09T04:36:46.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.753+0000 7f099d7fa700 1 -- 172.21.15.149:0/1552380192 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f0994011790 con 0x7f09a00ae830 2023-06-09T04:36:46.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.753+0000 7f099d7fa700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098406ac50 0x7f098406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:46.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.753+0000 7f099d7fa700 1 -- 172.21.15.149:0/1552380192 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f0994088cb0 con 0x7f09a00ae830 2023-06-09T04:36:46.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.753+0000 7f099ffff700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098406ac50 0x7f098406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:46.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.753+0000 7f099ffff700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098406ac50 0x7f098406d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f098c000c00 tx=0x7f098c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:46.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.758+0000 7f099d7fa700 1 -- 172.21.15.149:0/1552380192 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09940541a0 con 0x7f09a00ae830 2023-06-09T04:36:46.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:46.948+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09a00ca560 con 0x7f09a00ae830 2023-06-09T04:36:47.607 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.606+0000 7f099d7fa700 1 -- 172.21.15.149:0/1552380192 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0994015020 con 0x7f09a00ae830 2023-06-09T04:36:47.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098406ac50 msgr2=0x7f098406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:47.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098406ac50 0x7f098406d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f098c000c00 tx=0x7f098c008030 comp rx=0 tx=0).stop 2023-06-09T04:36:47.611 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 msgr2=0x7f09a00c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:47.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00c9da0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f099400b480 tx=0x7f099400b840 comp rx=0 tx=0).stop 2023-06-09T04:36:47.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 shutdown_connections 2023-06-09T04:36:47.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098406ac50 0x7f098406d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a0159280 0x7f09a006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a00ae830 0x7f09a00c9da0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 --2- 172.21.15.149:0/1552380192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a00cd880 0x7f09a0069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.612 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 >> 172.21.15.149:0/1552380192 conn(0x7f09a0098b20 msgr2=0x7f09a00cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:47.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 shutdown_connections 2023-06-09T04:36:47.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.610+0000 7f09a6d63700 1 -- 172.21.15.149:0/1552380192 wait complete. 2023-06-09T04:36:47.613 INFO:teuthology.orchestra.run.smithi149.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-09T04:36:47.627 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-09T04:36:47.628 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:36:47.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:36:47.630 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:36:47.631 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:36:47.631 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:36:47.633 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:36:47.633 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:36:47.633 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:36:47.635 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:36:47.636 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:36:47.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:36:47.638 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:36:47.638 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-09T04:36:47.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:47.720 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-06-09T04:36:47.720 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-06-09T04:36:47.727 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-06-09T04:36:47.733 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-06-09T04:36:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.781+0000 7f57bec76700 1 Processor -- start 2023-06-09T04:36:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.781+0000 7f57bec76700 1 -- start start 2023-06-09T04:36:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bec76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f57b81588c0 0x7f57b80c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bec76700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f57b80ca060 0x7f57b8070530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bec76700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b8070eb0 con 0x7f57b8070a70 2023-06-09T04:36:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bec76700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80ae2a0 con 0x7f57b81588c0 2023-06-09T04:36:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bec76700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80ce3f0 con 0x7f57b80ca060 2023-06-09T04:36:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bca12700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f57b81588c0 0x7f57b80c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bca12700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f57b81588c0 0x7f57b80c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35724/0 (socket says 172.21.15.149:35724) 2023-06-09T04:36:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bca12700 1 -- 172.21.15.149:0/3429372655 learned_addr learned my addr 172.21.15.149:0/3429372655 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57b7fff700 1 --2- 172.21.15.149:0/3429372655 >> v2:172.21.15.184:3300/0 conn(0x7f57b80ca060 0x7f57b8070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bca12700 1 -- 172.21.15.149:0/3429372655 >> v2:172.21.15.184:3300/0 conn(0x7f57b80ca060 msgr2=0x7f57b8070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bca12700 1 --2- 172.21.15.149:0/3429372655 >> v2:172.21.15.184:3300/0 conn(0x7f57b80ca060 0x7f57b8070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.782+0000 7f57bca12700 1 -- 172.21.15.149:0/3429372655 >> v1:172.21.15.184:6789/0 conn(0x7f57b8070a70 legacy=0x7f57b815c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:47.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bca12700 1 -- 172.21.15.149:0/3429372655 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80cd350 con 0x7f57b81588c0 2023-06-09T04:36:47.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bca12700 1 --2- 172.21.15.149:0/3429372655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80c9b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098f0 tx=0x7f57ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9e45ed2389d2b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:47.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57b77fe700 1 -- 172.21.15.149:0/3429372655 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac004230 con 0x7f57b81588c0 2023-06-09T04:36:47.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57b77fe700 1 -- 172.21.15.149:0/3429372655 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac004390 con 0x7f57b81588c0 2023-06-09T04:36:47.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57b77fe700 1 -- 172.21.15.149:0/3429372655 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0036a0 con 0x7f57b81588c0 2023-06-09T04:36:47.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bec76700 1 -- 172.21.15.149:0/3429372655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 msgr2=0x7f57b80c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bec76700 1 --2- 172.21.15.149:0/3429372655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80c9b20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098f0 tx=0x7f57ac009c00 comp rx=0 tx=0).stop 2023-06-09T04:36:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bec76700 1 -- 172.21.15.149:0/3429372655 shutdown_connections 2023-06-09T04:36:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bec76700 1 --2- 172.21.15.149:0/3429372655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80c9b20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bec76700 1 --2- 172.21.15.149:0/3429372655 >> v2:172.21.15.184:3300/0 conn(0x7f57b80ca060 0x7f57b8070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.783+0000 7f57bec76700 1 -- 172.21.15.149:0/3429372655 >> 172.21.15.149:0/3429372655 conn(0x7f57b80cb480 msgr2=0x7f57b80cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.784+0000 7f57bec76700 1 -- 172.21.15.149:0/3429372655 shutdown_connections 2023-06-09T04:36:47.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.784+0000 7f57bec76700 1 -- 172.21.15.149:0/3429372655 wait complete. 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.785+0000 7f57bec76700 1 Processor -- start 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.785+0000 7f57bec76700 1 -- start start 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57b8070a70 0x7f57b8155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b80ca060 0x7f57b80ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80aef50 con 0x7f57b81588c0 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81ddad0 con 0x7f57b80ca060 2023-06-09T04:36:47.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80ac7e0 con 0x7f57b8070a70 2023-06-09T04:36:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80acdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35734/0 (socket says 172.21.15.149:35734) 2023-06-09T04:36:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 -- 172.21.15.149:0/707890101 learned_addr learned my addr 172.21.15.149:0/707890101 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bca12700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57b8070a70 0x7f57b8155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 -- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57b8070a70 msgr2=0x7f57b8155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57b8070a70 0x7f57b8155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57b7fff700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b80ca060 0x7f57b80ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 -- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b80ca060 msgr2=0x7f57b80ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b80ca060 0x7f57b80ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 -- 172.21.15.149:0/707890101 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009550 con 0x7f57b81588c0 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bd213700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80acdc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57b000b970 tx=0x7f57b000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57b57fa700 1 -- 172.21.15.149:0/707890101 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b000c9b0 con 0x7f57b81588c0 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57b57fa700 1 -- 172.21.15.149:0/707890101 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b000cb10 con 0x7f57b81588c0 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b81f6290 con 0x7f57b81588c0 2023-06-09T04:36:47.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57b57fa700 1 -- 172.21.15.149:0/707890101 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0014440 con 0x7f57b81588c0 2023-06-09T04:36:47.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.786+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b81f6850 con 0x7f57b81588c0 2023-06-09T04:36:47.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.787+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b81ddc10 con 0x7f57b81588c0 2023-06-09T04:36:47.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.788+0000 7f57b57fa700 1 -- 172.21.15.149:0/707890101 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f57b001d3b0 con 0x7f57b81588c0 2023-06-09T04:36:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.788+0000 7f57b57fa700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f579c06ac50 0x7f579c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.788+0000 7f57b57fa700 1 -- 172.21.15.149:0/707890101 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f57b0088c80 con 0x7f57b81588c0 2023-06-09T04:36:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.788+0000 7f57bca12700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f579c06ac50 0x7f579c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.789+0000 7f57bca12700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f579c06ac50 0x7f579c06d100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009c40 tx=0x7f57ac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:47.794 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.793+0000 7f57b57fa700 1 -- 172.21.15.149:0/707890101 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f57b00541f0 con 0x7f57b81588c0 2023-06-09T04:36:47.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.997+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57b8073fa0 con 0x7f57b81588c0 2023-06-09T04:36:47.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:47.998+0000 7f57b57fa700 1 -- 172.21.15.149:0/707890101 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14617 (secure 0 0 0) 0x7f57b0057810 con 0x7f57b81588c0 2023-06-09T04:36:48.000 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:48.000 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":17,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:47.603411+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:48.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f579c06ac50 msgr2=0x7f579c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f579c06ac50 0x7f579c06d100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009c40 tx=0x7f57ac008030 comp rx=0 tx=0).stop 2023-06-09T04:36:48.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 msgr2=0x7f57b80acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80acdc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57b000b970 tx=0x7f57b000bd30 comp rx=0 tx=0).stop 2023-06-09T04:36:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 shutdown_connections 2023-06-09T04:36:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f579c06ac50 0x7f579c06d100 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f57b8070a70 0x7f57b8155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f57b81588c0 0x7f57b80acdc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 --2- 172.21.15.149:0/707890101 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57b80ca060 0x7f57b80ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 >> 172.21.15.149:0/707890101 conn(0x7f57b80cb480 msgr2=0x7f57b806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:48.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 shutdown_connections 2023-06-09T04:36:48.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.001+0000 7f57bec76700 1 -- 172.21.15.149:0/707890101 wait complete. 2023-06-09T04:36:48.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:36:48.016 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:36:48.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.140+0000 7fc27fa8f700 1 Processor -- start 2023-06-09T04:36:48.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27fa8f700 1 -- start start 2023-06-09T04:36:48.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27fa8f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc27815c520 0x7fc278071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27fa8f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc2780cee20 0x7fc278069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27fa8f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc2780b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27fa8f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2780cd940 con 0x7fc27815c520 2023-06-09T04:36:48.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27fa8f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27806a770 con 0x7fc2780cee20 2023-06-09T04:36:48.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27fa8f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2780b20f0 con 0x7fc27806a2f0 2023-06-09T04:36:48.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27d82b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc27815c520 0x7fc278071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.141+0000 7fc27d82b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc27815c520 0x7fc278071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35748/0 (socket says 172.21.15.149:35748) 2023-06-09T04:36:48.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d82b700 1 -- 172.21.15.149:0/128860918 learned_addr learned my addr 172.21.15.149:0/128860918 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:48.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27e02c700 1 --2- 172.21.15.149:0/128860918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc2780b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d02a700 1 --2- 172.21.15.149:0/128860918 >> v2:172.21.15.184:3300/0 conn(0x7fc2780cee20 0x7fc278069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d82b700 1 -- 172.21.15.149:0/128860918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 msgr2=0x7fc2780b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:48.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d82b700 1 --2- 172.21.15.149:0/128860918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc2780b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d82b700 1 -- 172.21.15.149:0/128860918 >> v2:172.21.15.184:3300/0 conn(0x7fc2780cee20 msgr2=0x7fc278069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:48.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d82b700 1 --2- 172.21.15.149:0/128860918 >> v2:172.21.15.184:3300/0 conn(0x7fc2780cee20 0x7fc278069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d82b700 1 -- 172.21.15.149:0/128860918 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27815c8f0 con 0x7fc27815c520 2023-06-09T04:36:48.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27d82b700 1 --2- 172.21.15.149:0/128860918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27815c520 0x7fc278071560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2780705e0 tx=0x7fc268009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbaabd231e4d1bc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27c829700 1 -- 172.21.15.149:0/128860918 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268011830 con 0x7fc27815c520 2023-06-09T04:36:48.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27c829700 1 -- 172.21.15.149:0/128860918 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc268011990 con 0x7fc27815c520 2023-06-09T04:36:48.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.142+0000 7fc27c829700 1 -- 172.21.15.149:0/128860918 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc268011d20 con 0x7fc27815c520 2023-06-09T04:36:48.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 -- 172.21.15.149:0/128860918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27815c520 msgr2=0x7fc278071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/128860918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27815c520 0x7fc278071560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc2780705e0 tx=0x7fc268009bd0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 -- 172.21.15.149:0/128860918 shutdown_connections 2023-06-09T04:36:48.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/128860918 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc2780b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/128860918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc27815c520 0x7fc278071560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/128860918 >> v2:172.21.15.184:3300/0 conn(0x7fc2780cee20 0x7fc278069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 -- 172.21.15.149:0/128860918 >> 172.21.15.149:0/128860918 conn(0x7fc27806aec0 msgr2=0x7fc27806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:48.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 -- 172.21.15.149:0/128860918 shutdown_connections 2023-06-09T04:36:48.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.143+0000 7fc27fa8f700 1 -- 172.21.15.149:0/128860918 wait complete. 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.144+0000 7fc27fa8f700 1 Processor -- start 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.144+0000 7fc27fa8f700 1 -- start start 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27fa8f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc278157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27fa8f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2780cee20 0x7fc278158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27fa8f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27815c520 0x7fc278157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27fa8f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc278159b90 con 0x7fc2780cee20 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27fa8f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc278159350 con 0x7fc27815c520 2023-06-09T04:36:48.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27fa8f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2781f2210 con 0x7fc27806a2f0 2023-06-09T04:36:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2780cee20 0x7fc278158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2780cee20 0x7fc278158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35754/0 (socket says 172.21.15.149:35754) 2023-06-09T04:36:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 -- 172.21.15.149:0/1520702837 learned_addr learned my addr 172.21.15.149:0/1520702837 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d82b700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc278157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27e02c700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27815c520 0x7fc278157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 -- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 msgr2=0x7fc278157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc278157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 -- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27815c520 msgr2=0x7fc278157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27815c520 0x7fc278157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 -- 172.21.15.149:0/1520702837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268009550 con 0x7fc2780cee20 2023-06-09T04:36:48.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27d02a700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2780cee20 0x7fc278158e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc27400e9b0 tx=0x7fc27400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc26e7fc700 1 -- 172.21.15.149:0/1520702837 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274009710 con 0x7fc2780cee20 2023-06-09T04:36:48.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc26e7fc700 1 -- 172.21.15.149:0/1520702837 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400ee50 con 0x7fc2780cee20 2023-06-09T04:36:48.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2781595d0 con 0x7fc2780cee20 2023-06-09T04:36:48.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.145+0000 7fc26e7fc700 1 -- 172.21.15.149:0/1520702837 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400ca50 con 0x7fc2780cee20 2023-06-09T04:36:48.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.146+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27815e040 con 0x7fc2780cee20 2023-06-09T04:36:48.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.146+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27815dea0 con 0x7fc2780cee20 2023-06-09T04:36:48.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.147+0000 7fc26e7fc700 1 -- 172.21.15.149:0/1520702837 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fc27400cbb0 con 0x7fc2780cee20 2023-06-09T04:36:48.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.147+0000 7fc26e7fc700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc25c06ac50 0x7fc25c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.147+0000 7fc26e7fc700 1 -- 172.21.15.149:0/1520702837 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc274088ed0 con 0x7fc2780cee20 2023-06-09T04:36:48.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.152+0000 7fc26e7fc700 1 -- 172.21.15.149:0/1520702837 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc27815dea0 con 0x7fc2780cee20 2023-06-09T04:36:48.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.158+0000 7fc27d82b700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc25c06ac50 0x7fc25c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.158+0000 7fc27d82b700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc25c06ac50 0x7fc25c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc268014040 tx=0x7fc268008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.346+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc27815dea0 con 0x7fc2780cee20 2023-06-09T04:36:48.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.347+0000 7fc26e7fc700 1 -- 172.21.15.149:0/1520702837 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc27815dea0 con 0x7fc2780cee20 2023-06-09T04:36:48.348 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:36:48.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc25c06ac50 msgr2=0x7fc25c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc25c06ac50 0x7fc25c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc268014040 tx=0x7fc268008030 comp rx=0 tx=0).stop 2023-06-09T04:36:48.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2780cee20 msgr2=0x7fc278158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2780cee20 0x7fc278158e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc27400e9b0 tx=0x7fc27400ecc0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 shutdown_connections 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc25c06ac50 0x7fc25c06d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc27806a2f0 0x7fc278157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc27815c520 0x7fc278157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 --2- 172.21.15.149:0/1520702837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2780cee20 0x7fc278158e10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 >> 172.21.15.149:0/1520702837 conn(0x7fc27806aec0 msgr2=0x7fc2780add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:48.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 shutdown_connections 2023-06-09T04:36:48.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.349+0000 7fc27fa8f700 1 -- 172.21.15.149:0/1520702837 wait complete. 2023-06-09T04:36:48.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:36:48.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.487+0000 7fe407edb700 1 Processor -- start 2023-06-09T04:36:48.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.487+0000 7fe407edb700 1 -- start start 2023-06-09T04:36:48.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe407edb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe40015c200 0x7fe4000ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe407edb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe4000ce480 0x7fe40006c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe407edb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40015c5d0 con 0x7fe40006c7f0 2023-06-09T04:36:48.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe407edb700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000cec20 con 0x7fe4000ce480 2023-06-09T04:36:48.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe407edb700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000ce940 con 0x7fe40015c200 2023-06-09T04:36:48.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe405476700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe4000ce480 0x7fe40006c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe405c77700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe40015c200 0x7fe4000ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe406478700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe40006c7f0 0x7fe40006a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:37402/0 (socket says 172.21.15.149:37402) 2023-06-09T04:36:48.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe405c77700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe40015c200 0x7fe4000ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55032/0 (socket says 172.21.15.149:55032) 2023-06-09T04:36:48.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe406478700 1 -- 172.21.15.149:0/792833467 learned_addr learned my addr 172.21.15.149:0/792833467 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:48.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe405c77700 1 -- 172.21.15.149:0/792833467 >> v2:172.21.15.149:3300/0 conn(0x7fe4000ce480 msgr2=0x7fe40006c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:48.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.488+0000 7fe405c77700 1 --2- 172.21.15.149:0/792833467 >> v2:172.21.15.149:3300/0 conn(0x7fe4000ce480 0x7fe40006c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.489+0000 7fe405c77700 1 -- 172.21.15.149:0/792833467 >> v1:172.21.15.184:6789/0 conn(0x7fe40006c7f0 legacy=0x7fe40006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.489+0000 7fe405c77700 1 -- 172.21.15.149:0/792833467 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400069ee0 con 0x7fe40015c200 2023-06-09T04:36:48.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.489+0000 7fe405c77700 1 --2- 172.21.15.149:0/792833467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40015c200 0x7fe4000ae270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe400072260 tx=0x7fe3fc009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=873ac07ea77eb652 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.489+0000 7fe404c75700 1 -- 172.21.15.149:0/792833467 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc011830 con 0x7fe40015c200 2023-06-09T04:36:48.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.489+0000 7fe404c75700 1 -- 172.21.15.149:0/792833467 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc011990 con 0x7fe40015c200 2023-06-09T04:36:48.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.489+0000 7fe404c75700 1 -- 172.21.15.149:0/792833467 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc011d20 con 0x7fe40015c200 2023-06-09T04:36:48.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 -- 172.21.15.149:0/792833467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40015c200 msgr2=0x7fe4000ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 --2- 172.21.15.149:0/792833467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40015c200 0x7fe4000ae270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe400072260 tx=0x7fe3fc009b20 comp rx=0 tx=0).stop 2023-06-09T04:36:48.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 -- 172.21.15.149:0/792833467 shutdown_connections 2023-06-09T04:36:48.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 --2- 172.21.15.149:0/792833467 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40015c200 0x7fe4000ae270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 --2- 172.21.15.149:0/792833467 >> v2:172.21.15.149:3300/0 conn(0x7fe4000ce480 0x7fe40006c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 -- 172.21.15.149:0/792833467 >> 172.21.15.149:0/792833467 conn(0x7fe4000cee30 msgr2=0x7fe4000cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:48.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 -- 172.21.15.149:0/792833467 shutdown_connections 2023-06-09T04:36:48.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.490+0000 7fe407edb700 1 -- 172.21.15.149:0/792833467 wait complete. 2023-06-09T04:36:48.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.491+0000 7fe407edb700 1 Processor -- start 2023-06-09T04:36:48.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.491+0000 7fe407edb700 1 -- start start 2023-06-09T04:36:48.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe407edb700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe40006c7f0 0x7fe400155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe407edb700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4000ce480 0x7fe4000c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe407edb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe40015c200 0x7fe400154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe407edb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000c2eb0 con 0x7fe40015c200 2023-06-09T04:36:48.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe407edb700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000c3190 con 0x7fe4000ce480 2023-06-09T04:36:48.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe407edb700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000c3470 con 0x7fe40006c7f0 2023-06-09T04:36:48.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405476700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4000ce480 0x7fe4000c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405c77700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe40006c7f0 0x7fe400155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405476700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4000ce480 0x7fe4000c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55040/0 (socket says 172.21.15.149:55040) 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe406478700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe40015c200 0x7fe400154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405476700 1 -- 172.21.15.149:0/3701160206 learned_addr learned my addr 172.21.15.149:0/3701160206 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405476700 1 -- 172.21.15.149:0/3701160206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe40006c7f0 msgr2=0x7fe400155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405476700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe40006c7f0 0x7fe400155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405476700 1 -- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe40015c200 msgr2=0x7fe400154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.492+0000 7fe405476700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe40015c200 0x7fe400154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.493+0000 7fe405476700 1 -- 172.21.15.149:0/3701160206 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0094a0 con 0x7fe4000ce480 2023-06-09T04:36:48.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.493+0000 7fe405476700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4000ce480 0x7fe4000c3f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000e9b0 tx=0x7fe3f000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.493+0000 7fe3f67fc700 1 -- 172.21.15.149:0/3701160206 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000ee50 con 0x7fe4000ce480 2023-06-09T04:36:48.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.493+0000 7fe3f67fc700 1 -- 172.21.15.149:0/3701160206 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000c7f0 con 0x7fe4000ce480 2023-06-09T04:36:48.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.493+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4000c3750 con 0x7fe4000ce480 2023-06-09T04:36:48.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.493+0000 7fe3f67fc700 1 -- 172.21.15.149:0/3701160206 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000cb60 con 0x7fe4000ce480 2023-06-09T04:36:48.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.493+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe400155410 con 0x7fe4000ce480 2023-06-09T04:36:48.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.494+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe400073fa0 con 0x7fe4000ce480 2023-06-09T04:36:48.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.494+0000 7fe3f67fc700 1 -- 172.21.15.149:0/3701160206 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fe3f000ccc0 con 0x7fe4000ce480 2023-06-09T04:36:48.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.495+0000 7fe3f67fc700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe3e406ac50 0x7fe3e406d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.495+0000 7fe3f67fc700 1 -- 172.21.15.149:0/3701160206 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe3f0088f90 con 0x7fe4000ce480 2023-06-09T04:36:48.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.495+0000 7fe405c77700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe3e406ac50 0x7fe3e406d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.495+0000 7fe405c77700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe3e406ac50 0x7fe3e406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0090b0 tx=0x7fe3fc01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.500+0000 7fe3f67fc700 1 -- 172.21.15.149:0/3701160206 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3f0054470 con 0x7fe4000ce480 2023-06-09T04:36:48.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.693+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4000b4db0 con 0x7fe4000ce480 2023-06-09T04:36:48.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.694+0000 7fe3f67fc700 1 -- 172.21.15.149:0/3701160206 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3f00170a0 con 0x7fe4000ce480 2023-06-09T04:36:48.696 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:36:48.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe3e406ac50 msgr2=0x7fe3e406d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe3e406ac50 0x7fe3e406d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0090b0 tx=0x7fe3fc01c040 comp rx=0 tx=0).stop 2023-06-09T04:36:48.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4000ce480 msgr2=0x7fe4000c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4000ce480 0x7fe4000c3f50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000e9b0 tx=0x7fe3f000ecc0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 shutdown_connections 2023-06-09T04:36:48.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe3e406ac50 0x7fe3e406d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe40006c7f0 0x7fe400155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe40015c200 0x7fe400154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 --2- 172.21.15.149:0/3701160206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4000ce480 0x7fe4000c3f50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 >> 172.21.15.149:0/3701160206 conn(0x7fe4000cee30 msgr2=0x7fe400070800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:48.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.696+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 shutdown_connections 2023-06-09T04:36:48.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.697+0000 7fe407edb700 1 -- 172.21.15.149:0/3701160206 wait complete. 2023-06-09T04:36:48.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:36:48.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.831+0000 7f0a0f525700 1 Processor -- start 2023-06-09T04:36:48.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.831+0000 7f0a0f525700 1 -- start start 2023-06-09T04:36:48.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0f525700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0a0815c1f0 0x7f0a080cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0f525700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a0806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0f525700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0a0806b300 0x7f0a0806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0f525700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0815c5c0 con 0x7f0a0806b300 2023-06-09T04:36:48.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0f525700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a080ceca0 con 0x7f0a0815c1f0 2023-06-09T04:36:48.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0f525700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080ce9c0 con 0x7f0a080ce500 2023-06-09T04:36:48.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0a0806b300 0x7f0a0806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0a0806b300 0x7f0a0806e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35794/0 (socket says 172.21.15.149:35794) 2023-06-09T04:36:48.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1533411873 learned_addr learned my addr 172.21.15.149:0/1533411873 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:48.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0d2c1700 1 --2- 172.21.15.149:0/1533411873 >> v2:172.21.15.184:3300/0 conn(0x7f0a0815c1f0 0x7f0a080cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0cac0700 1 --2- 172.21.15.149:0/1533411873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a0806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1533411873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 msgr2=0x7f0a0806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:48.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 --2- 172.21.15.149:0/1533411873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a0806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1533411873 >> v2:172.21.15.184:3300/0 conn(0x7f0a0815c1f0 msgr2=0x7f0a080cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:48.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 --2- 172.21.15.149:0/1533411873 >> v2:172.21.15.184:3300/0 conn(0x7f0a0815c1f0 0x7f0a080cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1533411873 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a08069e50 con 0x7f0a0806b300 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.832+0000 7f0a0dac2700 1 --2- 172.21.15.149:0/1533411873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0806b300 0x7f0a0806e2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a0806b930 tx=0x7f0a0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a141f2c25c4c24ad server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f09fffff700 1 -- 172.21.15.149:0/1533411873 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000e070 con 0x7f0a0806b300 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f09fffff700 1 -- 172.21.15.149:0/1533411873 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000b910 con 0x7f0a0806b300 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f09fffff700 1 -- 172.21.15.149:0/1533411873 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000bcc0 con 0x7f0a0806b300 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 -- 172.21.15.149:0/1533411873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0806b300 msgr2=0x7f0a0806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1533411873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0806b300 0x7f0a0806e2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0a0806b930 tx=0x7f0a0000b330 comp rx=0 tx=0).stop 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 -- 172.21.15.149:0/1533411873 shutdown_connections 2023-06-09T04:36:48.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1533411873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0806b300 0x7f0a0806e2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1533411873 >> v2:172.21.15.184:3300/0 conn(0x7f0a0815c1f0 0x7f0a080cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1533411873 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a0806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 -- 172.21.15.149:0/1533411873 >> 172.21.15.149:0/1533411873 conn(0x7f0a080ceed0 msgr2=0x7f0a080cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:48.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 -- 172.21.15.149:0/1533411873 shutdown_connections 2023-06-09T04:36:48.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.833+0000 7f0a0f525700 1 -- 172.21.15.149:0/1533411873 wait complete. 2023-06-09T04:36:48.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.834+0000 7f0a0f525700 1 Processor -- start 2023-06-09T04:36:48.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.834+0000 7f0a0f525700 1 -- start start 2023-06-09T04:36:48.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0f525700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a0806b300 0x7f0a0814d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0f525700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a080c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0f525700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0815c1f0 0x7f0a081f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0f525700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081f1c50 con 0x7f0a0815c1f0 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0f525700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0814d6f0 con 0x7f0a0806b300 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0f525700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a080c3fc0 con 0x7f0a080ce500 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0815c1f0 0x7f0a081f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0815c1f0 0x7f0a081f20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35800/0 (socket says 172.21.15.149:35800) 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1669410550 learned_addr learned my addr 172.21.15.149:0/1669410550 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:48.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0d2c1700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a0806b300 0x7f0a0814d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0cac0700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a080c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 msgr2=0x7f0a080c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a080c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a0806b300 msgr2=0x7f0a0814d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a0806b300 0x7f0a0814d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0dac2700 1 -- 172.21.15.149:0/1669410550 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00009b30 con 0x7f0a0815c1f0 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.835+0000 7f0a0d2c1700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a0806b300 0x7f0a0814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:48.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.836+0000 7f0a0dac2700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0815c1f0 0x7f0a081f20e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a0809d100 tx=0x7f0a00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.836+0000 7f09fdffb700 1 -- 172.21.15.149:0/1669410550 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000099b0 con 0x7f0a0815c1f0 2023-06-09T04:36:48.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.836+0000 7f09fdffb700 1 -- 172.21.15.149:0/1669410550 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000ce80 con 0x7f0a0815c1f0 2023-06-09T04:36:48.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.836+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a080c42a0 con 0x7f0a0815c1f0 2023-06-09T04:36:48.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.836+0000 7f09fdffb700 1 -- 172.21.15.149:0/1669410550 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00004490 con 0x7f0a0815c1f0 2023-06-09T04:36:48.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.836+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a080c4860 con 0x7f0a0815c1f0 2023-06-09T04:36:48.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.837+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a081f1e00 con 0x7f0a0815c1f0 2023-06-09T04:36:48.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.837+0000 7f09fdffb700 1 -- 172.21.15.149:0/1669410550 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f0a000045f0 con 0x7f0a0815c1f0 2023-06-09T04:36:48.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.838+0000 7f09fdffb700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f09ec06ac50 0x7f09ec06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:48.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.838+0000 7f09fdffb700 1 -- 172.21.15.149:0/1669410550 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0a0008a270 con 0x7f0a0815c1f0 2023-06-09T04:36:48.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.838+0000 7f0a0d2c1700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f09ec06ac50 0x7f09ec06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:48.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.838+0000 7f0a0d2c1700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f09ec06ac50 0x7f09ec06d100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009f30 tx=0x7f0a04009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:48.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:48.842+0000 7f09fdffb700 1 -- 172.21.15.149:0/1669410550 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a000557e0 con 0x7f0a0815c1f0 2023-06-09T04:36:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.071+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a08073fa0 con 0x7f0a0815c1f0 2023-06-09T04:36:49.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.071+0000 7f09fdffb700 1 -- 172.21.15.149:0/1669410550 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7f0a00020de0 con 0x7f0a0815c1f0 2023-06-09T04:36:49.073 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:49.073 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-09T04:36:49.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f09ec06ac50 msgr2=0x7f09ec06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f09ec06ac50 0x7f09ec06d100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009f30 tx=0x7f0a04009210 comp rx=0 tx=0).stop 2023-06-09T04:36:49.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0815c1f0 msgr2=0x7f0a081f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0815c1f0 0x7f0a081f20e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a0809d100 tx=0x7f0a00004ad0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 shutdown_connections 2023-06-09T04:36:49.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f09ec06ac50 0x7f09ec06d100 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0a0815c1f0 0x7f0a081f20e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a0806b300 0x7f0a0814d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 --2- 172.21.15.149:0/1669410550 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0a080ce500 0x7f0a080c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 >> 172.21.15.149:0/1669410550 conn(0x7f0a080ceed0 msgr2=0x7f0a080afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:49.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 shutdown_connections 2023-06-09T04:36:49.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.073+0000 7f0a0f525700 1 -- 172.21.15.149:0/1669410550 wait complete. 2023-06-09T04:36:49.077 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 3 2023-06-09T04:36:49.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:49.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.206+0000 7f284bc29700 1 Processor -- start 2023-06-09T04:36:49.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.206+0000 7f284bc29700 1 -- start start 2023-06-09T04:36:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.207+0000 7f284bc29700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f28440ceab0 0x7f28440cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.207+0000 7f284bc29700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28440cd770 con 0x7f2844157d30 2023-06-09T04:36:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.207+0000 7f284bc29700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844158100 con 0x7f284415a6a0 2023-06-09T04:36:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.207+0000 7f284bc29700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284415b2d0 con 0x7f28440ceab0 2023-06-09T04:36:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.207+0000 7f28491c4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f28440ceab0 0x7f28440cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.207+0000 7f28499c5700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2844157d30 0x7f28440ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59668/0 (socket says 172.21.15.149:59668) 2023-06-09T04:36:49.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.207+0000 7f28499c5700 1 -- 172.21.15.149:0/609974441 learned_addr learned my addr 172.21.15.149:0/609974441 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:49.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.208+0000 7f28491c4700 1 -- 172.21.15.149:0/609974441 >> v1:172.21.15.184:6789/0 conn(0x7f284415a6a0 legacy=0x7f284415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.208+0000 7f28491c4700 1 -- 172.21.15.149:0/609974441 >> v1:172.21.15.149:6789/0 conn(0x7f2844157d30 legacy=0x7f28440ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.208+0000 7f28491c4700 1 -- 172.21.15.149:0/609974441 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284415b5b0 con 0x7f28440ceab0 2023-06-09T04:36:49.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.208+0000 7f28491c4700 1 --2- 172.21.15.149:0/609974441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28440ceab0 0x7f28440cdc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2838009840 tx=0x7f2838009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18adfc342a82a42 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.212+0000 7f28489c3700 1 -- 172.21.15.149:0/609974441 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011830 con 0x7f28440ceab0 2023-06-09T04:36:49.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f28489c3700 1 -- 172.21.15.149:0/609974441 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838011990 con 0x7f28440ceab0 2023-06-09T04:36:49.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f28489c3700 1 -- 172.21.15.149:0/609974441 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838011d20 con 0x7f28440ceab0 2023-06-09T04:36:49.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f284bc29700 1 -- 172.21.15.149:0/609974441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28440ceab0 msgr2=0x7f28440cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f284bc29700 1 --2- 172.21.15.149:0/609974441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28440ceab0 0x7f28440cdc00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2838009840 tx=0x7f2838009b50 comp rx=0 tx=0).stop 2023-06-09T04:36:49.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f284bc29700 1 -- 172.21.15.149:0/609974441 shutdown_connections 2023-06-09T04:36:49.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f284bc29700 1 --2- 172.21.15.149:0/609974441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28440ceab0 0x7f28440cdc00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f284bc29700 1 -- 172.21.15.149:0/609974441 >> 172.21.15.149:0/609974441 conn(0x7f284406a6d0 msgr2=0x7f2844099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:49.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f284bc29700 1 -- 172.21.15.149:0/609974441 shutdown_connections 2023-06-09T04:36:49.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.213+0000 7f284bc29700 1 -- 172.21.15.149:0/609974441 wait complete. 2023-06-09T04:36:49.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.215+0000 7f284bc29700 1 Processor -- start 2023-06-09T04:36:49.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.215+0000 7f284bc29700 1 -- start start 2023-06-09T04:36:49.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284bc29700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28440ceab0 0x7f2844148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284bc29700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844157d30 0x7f284415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284bc29700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f284415a6a0 0x7f284415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284bc29700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28441491a0 con 0x7f284415a6a0 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284bc29700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28440b5410 con 0x7f28440ceab0 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284bc29700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28440b56f0 con 0x7f2844157d30 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284a1c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f284415a6a0 0x7f284415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284a1c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f284415a6a0 0x7f284415bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35814/0 (socket says 172.21.15.149:35814) 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f284a1c6700 1 -- 172.21.15.149:0/3245555696 learned_addr learned my addr 172.21.15.149:0/3245555696 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f28499c5700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28440ceab0 0x7f2844148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.216+0000 7f28491c4700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844157d30 0x7f284415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284a1c6700 1 -- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844157d30 msgr2=0x7f284415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284a1c6700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844157d30 0x7f284415b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284a1c6700 1 -- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28440ceab0 msgr2=0x7f2844148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284a1c6700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28440ceab0 0x7f2844148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284a1c6700 1 -- 172.21.15.149:0/3245555696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380094a0 con 0x7f284415a6a0 2023-06-09T04:36:49.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284a1c6700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f284415a6a0 0x7f284415bd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c3c0 tx=0x7f283c00c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f28427fc700 1 -- 172.21.15.149:0/3245555696 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0052d0 con 0x7f284415a6a0 2023-06-09T04:36:49.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f28427fc700 1 -- 172.21.15.149:0/3245555696 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c005430 con 0x7f284415a6a0 2023-06-09T04:36:49.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28440b59d0 con 0x7f284415a6a0 2023-06-09T04:36:49.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f28427fc700 1 -- 172.21.15.149:0/3245555696 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0038a0 con 0x7f284415a6a0 2023-06-09T04:36:49.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.217+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28440b5f90 con 0x7f284415a6a0 2023-06-09T04:36:49.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.218+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28440b0240 con 0x7f284415a6a0 2023-06-09T04:36:49.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.218+0000 7f28427fc700 1 -- 172.21.15.149:0/3245555696 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f283c003a00 con 0x7f284415a6a0 2023-06-09T04:36:49.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.219+0000 7f28427fc700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f283006ace0 0x7f283006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.219+0000 7f28499c5700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f283006ace0 0x7f283006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.219+0000 7f28427fc700 1 -- 172.21.15.149:0/3245555696 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f283c088320 con 0x7f284415a6a0 2023-06-09T04:36:49.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.219+0000 7f28499c5700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f283006ace0 0x7f283006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2834001460 tx=0x7f2834009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.223+0000 7f28427fc700 1 -- 172.21.15.149:0/3245555696 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28440b0240 con 0x7f284415a6a0 2023-06-09T04:36:49.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.410+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28440b0240 con 0x7f284415a6a0 2023-06-09T04:36:49.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.411+0000 7f28427fc700 1 -- 172.21.15.149:0/3245555696 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14591 (secure 0 0 0) 0x7f28440b0240 con 0x7f284415a6a0 2023-06-09T04:36:49.412 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:49.412 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":18,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:48.615584+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:49.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f283006ace0 msgr2=0x7f283006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f283006ace0 0x7f283006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2834001460 tx=0x7f2834009040 comp rx=0 tx=0).stop 2023-06-09T04:36:49.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f284415a6a0 msgr2=0x7f284415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f284415a6a0 0x7f284415bd30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f283c00c3c0 tx=0x7f283c00c6d0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 shutdown_connections 2023-06-09T04:36:49.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f283006ace0 0x7f283006d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f284415a6a0 0x7f284415bd30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28440ceab0 0x7f2844148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 --2- 172.21.15.149:0/3245555696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2844157d30 0x7f284415b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 >> 172.21.15.149:0/3245555696 conn(0x7f284406a6d0 msgr2=0x7f28440c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:49.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 shutdown_connections 2023-06-09T04:36:49.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.413+0000 7f284bc29700 1 -- 172.21.15.149:0/3245555696 wait complete. 2023-06-09T04:36:49.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:36:49.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:36:49.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.550+0000 7f2b8ce26700 1 Processor -- start 2023-06-09T04:36:49.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.550+0000 7f2b8ce26700 1 -- start start 2023-06-09T04:36:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.551+0000 7f2b8ce26700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b880cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.551+0000 7f2b8ce26700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2b8815e340 0x7f2b880cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.551+0000 7f2b8ce26700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b880cda20 con 0x7f2b880b60a0 2023-06-09T04:36:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.551+0000 7f2b8ce26700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880b6470 con 0x7f2b8815e340 2023-06-09T04:36:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.551+0000 7f2b8ce26700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8815e7c0 con 0x7f2b880cf5b0 2023-06-09T04:36:49.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8659c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2b880b60a0 0x7f2b8815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59682/0 (socket says 172.21.15.149:59682) 2023-06-09T04:36:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8659c700 1 -- 172.21.15.149:0/3996238607 learned_addr learned my addr 172.21.15.149:0/3996238607 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b86d9d700 1 --2- 172.21.15.149:0/3996238607 >> v2:172.21.15.184:3300/0 conn(0x7f2b8815e340 0x7f2b880cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b85d9b700 1 --2- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b880cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8559a700 1 -- 172.21.15.149:0/3996238607 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521879732 0 0) 0x7f2b880cda20 con 0x7f2b880b60a0 2023-06-09T04:36:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8559a700 1 -- 172.21.15.149:0/3996238607 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b700035b0 con 0x7f2b880b60a0 2023-06-09T04:36:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b86d9d700 1 -- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 msgr2=0x7f2b880cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:49.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8559a700 1 -- 172.21.15.149:0/3996238607 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503602693 0 0) 0x7f2b700035b0 con 0x7f2b880b60a0 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b86d9d700 1 --2- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b880cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b86d9d700 1 -- 172.21.15.149:0/3996238607 >> v1:172.21.15.149:6789/0 conn(0x7f2b880b60a0 legacy=0x7f2b8815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b86d9d700 1 -- 172.21.15.149:0/3996238607 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8815a520 con 0x7f2b8815e340 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b85d9b700 1 --2- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b880cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b86d9d700 1 --2- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8815e340 0x7f2b880cfb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009d90 tx=0x7f2b8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97df064206adfc67 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8559a700 1 -- 172.21.15.149:0/3996238607 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000e070 con 0x7f2b8815e340 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8559a700 1 -- 172.21.15.149:0/3996238607 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80003a20 con 0x7f2b8815e340 2023-06-09T04:36:49.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.552+0000 7f2b8559a700 1 -- 172.21.15.149:0/3996238607 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c001670 con 0x7f2b8815e340 2023-06-09T04:36:49.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 -- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8815e340 msgr2=0x7f2b880cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8815e340 0x7f2b880cfb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009d90 tx=0x7f2b8000b330 comp rx=0 tx=0).stop 2023-06-09T04:36:49.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 -- 172.21.15.149:0/3996238607 shutdown_connections 2023-06-09T04:36:49.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b8815e340 0x7f2b880cfb00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/3996238607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b880cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 -- 172.21.15.149:0/3996238607 >> 172.21.15.149:0/3996238607 conn(0x7f2b88069db0 msgr2=0x7f2b8806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:49.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 -- 172.21.15.149:0/3996238607 shutdown_connections 2023-06-09T04:36:49.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.553+0000 7f2b8ce26700 1 -- 172.21.15.149:0/3996238607 wait complete. 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.554+0000 7f2b8ce26700 1 Processor -- start 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.554+0000 7f2b8ce26700 1 -- start start 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b8ce26700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b880b60a0 0x7f2b880c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b8ce26700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b8806b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b8ce26700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8815e340 0x7f2b8815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b8ce26700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8806be10 con 0x7f2b8815e340 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b8ce26700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880c6ad0 con 0x7f2b880b60a0 2023-06-09T04:36:49.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b8ce26700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b880c5a50 con 0x7f2b880cf5b0 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b86d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8815e340 0x7f2b8815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b86d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8815e340 0x7f2b8815d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35828/0 (socket says 172.21.15.149:35828) 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b86d9d700 1 -- 172.21.15.149:0/2503156746 learned_addr learned my addr 172.21.15.149:0/2503156746 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b85d9b700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b8806b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.555+0000 7f2b8659c700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b880b60a0 0x7f2b880c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b86d9d700 1 -- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 msgr2=0x7f2b8806b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b86d9d700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b8806b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b86d9d700 1 -- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b880b60a0 msgr2=0x7f2b880c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b86d9d700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b880b60a0 0x7f2b880c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b86d9d700 1 -- 172.21.15.149:0/2503156746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b780094a0 con 0x7f2b8815e340 2023-06-09T04:36:49.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b86d9d700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8815e340 0x7f2b8815d000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b8806f750 tx=0x7f2b80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b76ffd700 1 -- 172.21.15.149:0/2503156746 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80004440 con 0x7f2b8815e340 2023-06-09T04:36:49.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b76ffd700 1 -- 172.21.15.149:0/2503156746 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b800045c0 con 0x7f2b8815e340 2023-06-09T04:36:49.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b80009a70 con 0x7f2b8815e340 2023-06-09T04:36:49.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b76ffd700 1 -- 172.21.15.149:0/2503156746 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80004970 con 0x7f2b8815e340 2023-06-09T04:36:49.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.556+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b880c6010 con 0x7f2b8815e340 2023-06-09T04:36:49.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.557+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b88073fa0 con 0x7f2b8815e340 2023-06-09T04:36:49.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.557+0000 7f2b76ffd700 1 -- 172.21.15.149:0/2503156746 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b80012430 con 0x7f2b8815e340 2023-06-09T04:36:49.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.558+0000 7f2b76ffd700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2b6806ace0 0x7f2b6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.558+0000 7f2b76ffd700 1 -- 172.21.15.149:0/2503156746 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2b8008b380 con 0x7f2b8815e340 2023-06-09T04:36:49.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.558+0000 7f2b8659c700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2b6806ace0 0x7f2b6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.558+0000 7f2b8659c700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2b6806ace0 0x7f2b6806d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000f60 tx=0x7f2b7c001e00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.562+0000 7f2b76ffd700 1 -- 172.21.15.149:0/2503156746 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2b80056810 con 0x7f2b8815e340 2023-06-09T04:36:49.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.751+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2b880b5b80 con 0x7f2b8815e340 2023-06-09T04:36:49.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.751+0000 7f2b76ffd700 1 -- 172.21.15.149:0/2503156746 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2b80059e30 con 0x7f2b8815e340 2023-06-09T04:36:49.752 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:36:49.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2b6806ace0 msgr2=0x7f2b6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2b6806ace0 0x7f2b6806d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000f60 tx=0x7f2b7c001e00 comp rx=0 tx=0).stop 2023-06-09T04:36:49.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8815e340 msgr2=0x7f2b8815d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8815e340 0x7f2b8815d000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b8806f750 tx=0x7f2b80004ad0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 shutdown_connections 2023-06-09T04:36:49.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2b6806ace0 0x7f2b6806d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b8815e340 0x7f2b8815d000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b880b60a0 0x7f2b880c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 --2- 172.21.15.149:0/2503156746 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2b880cf5b0 0x7f2b8806b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 >> 172.21.15.149:0/2503156746 conn(0x7f2b88069db0 msgr2=0x7f2b880ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:49.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 shutdown_connections 2023-06-09T04:36:49.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.753+0000 7f2b8ce26700 1 -- 172.21.15.149:0/2503156746 wait complete. 2023-06-09T04:36:49.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:36:49.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.888+0000 7f08db3c6700 1 Processor -- start 2023-06-09T04:36:49.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.888+0000 7f08db3c6700 1 -- start start 2023-06-09T04:36:49.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08db3c6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f08d415c520 0x7f08d4071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08db3c6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08db3c6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08d406a2f0 0x7f08d40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08db3c6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d40cd940 con 0x7f08d406a2f0 2023-06-09T04:36:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08db3c6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d406a770 con 0x7f08d415c520 2023-06-09T04:36:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08db3c6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40b20f0 con 0x7f08d40cee20 2023-06-09T04:36:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08d406a2f0 0x7f08d40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f08d406a2f0 0x7f08d40b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35836/0 (socket says 172.21.15.149:35836) 2023-06-09T04:36:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 -- 172.21.15.149:0/98507980 learned_addr learned my addr 172.21.15.149:0/98507980 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:49.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d8961700 1 --2- 172.21.15.149:0/98507980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9162700 1 --2- 172.21.15.149:0/98507980 >> v2:172.21.15.184:3300/0 conn(0x7f08d415c520 0x7f08d4071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 -- 172.21.15.149:0/98507980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 msgr2=0x7f08d4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 --2- 172.21.15.149:0/98507980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 -- 172.21.15.149:0/98507980 >> v2:172.21.15.184:3300/0 conn(0x7f08d415c520 msgr2=0x7f08d4071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 --2- 172.21.15.149:0/98507980 >> v2:172.21.15.184:3300/0 conn(0x7f08d415c520 0x7f08d4071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 -- 172.21.15.149:0/98507980 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d415c8f0 con 0x7f08d406a2f0 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9162700 1 --2- 172.21.15.149:0/98507980 >> v2:172.21.15.184:3300/0 conn(0x7f08d415c520 0x7f08d4071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:49.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08d9963700 1 --2- 172.21.15.149:0/98507980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40b24a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08d40cd1a0 tx=0x7f08cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d629a77b3c2ecd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08cbfff700 1 -- 172.21.15.149:0/98507980 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00e070 con 0x7f08d406a2f0 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08cbfff700 1 -- 172.21.15.149:0/98507980 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc00b8d0 con 0x7f08d406a2f0 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.889+0000 7f08cbfff700 1 -- 172.21.15.149:0/98507980 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc00bc80 con 0x7f08d406a2f0 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 -- 172.21.15.149:0/98507980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 msgr2=0x7f08d40b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 --2- 172.21.15.149:0/98507980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40b24a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08d40cd1a0 tx=0x7f08cc00b330 comp rx=0 tx=0).stop 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 -- 172.21.15.149:0/98507980 shutdown_connections 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 --2- 172.21.15.149:0/98507980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40b24a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 --2- 172.21.15.149:0/98507980 >> v2:172.21.15.184:3300/0 conn(0x7f08d415c520 0x7f08d4071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 --2- 172.21.15.149:0/98507980 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 -- 172.21.15.149:0/98507980 >> 172.21.15.149:0/98507980 conn(0x7f08d406aec0 msgr2=0x7f08d406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:49.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 -- 172.21.15.149:0/98507980 shutdown_connections 2023-06-09T04:36:49.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.890+0000 7f08db3c6700 1 -- 172.21.15.149:0/98507980 wait complete. 2023-06-09T04:36:49.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.892+0000 7f08db3c6700 1 Processor -- start 2023-06-09T04:36:49.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.892+0000 7f08db3c6700 1 -- start start 2023-06-09T04:36:49.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08db3c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08db3c6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08db3c6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08d415c520 0x7f08d40c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08db3c6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40c4880 con 0x7f08d406a2f0 2023-06-09T04:36:49.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08db3c6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40abf80 con 0x7f08d415c520 2023-06-09T04:36:49.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08db3c6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d40ac260 con 0x7f08d40cee20 2023-06-09T04:36:49.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35838/0 (socket says 172.21.15.149:35838) 2023-06-09T04:36:49.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 -- 172.21.15.149:0/2504468427 learned_addr learned my addr 172.21.15.149:0/2504468427 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9963700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08d415c520 0x7f08d40c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d8961700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 -- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 msgr2=0x7f08d4151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 -- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08d415c520 msgr2=0x7f08d40c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08d415c520 0x7f08d40c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 -- 172.21.15.149:0/2504468427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc009b30 con 0x7f08d406a2f0 2023-06-09T04:36:49.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9963700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08d415c520 0x7f08d40c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:49.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08d9162700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40ab8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08d000e810 tx=0x7f08d000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08c9ffb700 1 -- 172.21.15.149:0/2504468427 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0013610 con 0x7f08d406a2f0 2023-06-09T04:36:49.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08c9ffb700 1 -- 172.21.15.149:0/2504468427 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d0013770 con 0x7f08d406a2f0 2023-06-09T04:36:49.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d40ac540 con 0x7f08d406a2f0 2023-06-09T04:36:49.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.893+0000 7f08c9ffb700 1 -- 172.21.15.149:0/2504468427 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0013b20 con 0x7f08d406a2f0 2023-06-09T04:36:49.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.894+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d4152d60 con 0x7f08d406a2f0 2023-06-09T04:36:49.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.894+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d40b1ac0 con 0x7f08d406a2f0 2023-06-09T04:36:49.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.895+0000 7f08c9ffb700 1 -- 172.21.15.149:0/2504468427 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08d0013c80 con 0x7f08d406a2f0 2023-06-09T04:36:49.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.895+0000 7f08c9ffb700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f08b806ace0 0x7f08b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:49.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.895+0000 7f08c9ffb700 1 -- 172.21.15.149:0/2504468427 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f08d0088d80 con 0x7f08d406a2f0 2023-06-09T04:36:49.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.895+0000 7f08d8961700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f08b806ace0 0x7f08b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:49.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.896+0000 7f08d8961700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f08b806ace0 0x7f08b806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08d4071580 tx=0x7f08c4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:49.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:49.900+0000 7f08c9ffb700 1 -- 172.21.15.149:0/2504468427 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f08d0057c00 con 0x7f08d406a2f0 2023-06-09T04:36:50.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.086+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08d4073fa0 con 0x7f08d406a2f0 2023-06-09T04:36:50.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.087+0000 7f08c9ffb700 1 -- 172.21.15.149:0/2504468427 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08d00210a0 con 0x7f08d406a2f0 2023-06-09T04:36:50.088 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:36:50.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f08b806ace0 msgr2=0x7f08b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f08b806ace0 0x7f08b806d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08d4071580 tx=0x7f08c4008040 comp rx=0 tx=0).stop 2023-06-09T04:36:50.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 msgr2=0x7f08d40ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40ab8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08d000e810 tx=0x7f08d000ebd0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 shutdown_connections 2023-06-09T04:36:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f08b806ace0 0x7f08b806d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f08d415c520 0x7f08d40c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f08d406a2f0 0x7f08d40ab8f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 --2- 172.21.15.149:0/2504468427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f08d40cee20 0x7f08d4151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 >> 172.21.15.149:0/2504468427 conn(0x7f08d406aec0 msgr2=0x7f08d4158280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:50.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 shutdown_connections 2023-06-09T04:36:50.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.089+0000 7f08db3c6700 1 -- 172.21.15.149:0/2504468427 wait complete. 2023-06-09T04:36:50.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:36:50.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.221+0000 7f56f4470700 1 Processor -- start 2023-06-09T04:36:50.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.221+0000 7f56f4470700 1 -- start start 2023-06-09T04:36:50.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f4470700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f56ec06a4c0 0x7f56ec0af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f4470700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56ec0ccba0 0x7f56ec0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f4470700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ec0ccfa0 con 0x7f56ec15c590 2023-06-09T04:36:50.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f4470700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0afae0 con 0x7f56ec0ccba0 2023-06-09T04:36:50.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f4470700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ec0af050 con 0x7f56ec06a4c0 2023-06-09T04:36:50.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f2a0d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f56ec0ccba0 0x7f56ec0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f220c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f56ec15c590 0x7f56ec069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59710/0 (socket says 172.21.15.149:59710) 2023-06-09T04:36:50.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f220c700 1 -- 172.21.15.149:0/3693702426 learned_addr learned my addr 172.21.15.149:0/3693702426 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:50.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.222+0000 7f56f1a0b700 1 --2- 172.21.15.149:0/3693702426 >> v2:172.21.15.184:3300/0 conn(0x7f56ec06a4c0 0x7f56ec0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f2a0d700 1 -- 172.21.15.149:0/3693702426 >> v2:172.21.15.184:3300/0 conn(0x7f56ec06a4c0 msgr2=0x7f56ec0af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:50.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f2a0d700 1 --2- 172.21.15.149:0/3693702426 >> v2:172.21.15.184:3300/0 conn(0x7f56ec06a4c0 0x7f56ec0af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f2a0d700 1 -- 172.21.15.149:0/3693702426 >> v1:172.21.15.149:6789/0 conn(0x7f56ec15c590 legacy=0x7f56ec069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f2a0d700 1 -- 172.21.15.149:0/3693702426 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0af800 con 0x7f56ec0ccba0 2023-06-09T04:36:50.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f2a0d700 1 --2- 172.21.15.149:0/3693702426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0ccba0 0x7f56ec0b06d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0b21e0 tx=0x7f56e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43ab0fec18cbed6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:50.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f120a700 1 -- 172.21.15.149:0/3693702426 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400e070 con 0x7f56ec0ccba0 2023-06-09T04:36:50.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f120a700 1 -- 172.21.15.149:0/3693702426 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e400bbd0 con 0x7f56ec0ccba0 2023-06-09T04:36:50.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f120a700 1 -- 172.21.15.149:0/3693702426 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4012430 con 0x7f56ec0ccba0 2023-06-09T04:36:50.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f4470700 1 -- 172.21.15.149:0/3693702426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0ccba0 msgr2=0x7f56ec0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.223+0000 7f56f4470700 1 --2- 172.21.15.149:0/3693702426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0ccba0 0x7f56ec0b06d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f56ec0b21e0 tx=0x7f56e400b330 comp rx=0 tx=0).stop 2023-06-09T04:36:50.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.224+0000 7f56f4470700 1 -- 172.21.15.149:0/3693702426 shutdown_connections 2023-06-09T04:36:50.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.224+0000 7f56f4470700 1 --2- 172.21.15.149:0/3693702426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec0ccba0 0x7f56ec0b06d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.224+0000 7f56f4470700 1 --2- 172.21.15.149:0/3693702426 >> v2:172.21.15.184:3300/0 conn(0x7f56ec06a4c0 0x7f56ec0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.224+0000 7f56f4470700 1 -- 172.21.15.149:0/3693702426 >> 172.21.15.149:0/3693702426 conn(0x7f56ec06b7e0 msgr2=0x7f56ec0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:50.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.224+0000 7f56f4470700 1 -- 172.21.15.149:0/3693702426 shutdown_connections 2023-06-09T04:36:50.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.224+0000 7f56f4470700 1 -- 172.21.15.149:0/3693702426 wait complete. 2023-06-09T04:36:50.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.225+0000 7f56f4470700 1 Processor -- start 2023-06-09T04:36:50.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.225+0000 7f56f4470700 1 -- start start 2023-06-09T04:36:50.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.225+0000 7f56f4470700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec06a4c0 0x7f56ec155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.225+0000 7f56f4470700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56ec0ccba0 0x7f56ec0b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f4470700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56ec15c590 0x7f56ec15ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f4470700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec156370 con 0x7f56ec06a4c0 2023-06-09T04:36:50.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f4470700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0b2650 con 0x7f56ec15c590 2023-06-09T04:36:50.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f4470700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec0b2930 con 0x7f56ec0ccba0 2023-06-09T04:36:50.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec06a4c0 0x7f56ec155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec06a4c0 0x7f56ec155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35852/0 (socket says 172.21.15.149:35852) 2023-06-09T04:36:50.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 -- 172.21.15.149:0/3816945397 learned_addr learned my addr 172.21.15.149:0/3816945397 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:50.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 -- 172.21.15.149:0/3816945397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56ec0ccba0 msgr2=0x7f56ec0b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56ec0ccba0 0x7f56ec0b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 -- 172.21.15.149:0/3816945397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56ec15c590 msgr2=0x7f56ec15ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56ec15c590 0x7f56ec15ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 -- 172.21.15.149:0/3816945397 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4009a70 con 0x7f56ec06a4c0 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f220c700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec06a4c0 0x7f56ec155e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56e8007fd0 tx=0x7f56e800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56e2ffd700 1 -- 172.21.15.149:0/3816945397 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e80074e0 con 0x7f56ec06a4c0 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56e2ffd700 1 -- 172.21.15.149:0/3816945397 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8007640 con 0x7f56ec06a4c0 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56e2ffd700 1 -- 172.21.15.149:0/3816945397 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8005a50 con 0x7f56ec06a4c0 2023-06-09T04:36:50.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec0b2c10 con 0x7f56ec06a4c0 2023-06-09T04:36:50.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.226+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec0b31d0 con 0x7f56ec06a4c0 2023-06-09T04:36:50.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.227+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec073fa0 con 0x7f56ec06a4c0 2023-06-09T04:36:50.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.227+0000 7f56e2ffd700 1 -- 172.21.15.149:0/3816945397 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56e8005bb0 con 0x7f56ec06a4c0 2023-06-09T04:36:50.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.228+0000 7f56e2ffd700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f56d006ace0 0x7f56d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.228+0000 7f56e2ffd700 1 -- 172.21.15.149:0/3816945397 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f56e8088530 con 0x7f56ec06a4c0 2023-06-09T04:36:50.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.228+0000 7f56f1a0b700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f56d006ace0 0x7f56d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.228+0000 7f56f1a0b700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f56d006ace0 0x7f56d006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56ec1ef740 tx=0x7f56dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:50.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.232+0000 7f56e2ffd700 1 -- 172.21.15.149:0/3816945397 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56e8053a80 con 0x7f56ec06a4c0 2023-06-09T04:36:50.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.422+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f56ec071dc0 con 0x7f56ec06a4c0 2023-06-09T04:36:50.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.422+0000 7f56e2ffd700 1 -- 172.21.15.149:0/3816945397 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+126 (secure 0 0 0) 0x7f56e8017090 con 0x7f56ec06a4c0 2023-06-09T04:36:50.424 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:50.424 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-06-09T04:36:50.424 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:36:50.424 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-06-09T04:36:50.424 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "rbd" 2023-06-09T04:36:50.424 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:36:50.425 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:36:50.425 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 2, 2023-06-09T04:36:50.425 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-06-09T04:36:50.425 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:36:50.425 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-06-09T04:36:50.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f56d006ace0 msgr2=0x7f56d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f56d006ace0 0x7f56d006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56ec1ef740 tx=0x7f56dc008040 comp rx=0 tx=0).stop 2023-06-09T04:36:50.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec06a4c0 msgr2=0x7f56ec155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec06a4c0 0x7f56ec155e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56e8007fd0 tx=0x7f56e800c790 comp rx=0 tx=0).stop 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 shutdown_connections 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f56d006ace0 0x7f56d006d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56ec15c590 0x7f56ec15ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56ec06a4c0 0x7f56ec155e30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 --2- 172.21.15.149:0/3816945397 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56ec0ccba0 0x7f56ec0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 >> 172.21.15.149:0/3816945397 conn(0x7f56ec06b7e0 msgr2=0x7f56ec069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 shutdown_connections 2023-06-09T04:36:50.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.425+0000 7f56f4470700 1 -- 172.21.15.149:0/3816945397 wait complete. 2023-06-09T04:36:50.438 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:36:50.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:36:50.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.561+0000 7fd42ece2700 1 Processor -- start 2023-06-09T04:36:50.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.561+0000 7fd42ece2700 1 -- start start 2023-06-09T04:36:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ece2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd42815f7c0 0x7fd4281607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ece2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4280ccad0 0x7fd4280709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ece2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4280ce580 con 0x7fd428070f30 2023-06-09T04:36:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ece2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4280cdde0 con 0x7fd42815f7c0 2023-06-09T04:36:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ece2700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42815fb90 con 0x7fd4280ccad0 2023-06-09T04:36:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ca7e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd42815f7c0 0x7fd4281607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42d27f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd428070f30 0x7fd42806ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59728/0 (socket says 172.21.15.149:59728) 2023-06-09T04:36:50.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42d27f700 1 -- 172.21.15.149:0/3993480142 learned_addr learned my addr 172.21.15.149:0/3993480142 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:50.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd427fff700 1 --2- 172.21.15.149:0/3993480142 >> v2:172.21.15.184:3300/0 conn(0x7fd4280ccad0 0x7fd4280709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ca7e700 1 -- 172.21.15.149:0/3993480142 >> v2:172.21.15.184:3300/0 conn(0x7fd4280ccad0 msgr2=0x7fd4280709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:50.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ca7e700 1 --2- 172.21.15.149:0/3993480142 >> v2:172.21.15.184:3300/0 conn(0x7fd4280ccad0 0x7fd4280709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ca7e700 1 -- 172.21.15.149:0/3993480142 >> v1:172.21.15.149:6789/0 conn(0x7fd428070f30 legacy=0x7fd42806ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd42ca7e700 1 -- 172.21.15.149:0/3993480142 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428071370 con 0x7fd42815f7c0 2023-06-09T04:36:50.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.562+0000 7fd4277fe700 1 -- 172.21.15.149:0/3993480142 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521660174 0 0) 0x7fd4280ce580 con 0x7fd428070f30 2023-06-09T04:36:50.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ca7e700 1 --2- 172.21.15.149:0/3993480142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd42815f7c0 0x7fd4281607b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b1b70 tx=0x7fd41c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f587625740911cc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:50.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd4277fe700 1 -- 172.21.15.149:0/3993480142 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c011830 con 0x7fd42815f7c0 2023-06-09T04:36:50.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd4277fe700 1 -- 172.21.15.149:0/3993480142 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c011990 con 0x7fd42815f7c0 2023-06-09T04:36:50.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd4277fe700 1 -- 172.21.15.149:0/3993480142 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c011d20 con 0x7fd42815f7c0 2023-06-09T04:36:50.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 -- 172.21.15.149:0/3993480142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd42815f7c0 msgr2=0x7fd4281607b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 --2- 172.21.15.149:0/3993480142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd42815f7c0 0x7fd4281607b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4280b1b70 tx=0x7fd41c009b20 comp rx=0 tx=0).stop 2023-06-09T04:36:50.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 -- 172.21.15.149:0/3993480142 shutdown_connections 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 --2- 172.21.15.149:0/3993480142 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd42815f7c0 0x7fd4281607b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 --2- 172.21.15.149:0/3993480142 >> v2:172.21.15.184:3300/0 conn(0x7fd4280ccad0 0x7fd4280709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 -- 172.21.15.149:0/3993480142 >> 172.21.15.149:0/3993480142 conn(0x7fd4280b1740 msgr2=0x7fd4280cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 -- 172.21.15.149:0/3993480142 shutdown_connections 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.563+0000 7fd42ece2700 1 -- 172.21.15.149:0/3993480142 wait complete. 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.564+0000 7fd42ece2700 1 Processor -- start 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.564+0000 7fd42ece2700 1 -- start start 2023-06-09T04:36:50.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ece2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd428070f30 0x7fd4280addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ece2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4280ccad0 0x7fd428150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ece2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd42815f7c0 0x7fd4280ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ece2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd428150960 con 0x7fd428070f30 2023-06-09T04:36:50.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ece2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280acd10 con 0x7fd42815f7c0 2023-06-09T04:36:50.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ece2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280acff0 con 0x7fd4280ccad0 2023-06-09T04:36:50.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ca7e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd428070f30 0x7fd4280addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ca7e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd428070f30 0x7fd4280addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35866/0 (socket says 172.21.15.149:35866) 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.565+0000 7fd42ca7e700 1 -- 172.21.15.149:0/2761002320 learned_addr learned my addr 172.21.15.149:0/2761002320 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42d27f700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd42815f7c0 0x7fd4280ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd427fff700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4280ccad0 0x7fd428150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ca7e700 1 -- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4280ccad0 msgr2=0x7fd428150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ca7e700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4280ccad0 0x7fd428150420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ca7e700 1 -- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd42815f7c0 msgr2=0x7fd4280ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ca7e700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd42815f7c0 0x7fd4280ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:50.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ca7e700 1 -- 172.21.15.149:0/2761002320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0094a0 con 0x7fd428070f30 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42d27f700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd42815f7c0 0x7fd4280ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ca7e700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd428070f30 0x7fd4280addb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd41c000c00 tx=0x7fd41c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd4257fa700 1 -- 172.21.15.149:0/2761002320 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0036a0 con 0x7fd428070f30 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd4257fa700 1 -- 172.21.15.149:0/2761002320 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c01e070 con 0x7fd428070f30 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd4257fa700 1 -- 172.21.15.149:0/2761002320 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c003a60 con 0x7fd428070f30 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4280ad2d0 con 0x7fd428070f30 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.566+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4280ad890 con 0x7fd428070f30 2023-06-09T04:36:50.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.567+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42804e090 con 0x7fd428070f30 2023-06-09T04:36:50.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.567+0000 7fd4257fa700 1 -- 172.21.15.149:0/2761002320 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd41c003bc0 con 0x7fd428070f30 2023-06-09T04:36:50.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.568+0000 7fd4257fa700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd40c06ace0 0x7fd40c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:50.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.568+0000 7fd4257fa700 1 -- 172.21.15.149:0/2761002320 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd41c08a0b0 con 0x7fd428070f30 2023-06-09T04:36:50.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.568+0000 7fd427fff700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd40c06ace0 0x7fd40c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:50.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.568+0000 7fd427fff700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd40c06ace0 0x7fd40c06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd414009a90 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:50.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.572+0000 7fd4257fa700 1 -- 172.21.15.149:0/2761002320 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd41c055540 con 0x7fd428070f30 2023-06-09T04:36:50.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:50.762+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd428071740 con 0x7fd428070f30 2023-06-09T04:36:51.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.664+0000 7fd4257fa700 1 -- 172.21.15.149:0/2761002320 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd41c058b60 con 0x7fd428070f30 2023-06-09T04:36:51.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd40c06ace0 msgr2=0x7fd40c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:51.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd40c06ace0 0x7fd40c06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd414009a90 tx=0x7fd414008040 comp rx=0 tx=0).stop 2023-06-09T04:36:51.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd428070f30 msgr2=0x7fd4280addb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:51.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd428070f30 0x7fd4280addb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd41c000c00 tx=0x7fd41c004750 comp rx=0 tx=0).stop 2023-06-09T04:36:51.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 shutdown_connections 2023-06-09T04:36:51.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd40c06ace0 0x7fd40c06d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd42815f7c0 0x7fd4280ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd428070f30 0x7fd4280addb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 --2- 172.21.15.149:0/2761002320 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4280ccad0 0x7fd428150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 >> 172.21.15.149:0/2761002320 conn(0x7fd4280b1740 msgr2=0x7fd4280c4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:51.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 shutdown_connections 2023-06-09T04:36:51.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.668+0000 7fd42ece2700 1 -- 172.21.15.149:0/2761002320 wait complete. 2023-06-09T04:36:51.671 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-06-09T04:36:51.684 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-09T04:36:51.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.812+0000 7fb73e6ec700 1 Processor -- start 2023-06-09T04:36:51.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.812+0000 7fb73e6ec700 1 -- start start 2023-06-09T04:36:51.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73e6ec700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb7381588a0 0x7fb73806b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:51.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73e6ec700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb738071010 0x7fb73815c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:51.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73e6ec700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7380cb5f0 con 0x7fb73806c2b0 2023-06-09T04:36:51.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73e6ec700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7380caec0 con 0x7fb738071010 2023-06-09T04:36:51.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73e6ec700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73806dbd0 con 0x7fb7381588a0 2023-06-09T04:36:51.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73cc89700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb738071010 0x7fb73815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:51.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73cc89700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb738071010 0x7fb73815c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35878/0 (socket says 172.21.15.149:35878) 2023-06-09T04:36:51.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb73cc89700 1 -- 172.21.15.149:0/2079684294 learned_addr learned my addr 172.21.15.149:0/2079684294 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:51.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.813+0000 7fb737fff700 1 --2- 172.21.15.149:0/2079684294 >> v2:172.21.15.184:3300/0 conn(0x7fb7381588a0 0x7fb73806b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:51.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73cc89700 1 -- 172.21.15.149:0/2079684294 >> v2:172.21.15.184:3300/0 conn(0x7fb7381588a0 msgr2=0x7fb73806b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:51.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73cc89700 1 --2- 172.21.15.149:0/2079684294 >> v2:172.21.15.184:3300/0 conn(0x7fb7381588a0 0x7fb73806b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73cc89700 1 -- 172.21.15.149:0/2079684294 >> v1:172.21.15.184:6789/0 conn(0x7fb73806c2b0 legacy=0x7fb738070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:51.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73cc89700 1 -- 172.21.15.149:0/2079684294 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73806deb0 con 0x7fb738071010 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb737fff700 1 --2- 172.21.15.149:0/2079684294 >> v2:172.21.15.184:3300/0 conn(0x7fb7381588a0 0x7fb73806b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73cc89700 1 --2- 172.21.15.149:0/2079684294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb73815c820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7380cff30 tx=0x7fb73000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb795874e95ad206 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb736ffd700 1 -- 172.21.15.149:0/2079684294 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000e070 con 0x7fb738071010 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb736ffd700 1 -- 172.21.15.149:0/2079684294 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73000b9c0 con 0x7fb738071010 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb736ffd700 1 -- 172.21.15.149:0/2079684294 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73000bd70 con 0x7fb738071010 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2079684294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 msgr2=0x7fb73815c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2079684294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb73815c820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb7380cff30 tx=0x7fb73000b330 comp rx=0 tx=0).stop 2023-06-09T04:36:51.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2079684294 shutdown_connections 2023-06-09T04:36:51.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2079684294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb73815c820 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2079684294 >> v2:172.21.15.184:3300/0 conn(0x7fb7381588a0 0x7fb73806b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.814+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2079684294 >> 172.21.15.149:0/2079684294 conn(0x7fb7380cee30 msgr2=0x7fb7380cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:51.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.815+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2079684294 shutdown_connections 2023-06-09T04:36:51.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.815+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2079684294 wait complete. 2023-06-09T04:36:51.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.816+0000 7fb73e6ec700 1 Processor -- start 2023-06-09T04:36:51.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.816+0000 7fb73e6ec700 1 -- start start 2023-06-09T04:36:51.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73806c2b0 0x7fb73814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:51.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb7381550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:51.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7381588a0 0x7fb738155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:51.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738152540 con 0x7fb738071010 2023-06-09T04:36:51.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73814e2d0 con 0x7fb7381588a0 2023-06-09T04:36:51.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73814d9a0 con 0x7fb73806c2b0 2023-06-09T04:36:51.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb7381550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:51.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb7381550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35882/0 (socket says 172.21.15.149:35882) 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 -- 172.21.15.149:0/2455471301 learned_addr learned my addr 172.21.15.149:0/2455471301 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb737fff700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73806c2b0 0x7fb73814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73cc89700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7381588a0 0x7fb738155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 -- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73806c2b0 msgr2=0x7fb73814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73806c2b0 0x7fb73814d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 -- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7381588a0 msgr2=0x7fb738155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7381588a0 0x7fb738155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:51.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 -- 172.21.15.149:0/2455471301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb730009b30 con 0x7fb738071010 2023-06-09T04:36:51.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb737fff700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73806c2b0 0x7fb73814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:51.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73cc89700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7381588a0 0x7fb738155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:51.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb7377fe700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb7381550e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c4e0 tx=0x7fb72800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:51.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb734ff9700 1 -- 172.21.15.149:0/2455471301 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280052d0 con 0x7fb738071010 2023-06-09T04:36:51.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb734ff9700 1 -- 172.21.15.149:0/2455471301 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb728005430 con 0x7fb738071010 2023-06-09T04:36:51.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb734ff9700 1 -- 172.21.15.149:0/2455471301 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280038c0 con 0x7fb738071010 2023-06-09T04:36:51.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73814dc80 con 0x7fb738071010 2023-06-09T04:36:51.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.817+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb738152160 con 0x7fb738071010 2023-06-09T04:36:51.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.818+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb738073fa0 con 0x7fb738071010 2023-06-09T04:36:51.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.819+0000 7fb734ff9700 1 -- 172.21.15.149:0/2455471301 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb728003a20 con 0x7fb738071010 2023-06-09T04:36:51.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.819+0000 7fb734ff9700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb72406ace0 0x7fb72406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:51.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.819+0000 7fb734ff9700 1 -- 172.21.15.149:0/2455471301 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb7280886f0 con 0x7fb738071010 2023-06-09T04:36:51.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.819+0000 7fb737fff700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb72406ace0 0x7fb72406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:51.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.820+0000 7fb737fff700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb72406ace0 0x7fb72406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c960 tx=0x7fb72c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:51.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:51.824+0000 7fb734ff9700 1 -- 172.21.15.149:0/2455471301 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb728053a10 con 0x7fb738071010 2023-06-09T04:36:52.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.011+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fb7381522f0 con 0x7fb738071010 2023-06-09T04:36:52.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.670+0000 7fb734ff9700 1 -- 172.21.15.149:0/2455471301 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7fb728057030 con 0x7fb738071010 2023-06-09T04:36:52.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb72406ace0 msgr2=0x7fb72406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:52.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb72406ace0 0x7fb72406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c960 tx=0x7fb72c008040 comp rx=0 tx=0).stop 2023-06-09T04:36:52.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 msgr2=0x7fb7381550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:52.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb7381550e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c4e0 tx=0x7fb72800c8a0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 shutdown_connections 2023-06-09T04:36:52.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb72406ace0 0x7fb72406d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb73806c2b0 0x7fb73814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7381588a0 0x7fb738155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 --2- 172.21.15.149:0/2455471301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb738071010 0x7fb7381550e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 >> 172.21.15.149:0/2455471301 conn(0x7fb7380cee30 msgr2=0x7fb7380ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:52.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 shutdown_connections 2023-06-09T04:36:52.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.674+0000 7fb73e6ec700 1 -- 172.21.15.149:0/2455471301 wait complete. 2023-06-09T04:36:52.678 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-06-09T04:36:52.698 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:36:52.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.821+0000 7fc76c23d700 1 Processor -- start 2023-06-09T04:36:52.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.821+0000 7fc76c23d700 1 -- start start 2023-06-09T04:36:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc76c23d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc764069db0 0x7fc7640ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc76c23d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76406a200 0x7fc7640ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc76c23d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc764071010 con 0x7fc76415c090 2023-06-09T04:36:52.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc76c23d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7640712c0 con 0x7fc764069db0 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc76c23d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7640715a0 con 0x7fc76406a200 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc7697d8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc764069db0 0x7fc7640ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc7697d8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc764069db0 0x7fc7640ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35890/0 (socket says 172.21.15.149:35890) 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc7697d8700 1 -- 172.21.15.149:0/1768054606 learned_addr learned my addr 172.21.15.149:0/1768054606 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc76a7da700 1 --2- 172.21.15.149:0/1768054606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76406a200 0x7fc7640ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc7697d8700 1 -- 172.21.15.149:0/1768054606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76406a200 msgr2=0x7fc7640ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc7697d8700 1 --2- 172.21.15.149:0/1768054606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76406a200 0x7fc7640ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc7697d8700 1 -- 172.21.15.149:0/1768054606 >> v1:172.21.15.184:6789/0 conn(0x7fc76415c090 legacy=0x7fc764070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.822+0000 7fc7697d8700 1 -- 172.21.15.149:0/1768054606 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764071880 con 0x7fc764069db0 2023-06-09T04:36:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.823+0000 7fc7697d8700 1 --2- 172.21.15.149:0/1768054606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc7640ce2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7600098f0 tx=0x7fc760009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ccf33025b18870 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.823+0000 7fc768fd7700 1 -- 172.21.15.149:0/1768054606 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011830 con 0x7fc764069db0 2023-06-09T04:36:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.823+0000 7fc768fd7700 1 -- 172.21.15.149:0/1768054606 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760011990 con 0x7fc764069db0 2023-06-09T04:36:52.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.823+0000 7fc768fd7700 1 -- 172.21.15.149:0/1768054606 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011d20 con 0x7fc764069db0 2023-06-09T04:36:52.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.823+0000 7fc76c23d700 1 -- 172.21.15.149:0/1768054606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 msgr2=0x7fc7640ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:52.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.823+0000 7fc76c23d700 1 --2- 172.21.15.149:0/1768054606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc7640ce2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7600098f0 tx=0x7fc760009c00 comp rx=0 tx=0).stop 2023-06-09T04:36:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.824+0000 7fc76c23d700 1 -- 172.21.15.149:0/1768054606 shutdown_connections 2023-06-09T04:36:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.824+0000 7fc76c23d700 1 --2- 172.21.15.149:0/1768054606 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76406a200 0x7fc7640ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.824+0000 7fc76c23d700 1 --2- 172.21.15.149:0/1768054606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc7640ce2b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.824+0000 7fc76c23d700 1 -- 172.21.15.149:0/1768054606 >> 172.21.15.149:0/1768054606 conn(0x7fc7640cee30 msgr2=0x7fc7640cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.824+0000 7fc76c23d700 1 -- 172.21.15.149:0/1768054606 shutdown_connections 2023-06-09T04:36:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.824+0000 7fc76c23d700 1 -- 172.21.15.149:0/1768054606 wait complete. 2023-06-09T04:36:52.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.825+0000 7fc76c23d700 1 Processor -- start 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.825+0000 7fc76c23d700 1 -- start start 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.825+0000 7fc76c23d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc764156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76c23d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76406a200 0x7fc7641f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76c23d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76415c090 0x7fc7641517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76c23d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76409e060 con 0x7fc764069db0 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76c23d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc764157360 con 0x7fc76406a200 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76c23d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc764157640 con 0x7fc76415c090 2023-06-09T04:36:52.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc764156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc764156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35894/0 (socket says 172.21.15.149:35894) 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 -- 172.21.15.149:0/2798408816 learned_addr learned my addr 172.21.15.149:0/2798408816 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 -- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76415c090 msgr2=0x7fc7641517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76a7da700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76415c090 0x7fc7641517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76415c090 0x7fc7641517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 -- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76406a200 msgr2=0x7fc7641f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc7697d8700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76406a200 0x7fc7641f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:52.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76406a200 0x7fc7641f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 -- 172.21.15.149:0/2798408816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc760009550 con 0x7fc764069db0 2023-06-09T04:36:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc769fd9700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc764156b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc75400c450 tx=0x7fc75400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc75a7fc700 1 -- 172.21.15.149:0/2798408816 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540052d0 con 0x7fc764069db0 2023-06-09T04:36:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc75a7fc700 1 -- 172.21.15.149:0/2798408816 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754005430 con 0x7fc764069db0 2023-06-09T04:36:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76409e2b0 con 0x7fc764069db0 2023-06-09T04:36:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc75a7fc700 1 -- 172.21.15.149:0/2798408816 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540038c0 con 0x7fc764069db0 2023-06-09T04:36:52.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.826+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc764157050 con 0x7fc764069db0 2023-06-09T04:36:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.827+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc764073fa0 con 0x7fc764069db0 2023-06-09T04:36:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.828+0000 7fc75a7fc700 1 -- 172.21.15.149:0/2798408816 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc754003a20 con 0x7fc764069db0 2023-06-09T04:36:52.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.828+0000 7fc75a7fc700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc74806ace0 0x7fc74806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.828+0000 7fc7697d8700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc74806ace0 0x7fc74806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.828+0000 7fc75a7fc700 1 -- 172.21.15.149:0/2798408816 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc7540887c0 con 0x7fc764069db0 2023-06-09T04:36:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.828+0000 7fc7697d8700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc74806ace0 0x7fc74806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7641f5330 tx=0x7fc760008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:52.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:52.833+0000 7fc75a7fc700 1 -- 172.21.15.149:0/2798408816 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7540538d0 con 0x7fc764069db0 2023-06-09T04:36:53.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.061+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc7640cfd60 con 0x7fc764069db0 2023-06-09T04:36:53.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.066+0000 7fc75a7fc700 1 -- 172.21.15.149:0/2798408816 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc754056ef0 con 0x7fc764069db0 2023-06-09T04:36:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc74806ace0 msgr2=0x7fc74806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc74806ace0 0x7fc74806d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7641f5330 tx=0x7fc760008030 comp rx=0 tx=0).stop 2023-06-09T04:36:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 msgr2=0x7fc764156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc764156b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc75400c450 tx=0x7fc75400c810 comp rx=0 tx=0).stop 2023-06-09T04:36:53.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 shutdown_connections 2023-06-09T04:36:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc74806ace0 0x7fc74806d190 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc7641f5330 tx=0x7fc760008030 comp rx=0 tx=0).stop 2023-06-09T04:36:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc76415c090 0x7fc7641517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc764069db0 0x7fc764156b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 --2- 172.21.15.149:0/2798408816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc76406a200 0x7fc7641f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.071+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 >> 172.21.15.149:0/2798408816 conn(0x7fc7640cee30 msgr2=0x7fc7640cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:53.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.074+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 shutdown_connections 2023-06-09T04:36:53.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.075+0000 7fc76c23d700 1 -- 172.21.15.149:0/2798408816 wait complete. 2023-06-09T04:36:53.077 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 3 and data pool 4 2023-06-09T04:36:53.098 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-09T04:36:53.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-09T04:36:53.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.222+0000 7f8d26cb1700 1 Processor -- start 2023-06-09T04:36:53.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.222+0000 7f8d26cb1700 1 -- start start 2023-06-09T04:36:53.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d26cb1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8d2015a270 0x7f8d200ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d26cb1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2015eda0 con 0x7f8d200ae560 2023-06-09T04:36:53.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d26cb1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200b0930 con 0x7f8d2015a640 2023-06-09T04:36:53.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d26cb1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d200b0c10 con 0x7f8d2015a270 2023-06-09T04:36:53.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d2524e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8d200ae560 0x7f8d2015e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59766/0 (socket says 172.21.15.149:59766) 2023-06-09T04:36:53.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d2524e700 1 -- 172.21.15.149:0/1545371571 learned_addr learned my addr 172.21.15.149:0/1545371571 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:53.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d24a4d700 1 --2- 172.21.15.149:0/1545371571 >> v2:172.21.15.184:3300/0 conn(0x7f8d2015a270 0x7f8d200ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.223+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696804148 0 0) 0x7f8d2015eda0 con 0x7f8d200ae560 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d100035b0 con 0x7f8d200ae560 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1762982847 0 0) 0x7f8d100035b0 con 0x7f8d200ae560 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 >> v2:172.21.15.184:3300/0 conn(0x7f8d2015a270 msgr2=0x7f8d200ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 --2- 172.21.15.149:0/1545371571 >> v2:172.21.15.184:3300/0 conn(0x7f8d2015a270 0x7f8d200ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 >> v1:172.21.15.184:6789/0 conn(0x7f8d2015a640 legacy=0x7f8d2015df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200b0ef0 con 0x7f8d200ae560 2023-06-09T04:36:53.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f8d180019f0 con 0x7f8d200ae560 2023-06-09T04:36:53.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 >> v1:172.21.15.149:6789/0 conn(0x7f8d200ae560 legacy=0x7f8d2015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:53.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d10003a00 0x7f8d10003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d10004850 0x7f8d10004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10005200 0x7f8d1000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200b0c10 con 0x7f8d10004850 2023-06-09T04:36:53.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1000c080 con 0x7f8d10005200 2023-06-09T04:36:53.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1000c240 con 0x7f8d10003a00 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1ffff700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d10004850 0x7f8d10004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d24a4d700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d10003a00 0x7f8d10003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d2524e700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10005200 0x7f8d1000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1ffff700 1 -- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d10003a00 msgr2=0x7f8d10003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1ffff700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d10003a00 0x7f8d10003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1ffff700 1 -- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10005200 msgr2=0x7f8d1000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1ffff700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10005200 0x7f8d1000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1ffff700 1 -- 172.21.15.149:0/1545371571 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d100035b0 con 0x7f8d10004850 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d2524e700 1 -- 172.21.15.149:0/1545371571 reap_dead start 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1ffff700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d10004850 0x7f8d10004cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d2015aa50 tx=0x7f8d10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175d08b4dc597cf0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0052d0 con 0x7f8d10004850 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c005450 con 0x7f8d10004850 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.224+0000 7f8d1f7fe700 1 -- 172.21.15.149:0/1545371571 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0038c0 con 0x7f8d10004850 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.225+0000 7f8d26cb1700 1 -- 172.21.15.149:0/1545371571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d10004850 msgr2=0x7f8d10004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.225+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d10004850 0x7f8d10004cc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d2015aa50 tx=0x7f8d10005880 comp rx=0 tx=0).stop 2023-06-09T04:36:53.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.225+0000 7f8d26cb1700 1 -- 172.21.15.149:0/1545371571 shutdown_connections 2023-06-09T04:36:53.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.225+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/1545371571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d10004850 0x7f8d10004cc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.225+0000 7f8d26cb1700 1 -- 172.21.15.149:0/1545371571 >> 172.21.15.149:0/1545371571 conn(0x7f8d2006a6d0 msgr2=0x7f8d20099c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:53.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.225+0000 7f8d26cb1700 1 -- 172.21.15.149:0/1545371571 shutdown_connections 2023-06-09T04:36:53.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.225+0000 7f8d26cb1700 1 -- 172.21.15.149:0/1545371571 wait complete. 2023-06-09T04:36:53.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.226+0000 7f8d26cb1700 1 Processor -- start 2023-06-09T04:36:53.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.226+0000 7f8d26cb1700 1 -- start start 2023-06-09T04:36:53.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d26cb1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10004850 0x7f8d200c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d26cb1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d200b5600 0x7f8d200c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d26cb1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d200b5a70 0x7f8d200ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d26cb1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20152710 con 0x7f8d200b5a70 2023-06-09T04:36:53.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d26cb1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200cd820 con 0x7f8d10004850 2023-06-09T04:36:53.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d26cb1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d200cdda0 con 0x7f8d200b5600 2023-06-09T04:36:53.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d2524e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d200b5a70 0x7f8d200ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d2524e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d200b5a70 0x7f8d200ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35916/0 (socket says 172.21.15.149:35916) 2023-06-09T04:36:53.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d2524e700 1 -- 172.21.15.149:0/3858028070 learned_addr learned my addr 172.21.15.149:0/3858028070 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:53.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d1ffff700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d200b5600 0x7f8d200c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.227+0000 7f8d24a4d700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10004850 0x7f8d200c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d2524e700 1 -- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d200b5600 msgr2=0x7f8d200c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:53.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d2524e700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d200b5600 0x7f8d200c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d2524e700 1 -- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10004850 msgr2=0x7f8d200c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:53.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d2524e700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10004850 0x7f8d200c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:53.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d2524e700 1 -- 172.21.15.149:0/3858028070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200cdac0 con 0x7f8d200b5a70 2023-06-09T04:36:53.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d2524e700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d200b5a70 0x7f8d200ce540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d20070ef0 tx=0x7f8d1800a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:53.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d1d7fa700 1 -- 172.21.15.149:0/3858028070 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800ad60 con 0x7f8d200b5a70 2023-06-09T04:36:53.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d1d7fa700 1 -- 172.21.15.149:0/3858028070 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d180133f0 con 0x7f8d200b5a70 2023-06-09T04:36:53.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d200c4560 con 0x7f8d200b5a70 2023-06-09T04:36:53.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d1d7fa700 1 -- 172.21.15.149:0/3858028070 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d180137a0 con 0x7f8d200b5a70 2023-06-09T04:36:53.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.228+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d20154fb0 con 0x7f8d200b5a70 2023-06-09T04:36:53.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.229+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d200c4a80 con 0x7f8d200b5a70 2023-06-09T04:36:53.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.229+0000 7f8d1d7fa700 1 -- 172.21.15.149:0/3858028070 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d18013900 con 0x7f8d200b5a70 2023-06-09T04:36:53.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.230+0000 7f8d1d7fa700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8d0406ace0 0x7f8d0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:53.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.230+0000 7f8d1d7fa700 1 -- 172.21.15.149:0/3858028070 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d18089bf0 con 0x7f8d200b5a70 2023-06-09T04:36:53.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.230+0000 7f8d24a4d700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8d0406ace0 0x7f8d0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:53.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.230+0000 7f8d24a4d700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8d0406ace0 0x7f8d0406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009c60 tx=0x7f8d14009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:53.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.234+0000 7f8d1d7fa700 1 -- 172.21.15.149:0/3858028070 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8d200c4a80 con 0x7f8d200b5a70 2023-06-09T04:36:53.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:53.432+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f8d200c4a80 con 0x7f8d200b5a70 2023-06-09T04:36:54.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.067+0000 7f8d1d7fa700 1 -- 172.21.15.149:0/3858028070 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f8d200c4a80 con 0x7f8d200b5a70 2023-06-09T04:36:54.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8d0406ace0 msgr2=0x7f8d0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:54.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8d0406ace0 0x7f8d0406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009c60 tx=0x7f8d14009210 comp rx=0 tx=0).stop 2023-06-09T04:36:54.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d200b5a70 msgr2=0x7f8d200ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:54.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d200b5a70 0x7f8d200ce540 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d20070ef0 tx=0x7f8d1800a5f0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 shutdown_connections 2023-06-09T04:36:54.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8d0406ace0 0x7f8d0406d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8d200b5a70 0x7f8d200ce540 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d10004850 0x7f8d200c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 --2- 172.21.15.149:0/3858028070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8d200b5600 0x7f8d200c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 >> 172.21.15.149:0/3858028070 conn(0x7f8d2006a6d0 msgr2=0x7f8d200b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:54.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 shutdown_connections 2023-06-09T04:36:54.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.072+0000 7f8d26cb1700 1 -- 172.21.15.149:0/3858028070 wait complete. 2023-06-09T04:36:54.088 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:36:54.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.217+0000 7f47d7f15700 1 Processor -- start 2023-06-09T04:36:54.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.217+0000 7f47d7f15700 1 -- start start 2023-06-09T04:36:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d7f15700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d00709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d7f15700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f47d006e070 0x7f47d0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d7f15700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d006a530 con 0x7f47d0157a20 2023-06-09T04:36:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d7f15700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d006e8a0 con 0x7f47d006e070 2023-06-09T04:36:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d7f15700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d006e5c0 con 0x7f47d006a9c0 2023-06-09T04:36:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d54b0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d00709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d64b2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f47d006e070 0x7f47d0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d5cb1700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f47d0157a20 0x7f47d006b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:37550/0 (socket says 172.21.15.149:37550) 2023-06-09T04:36:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d54b0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d00709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:41534/0 (socket says 172.21.15.149:41534) 2023-06-09T04:36:54.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.218+0000 7f47d5cb1700 1 -- 172.21.15.149:0/1843731534 learned_addr learned my addr 172.21.15.149:0/1843731534 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:54.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d54b0700 1 -- 172.21.15.149:0/1843731534 >> v2:172.21.15.184:3300/0 conn(0x7f47d006e070 msgr2=0x7f47d0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:54.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d54b0700 1 --2- 172.21.15.149:0/1843731534 >> v2:172.21.15.184:3300/0 conn(0x7f47d006e070 0x7f47d0070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d54b0700 1 -- 172.21.15.149:0/1843731534 >> v1:172.21.15.184:6789/0 conn(0x7f47d0157a20 legacy=0x7f47d006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:54.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d54b0700 1 -- 172.21.15.149:0/1843731534 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0069ee0 con 0x7f47d006a9c0 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d64b2700 1 --2- 172.21.15.149:0/1843731534 >> v2:172.21.15.184:3300/0 conn(0x7f47d006e070 0x7f47d0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d54b0700 1 --2- 172.21.15.149:0/1843731534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d00709a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009840 tx=0x7f47cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ea251a50ad5d72 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d4caf700 1 -- 172.21.15.149:0/1843731534 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc011830 con 0x7f47d006a9c0 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d4caf700 1 -- 172.21.15.149:0/1843731534 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc011990 con 0x7f47d006a9c0 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.219+0000 7f47d4caf700 1 -- 172.21.15.149:0/1843731534 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc011d20 con 0x7f47d006a9c0 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 -- 172.21.15.149:0/1843731534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 msgr2=0x7f47d00709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 --2- 172.21.15.149:0/1843731534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d00709a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009840 tx=0x7f47cc009b50 comp rx=0 tx=0).stop 2023-06-09T04:36:54.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 -- 172.21.15.149:0/1843731534 shutdown_connections 2023-06-09T04:36:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 --2- 172.21.15.149:0/1843731534 >> v2:172.21.15.184:3300/0 conn(0x7f47d006e070 0x7f47d0070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 --2- 172.21.15.149:0/1843731534 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d00709a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 -- 172.21.15.149:0/1843731534 >> 172.21.15.149:0/1843731534 conn(0x7f47d00cee90 msgr2=0x7f47d00cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 -- 172.21.15.149:0/1843731534 shutdown_connections 2023-06-09T04:36:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.220+0000 7f47d7f15700 1 -- 172.21.15.149:0/1843731534 wait complete. 2023-06-09T04:36:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.221+0000 7f47d7f15700 1 Processor -- start 2023-06-09T04:36:54.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.221+0000 7f47d7f15700 1 -- start start 2023-06-09T04:36:54.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d0153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d006e070 0x7f47d015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d0157a20 0x7f47d00c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d015a380 con 0x7f47d0157a20 2023-06-09T04:36:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00c6540 con 0x7f47d006e070 2023-06-09T04:36:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00c6820 con 0x7f47d006a9c0 2023-06-09T04:36:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d0157a20 0x7f47d00c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:54.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d0157a20 0x7f47d00c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35930/0 (socket says 172.21.15.149:35930) 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 -- 172.21.15.149:0/452557163 learned_addr learned my addr 172.21.15.149:0/452557163 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d5cb1700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d0153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d54b0700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d006e070 0x7f47d015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 -- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 msgr2=0x7f47d0153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d0153370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 -- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d006e070 msgr2=0x7f47d015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d006e070 0x7f47d015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:54.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 -- 172.21.15.149:0/452557163 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c8009a70 con 0x7f47d0157a20 2023-06-09T04:36:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d64b2700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d0157a20 0x7f47d00c80a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47c800efb0 tx=0x7f47c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47c67fc700 1 -- 172.21.15.149:0/452557163 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c800cc90 con 0x7f47d0157a20 2023-06-09T04:36:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47c67fc700 1 -- 172.21.15.149:0/452557163 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c800f040 con 0x7f47d0157a20 2023-06-09T04:36:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47c67fc700 1 -- 172.21.15.149:0/452557163 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8014480 con 0x7f47d0157a20 2023-06-09T04:36:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc0094a0 con 0x7f47d0157a20 2023-06-09T04:36:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.222+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d01538b0 con 0x7f47d0157a20 2023-06-09T04:36:54.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.223+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d015e8e0 con 0x7f47d0157a20 2023-06-09T04:36:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.224+0000 7f47c67fc700 1 -- 172.21.15.149:0/452557163 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47c80145e0 con 0x7f47d0157a20 2023-06-09T04:36:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.224+0000 7f47c67fc700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47b406ace0 0x7f47b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.224+0000 7f47c67fc700 1 -- 172.21.15.149:0/452557163 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f47c808a240 con 0x7f47d0157a20 2023-06-09T04:36:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.224+0000 7f47d5cb1700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47b406ace0 0x7f47b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:54.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.225+0000 7f47d5cb1700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47b406ace0 0x7f47b406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47c0005910 tx=0x7f47c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:54.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.229+0000 7f47c67fc700 1 -- 172.21.15.149:0/452557163 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47c8058c20 con 0x7f47d0157a20 2023-06-09T04:36:54.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:54.417+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f47d015a860 con 0x7f47d0157a20 2023-06-09T04:36:56.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.086+0000 7f47c67fc700 1 -- 172.21.15.149:0/452557163 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f47c8009d50 con 0x7f47d0157a20 2023-06-09T04:36:56.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.094+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47b406ace0 msgr2=0x7f47b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:56.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.094+0000 7f47d7f15700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47b406ace0 0x7f47b406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f47c0005910 tx=0x7f47c0009040 comp rx=0 tx=0).stop 2023-06-09T04:36:56.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.094+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d0157a20 msgr2=0x7f47d00c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:56.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.094+0000 7f47d7f15700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d0157a20 0x7f47d00c80a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f47c800efb0 tx=0x7f47c800c3a0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.095+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 shutdown_connections 2023-06-09T04:36:56.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.095+0000 7f47d7f15700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47b406ace0 0x7f47b406d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.095+0000 7f47d7f15700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47d006a9c0 0x7f47d0153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.095+0000 7f47d7f15700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47d0157a20 0x7f47d00c80a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.095+0000 7f47d7f15700 1 --2- 172.21.15.149:0/452557163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47d006e070 0x7f47d015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.095+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 >> 172.21.15.149:0/452557163 conn(0x7f47d00cee90 msgr2=0x7f47d00cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:56.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.096+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 shutdown_connections 2023-06-09T04:36:56.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.096+0000 7f47d7f15700 1 -- 172.21.15.149:0/452557163 wait complete. 2023-06-09T04:36:56.099 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data_ec' created 2023-06-09T04:36:56.112 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-09T04:36:56.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.237+0000 7f9cfd1c8700 1 Processor -- start 2023-06-09T04:36:56.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.237+0000 7f9cfd1c8700 1 -- start start 2023-06-09T04:36:56.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cfd1c8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9cf815d5c0 0x7f9cf806daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:56.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cfd1c8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf806cd70 0x7f9cf806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:56.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cfd1c8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf815d990 con 0x7f9cf80d00a0 2023-06-09T04:36:56.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cfd1c8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf806d730 con 0x7f9cf815d5c0 2023-06-09T04:36:56.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cfd1c8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf806e080 con 0x7f9cf806cd70 2023-06-09T04:36:56.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf6d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9cf815d5c0 0x7f9cf806daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:56.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf6d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9cf815d5c0 0x7f9cf806daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35934/0 (socket says 172.21.15.149:35934) 2023-06-09T04:36:56.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf6d9d700 1 -- 172.21.15.149:0/303848921 learned_addr learned my addr 172.21.15.149:0/303848921 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:56.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf759e700 1 --2- 172.21.15.149:0/303848921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf806cd70 0x7f9cf806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:56.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf6d9d700 1 -- 172.21.15.149:0/303848921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf806cd70 msgr2=0x7f9cf806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf6d9d700 1 --2- 172.21.15.149:0/303848921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf806cd70 0x7f9cf806d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf6d9d700 1 -- 172.21.15.149:0/303848921 >> v1:172.21.15.184:6789/0 conn(0x7f9cf80d00a0 legacy=0x7f9cf806a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.238+0000 7f9cf6d9d700 1 -- 172.21.15.149:0/303848921 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf806e360 con 0x7f9cf815d5c0 2023-06-09T04:36:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cf6d9d700 1 --2- 172.21.15.149:0/303848921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf815d5c0 0x7f9cf806daa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cec006fd0 tx=0x7f9cec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612d7130580ff3cc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cf5d9b700 1 -- 172.21.15.149:0/303848921 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec005e30 con 0x7f9cf815d5c0 2023-06-09T04:36:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cf5d9b700 1 -- 172.21.15.149:0/303848921 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec004030 con 0x7f9cf815d5c0 2023-06-09T04:36:56.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cf5d9b700 1 -- 172.21.15.149:0/303848921 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec0043e0 con 0x7f9cf815d5c0 2023-06-09T04:36:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/303848921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf815d5c0 msgr2=0x7f9cf806daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/303848921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf815d5c0 0x7f9cf806daa0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cec006fd0 tx=0x7f9cec009bd0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/303848921 shutdown_connections 2023-06-09T04:36:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/303848921 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf806cd70 0x7f9cf806d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/303848921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf815d5c0 0x7f9cf806daa0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/303848921 >> 172.21.15.149:0/303848921 conn(0x7f9cf8098b20 msgr2=0x7f9cf806b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:56.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/303848921 shutdown_connections 2023-06-09T04:36:56.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.239+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/303848921 wait complete. 2023-06-09T04:36:56.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 Processor -- start 2023-06-09T04:36:56.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 -- start start 2023-06-09T04:36:56.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf806cd70 0x7f9cf81f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:56.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80d00a0 0x7f9cf814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:56.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf815d5c0 0x7f9cf815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:56.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf814e000 con 0x7f9cf80d00a0 2023-06-09T04:36:56.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf815ac70 con 0x7f9cf806cd70 2023-06-09T04:36:56.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.241+0000 7f9cfd1c8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80cdad0 con 0x7f9cf815d5c0 2023-06-09T04:36:56.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80d00a0 0x7f9cf814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:56.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80d00a0 0x7f9cf814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35942/0 (socket says 172.21.15.149:35942) 2023-06-09T04:36:56.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 -- 172.21.15.149:0/357135072 learned_addr learned my addr 172.21.15.149:0/357135072 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:56.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf6d9d700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf806cd70 0x7f9cf81f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:56.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf759e700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf815d5c0 0x7f9cf815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:56.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 -- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf815d5c0 msgr2=0x7f9cf815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:56.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf815d5c0 0x7f9cf815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 -- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf806cd70 msgr2=0x7f9cf81f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:56.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf806cd70 0x7f9cf81f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 -- 172.21.15.149:0/357135072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec009500 con 0x7f9cf80d00a0 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cf659c700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80d00a0 0x7f9cf814dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c4e0 tx=0x7f9ce800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cdf7fe700 1 -- 172.21.15.149:0/357135072 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80052d0 con 0x7f9cf80d00a0 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cdf7fe700 1 -- 172.21.15.149:0/357135072 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce8005430 con 0x7f9cf80d00a0 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cdf7fe700 1 -- 172.21.15.149:0/357135072 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80038c0 con 0x7f9cf80d00a0 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf80cddb0 con 0x7f9cf80d00a0 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.242+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf815a840 con 0x7f9cf80d00a0 2023-06-09T04:36:56.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.243+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf80cd930 con 0x7f9cf80d00a0 2023-06-09T04:36:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.244+0000 7f9cdf7fe700 1 -- 172.21.15.149:0/357135072 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ce8003a20 con 0x7f9cf80d00a0 2023-06-09T04:36:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.244+0000 7f9cdf7fe700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9ce406ace0 0x7f9ce406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.244+0000 7f9cf6d9d700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9ce406ace0 0x7f9ce406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.244+0000 7f9cdf7fe700 1 -- 172.21.15.149:0/357135072 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f9ce8088be0 con 0x7f9cf80d00a0 2023-06-09T04:36:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.244+0000 7f9cf6d9d700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9ce406ace0 0x7f9ce406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000c00 tx=0x7f9cec008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:56.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.249+0000 7f9cdf7fe700 1 -- 172.21.15.149:0/357135072 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9cf80cd930 con 0x7f9cf80d00a0 2023-06-09T04:36:56.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:56.434+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f9cf80ce2d0 con 0x7f9cf80d00a0 2023-06-09T04:36:57.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.094+0000 7f9cdf7fe700 1 -- 172.21.15.149:0/357135072 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9cf80ce2d0 con 0x7f9cf80d00a0 2023-06-09T04:36:57.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.101+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9ce406ace0 msgr2=0x7f9ce406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.101+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9ce406ace0 0x7f9ce406d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cec000c00 tx=0x7f9cec008070 comp rx=0 tx=0).stop 2023-06-09T04:36:57.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.101+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80d00a0 msgr2=0x7f9cf814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.101+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80d00a0 0x7f9cf814dac0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800c4e0 tx=0x7f9ce800c8a0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.107+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 shutdown_connections 2023-06-09T04:36:57.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.107+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9ce406ace0 0x7f9ce406d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.107+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9cf815d5c0 0x7f9cf815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.107+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9cf806cd70 0x7f9cf81f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.107+0000 7f9cfd1c8700 1 --2- 172.21.15.149:0/357135072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9cf80d00a0 0x7f9cf814dac0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.107+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 >> 172.21.15.149:0/357135072 conn(0x7f9cf8098b20 msgr2=0x7f9cf80b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:57.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.108+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 shutdown_connections 2023-06-09T04:36:57.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.108+0000 7f9cfd1c8700 1 -- 172.21.15.149:0/357135072 wait complete. 2023-06-09T04:36:57.110 INFO:teuthology.orchestra.run.smithi149.stderr:set pool 5 allow_ec_overwrites to true 2023-06-09T04:36:57.130 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-09T04:36:57.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.252+0000 7f599e876700 1 Processor -- start 2023-06-09T04:36:57.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.252+0000 7f599e876700 1 -- start start 2023-06-09T04:36:57.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.252+0000 7f599e876700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59980b60a0 0x7f59980cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.252+0000 7f599e876700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f599815e340 0x7f59980cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.252+0000 7f599e876700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59980cda20 con 0x7f59980cf5b0 2023-06-09T04:36:57.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.252+0000 7f599e876700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59980b6470 con 0x7f59980b60a0 2023-06-09T04:36:57.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.252+0000 7f599e876700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599815e7a0 con 0x7f599815e340 2023-06-09T04:36:57.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5997fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f59980b60a0 0x7f59980cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f59977fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f59980cf5b0 0x7f599815dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59812/0 (socket says 172.21.15.149:59812) 2023-06-09T04:36:57.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f59977fe700 1 -- 172.21.15.149:0/3602604540 learned_addr learned my addr 172.21.15.149:0/3602604540 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:57.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f599ce13700 1 --2- 172.21.15.149:0/3602604540 >> v2:172.21.15.184:3300/0 conn(0x7f599815e340 0x7f59980cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5997fff700 1 -- 172.21.15.149:0/3602604540 >> v2:172.21.15.184:3300/0 conn(0x7f599815e340 msgr2=0x7f59980cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5997fff700 1 --2- 172.21.15.149:0/3602604540 >> v2:172.21.15.184:3300/0 conn(0x7f599815e340 0x7f59980cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5997fff700 1 -- 172.21.15.149:0/3602604540 >> v1:172.21.15.149:6789/0 conn(0x7f59980cf5b0 legacy=0x7f599815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5996ffd700 1 -- 172.21.15.149:0/3602604540 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714870051 0 0) 0x7f59980cda20 con 0x7f59980cf5b0 2023-06-09T04:36:57.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5997fff700 1 -- 172.21.15.149:0/3602604540 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599815a520 con 0x7f59980b60a0 2023-06-09T04:36:57.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5997fff700 1 --2- 172.21.15.149:0/3602604540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f59980cad90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5998071ff0 tx=0x7f5988009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99687ee9d128d68b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:57.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5996ffd700 1 -- 172.21.15.149:0/3602604540 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988011830 con 0x7f59980b60a0 2023-06-09T04:36:57.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5996ffd700 1 -- 172.21.15.149:0/3602604540 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988011990 con 0x7f59980b60a0 2023-06-09T04:36:57.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.253+0000 7f5996ffd700 1 -- 172.21.15.149:0/3602604540 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988011d20 con 0x7f59980b60a0 2023-06-09T04:36:57.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 -- 172.21.15.149:0/3602604540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 msgr2=0x7f59980cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 --2- 172.21.15.149:0/3602604540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f59980cad90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5998071ff0 tx=0x7f5988009b20 comp rx=0 tx=0).stop 2023-06-09T04:36:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 -- 172.21.15.149:0/3602604540 shutdown_connections 2023-06-09T04:36:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 --2- 172.21.15.149:0/3602604540 >> v2:172.21.15.184:3300/0 conn(0x7f599815e340 0x7f59980cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 --2- 172.21.15.149:0/3602604540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f59980cad90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 -- 172.21.15.149:0/3602604540 >> 172.21.15.149:0/3602604540 conn(0x7f5998069db0 msgr2=0x7f599806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 -- 172.21.15.149:0/3602604540 shutdown_connections 2023-06-09T04:36:57.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.254+0000 7f599e876700 1 -- 172.21.15.149:0/3602604540 wait complete. 2023-06-09T04:36:57.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.255+0000 7f599e876700 1 Processor -- start 2023-06-09T04:36:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.255+0000 7f599e876700 1 -- start start 2023-06-09T04:36:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599e876700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f5998151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599e876700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59980cf5b0 0x7f5998154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599e876700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599815e340 0x7f59980d0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599e876700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599815a7b0 con 0x7f59980b60a0 2023-06-09T04:36:57.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599e876700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599815aa50 con 0x7f599815e340 2023-06-09T04:36:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599e876700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599815ad30 con 0x7f59980cf5b0 2023-06-09T04:36:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f5998151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f5998151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35954/0 (socket says 172.21.15.149:35954) 2023-06-09T04:36:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 -- 172.21.15.149:0/1978205044 learned_addr learned my addr 172.21.15.149:0/1978205044 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599ce13700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599815e340 0x7f59980d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f59977fe700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59980cf5b0 0x7f5998154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 -- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59980cf5b0 msgr2=0x7f5998154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59980cf5b0 0x7f5998154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 -- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599815e340 msgr2=0x7f59980d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599815e340 0x7f59980d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 -- 172.21.15.149:0/1978205044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59880094a0 con 0x7f59980b60a0 2023-06-09T04:36:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f59977fe700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59980cf5b0 0x7f5998154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599ce13700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599815e340 0x7f59980d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:57.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5997fff700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f5998151350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5988000c00 tx=0x7f5988004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5994ff9700 1 -- 172.21.15.149:0/1978205044 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880036a0 con 0x7f59980b60a0 2023-06-09T04:36:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f5994ff9700 1 -- 172.21.15.149:0/1978205044 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598801e070 con 0x7f59980b60a0 2023-06-09T04:36:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.256+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599815b010 con 0x7f59980b60a0 2023-06-09T04:36:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.257+0000 7f5994ff9700 1 -- 172.21.15.149:0/1978205044 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988003a60 con 0x7f59980b60a0 2023-06-09T04:36:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.257+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998151ba0 con 0x7f59980b60a0 2023-06-09T04:36:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.257+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998151d30 con 0x7f59980b60a0 2023-06-09T04:36:57.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.258+0000 7f5994ff9700 1 -- 172.21.15.149:0/1978205044 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5988003bc0 con 0x7f59980b60a0 2023-06-09T04:36:57.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.258+0000 7f5994ff9700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f598406ace0 0x7f598406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.258+0000 7f5994ff9700 1 -- 172.21.15.149:0/1978205044 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f598808a7b0 con 0x7f59980b60a0 2023-06-09T04:36:57.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.258+0000 7f59977fe700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f598406ace0 0x7f598406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.259+0000 7f59977fe700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f598406ace0 0x7f598406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f598c007fd0 tx=0x7f598c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:57.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.263+0000 7f5994ff9700 1 -- 172.21.15.149:0/1978205044 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5988055620 con 0x7f59980b60a0 2023-06-09T04:36:57.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.494+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f599815b530 con 0x7f59980b60a0 2023-06-09T04:36:57.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.499+0000 7f5994ff9700 1 -- 172.21.15.149:0/1978205044 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f599815b530 con 0x7f59980b60a0 2023-06-09T04:36:57.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.501+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f598406ace0 msgr2=0x7f598406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.501+0000 7f599e876700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f598406ace0 0x7f598406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f598c007fd0 tx=0x7f598c009040 comp rx=0 tx=0).stop 2023-06-09T04:36:57.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.501+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 msgr2=0x7f5998151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.501+0000 7f599e876700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f5998151350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5988000c00 tx=0x7f5988004750 comp rx=0 tx=0).stop 2023-06-09T04:36:57.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 shutdown_connections 2023-06-09T04:36:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f598406ace0 0x7f598406d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f599815e340 0x7f59980d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f59980b60a0 0x7f5998151350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 --2- 172.21.15.149:0/1978205044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f59980cf5b0 0x7f5998154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 >> 172.21.15.149:0/1978205044 conn(0x7f5998069db0 msgr2=0x7f59981598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 shutdown_connections 2023-06-09T04:36:57.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.502+0000 7f599e876700 1 -- 172.21.15.149:0/1978205044 wait complete. 2023-06-09T04:36:57.505 INFO:teuthology.orchestra.run.smithi149.stderr:added data pool 5 to fsmap 2023-06-09T04:36:57.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:36:57.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.635+0000 7fc1fbe10700 1 Processor -- start 2023-06-09T04:36:57.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.635+0000 7fc1fbe10700 1 -- start start 2023-06-09T04:36:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1fbe10700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc1f406a4c0 0x7fc1f40af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1fbe10700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40ccba0 0x7fc1f40b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1fbe10700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40af050 con 0x7fc1f415c590 2023-06-09T04:36:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1fbe10700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40afae0 con 0x7fc1f406a4c0 2023-06-09T04:36:57.638 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1fbe10700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40ccfe0 con 0x7fc1f40ccba0 2023-06-09T04:36:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1f93ab700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc1f406a4c0 0x7fc1f40af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1f93ab700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc1f406a4c0 0x7fc1f40af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35964/0 (socket says 172.21.15.149:35964) 2023-06-09T04:36:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1f93ab700 1 -- 172.21.15.149:0/2963410667 learned_addr learned my addr 172.21.15.149:0/2963410667 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1fa3ad700 1 --2- 172.21.15.149:0/2963410667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40ccba0 0x7fc1f40b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.636+0000 7fc1f93ab700 1 -- 172.21.15.149:0/2963410667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40ccba0 msgr2=0x7fc1f40b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1f93ab700 1 --2- 172.21.15.149:0/2963410667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40ccba0 0x7fc1f40b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.639 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1f93ab700 1 -- 172.21.15.149:0/2963410667 >> v1:172.21.15.184:6789/0 conn(0x7fc1f415c590 legacy=0x7fc1f4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:57.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1f93ab700 1 -- 172.21.15.149:0/2963410667 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40af800 con 0x7fc1f406a4c0 2023-06-09T04:36:57.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1f93ab700 1 --2- 172.21.15.149:0/2963410667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f406a4c0 0x7fc1f40af220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00098f0 tx=0x7fc1f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7794d5cd3a6fb8cf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:57.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1f8baa700 1 -- 172.21.15.149:0/2963410667 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0004230 con 0x7fc1f406a4c0 2023-06-09T04:36:57.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1f8baa700 1 -- 172.21.15.149:0/2963410667 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0004390 con 0x7fc1f406a4c0 2023-06-09T04:36:57.640 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1f8baa700 1 -- 172.21.15.149:0/2963410667 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00036a0 con 0x7fc1f406a4c0 2023-06-09T04:36:57.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1fbe10700 1 -- 172.21.15.149:0/2963410667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f406a4c0 msgr2=0x7fc1f40af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/2963410667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f406a4c0 0x7fc1f40af220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00098f0 tx=0x7fc1f0009c00 comp rx=0 tx=0).stop 2023-06-09T04:36:57.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1fbe10700 1 -- 172.21.15.149:0/2963410667 shutdown_connections 2023-06-09T04:36:57.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/2963410667 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40ccba0 0x7fc1f40b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/2963410667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f406a4c0 0x7fc1f40af220 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1fbe10700 1 -- 172.21.15.149:0/2963410667 >> 172.21.15.149:0/2963410667 conn(0x7fc1f406b7e0 msgr2=0x7fc1f40cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.637+0000 7fc1fbe10700 1 -- 172.21.15.149:0/2963410667 shutdown_connections 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.638+0000 7fc1fbe10700 1 -- 172.21.15.149:0/2963410667 wait complete. 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 Processor -- start 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 -- start start 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f406a4c0 0x7fc1f40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ccba0 0x7fc1f40caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f415c590 0x7fc1f415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41e7a20 con 0x7fc1f415c590 2023-06-09T04:36:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f40b24d0 con 0x7fc1f40ccba0 2023-06-09T04:36:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.639+0000 7fc1fbe10700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41f67d0 con 0x7fc1f406a4c0 2023-06-09T04:36:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f415c590 0x7fc1f415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f415c590 0x7fc1f415a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35972/0 (socket says 172.21.15.149:35972) 2023-06-09T04:36:57.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 -- 172.21.15.149:0/1075145181 learned_addr learned my addr 172.21.15.149:0/1075145181 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1f9bac700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f406a4c0 0x7fc1f40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1f93ab700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ccba0 0x7fc1f40caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 -- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f406a4c0 msgr2=0x7fc1f40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f406a4c0 0x7fc1f40b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 -- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ccba0 msgr2=0x7fc1f40caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ccba0 0x7fc1f40caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 -- 172.21.15.149:0/1075145181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0009550 con 0x7fc1f415c590 2023-06-09T04:36:57.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fa3ad700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f415c590 0x7fc1f415a850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00cd70 tx=0x7fc1ec00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:57.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1ea7fc700 1 -- 172.21.15.149:0/1075145181 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec003a20 con 0x7fc1f415c590 2023-06-09T04:36:57.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1ea7fc700 1 -- 172.21.15.149:0/1075145181 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec003b80 con 0x7fc1f415c590 2023-06-09T04:36:57.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f40b26e0 con 0x7fc1f415c590 2023-06-09T04:36:57.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1ea7fc700 1 -- 172.21.15.149:0/1075145181 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec004020 con 0x7fc1f415c590 2023-06-09T04:36:57.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.640+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f40b2ca0 con 0x7fc1f415c590 2023-06-09T04:36:57.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.641+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f40d0530 con 0x7fc1f415c590 2023-06-09T04:36:57.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.642+0000 7fc1ea7fc700 1 -- 172.21.15.149:0/1075145181 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1ec004180 con 0x7fc1f415c590 2023-06-09T04:36:57.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.642+0000 7fc1ea7fc700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1d806ace0 0x7fc1d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:57.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.642+0000 7fc1ea7fc700 1 -- 172.21.15.149:0/1075145181 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc1ec012070 con 0x7fc1f415c590 2023-06-09T04:36:57.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.642+0000 7fc1f9bac700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1d806ace0 0x7fc1d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:57.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.642+0000 7fc1f9bac700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1d806ace0 0x7fc1d806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4006fd0 tx=0x7fc1e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:57.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.646+0000 7fc1ea7fc700 1 -- 172.21.15.149:0/1075145181 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc1ec08d030 con 0x7fc1f415c590 2023-06-09T04:36:57.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.875+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f40b2e90 con 0x7fc1f415c590 2023-06-09T04:36:57.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.876+0000 7fc1ea7fc700 1 -- 172.21.15.149:0/1075145181 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4679 (secure 0 0 0) 0x7fc1ec054d60 con 0x7fc1f415c590 2023-06-09T04:36:57.877 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:57.877 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:36:57.496440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-09T04:36:57.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1d806ace0 msgr2=0x7fc1d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1d806ace0 0x7fc1d806d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4006fd0 tx=0x7fc1e4008040 comp rx=0 tx=0).stop 2023-06-09T04:36:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f415c590 msgr2=0x7fc1f415a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f415c590 0x7fc1f415a850 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00cd70 tx=0x7fc1ec00a570 comp rx=0 tx=0).stop 2023-06-09T04:36:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 shutdown_connections 2023-06-09T04:36:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1d806ace0 0x7fc1d806d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f406a4c0 0x7fc1f40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f415c590 0x7fc1f415a850 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 --2- 172.21.15.149:0/1075145181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ccba0 0x7fc1f40caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 >> 172.21.15.149:0/1075145181 conn(0x7fc1f406b7e0 msgr2=0x7fc1f406d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 shutdown_connections 2023-06-09T04:36:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:57.878+0000 7fc1fbe10700 1 -- 172.21.15.149:0/1075145181 wait complete. 2023-06-09T04:36:57.881 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 7 2023-06-09T04:36:57.891 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:58.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.009+0000 7f2e21cb9700 1 Processor -- start 2023-06-09T04:36:58.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.009+0000 7f2e21cb9700 1 -- start start 2023-06-09T04:36:58.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.010+0000 7f2e21cb9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2e1c0cd980 0x7f2e1c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.010+0000 7f2e21cb9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0b01a0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.010+0000 7f2e21cb9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0b0900 con 0x7f2e1c0b0c40 2023-06-09T04:36:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.010+0000 7f2e21cb9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0b06f0 con 0x7f2e1c0cd980 2023-06-09T04:36:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.010+0000 7f2e1affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2e1c0cd980 0x7f2e1c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.010+0000 7f2e1b7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2e1c0afa30 0x7f2e1c0cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59840/0 (socket says 172.21.15.149:59840) 2023-06-09T04:36:58.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.010+0000 7f2e1b7fe700 1 -- 172.21.15.149:0/236235274 learned_addr learned my addr 172.21.15.149:0/236235274 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:58.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e1affd700 1 -- 172.21.15.149:0/236235274 >> v1:172.21.15.184:6789/0 conn(0x7f2e1c0b0c40 legacy=0x7f2e1c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e1affd700 1 -- 172.21.15.149:0/236235274 >> v1:172.21.15.149:6789/0 conn(0x7f2e1c0afa30 legacy=0x7f2e1c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e1affd700 1 -- 172.21.15.149:0/236235274 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0ca7a0 con 0x7f2e1c0cd980 2023-06-09T04:36:58.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e1affd700 1 --2- 172.21.15.149:0/236235274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0cd980 0x7f2e1c0b24f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009840 tx=0x7f2e10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb527173d5e6369 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e1a7fc700 1 -- 172.21.15.149:0/236235274 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10011830 con 0x7f2e1c0cd980 2023-06-09T04:36:58.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e1a7fc700 1 -- 172.21.15.149:0/236235274 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e10011990 con 0x7f2e1c0cd980 2023-06-09T04:36:58.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e1a7fc700 1 -- 172.21.15.149:0/236235274 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e10011d20 con 0x7f2e1c0cd980 2023-06-09T04:36:58.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e21cb9700 1 -- 172.21.15.149:0/236235274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0cd980 msgr2=0x7f2e1c0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/236235274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0cd980 0x7f2e1c0b24f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009840 tx=0x7f2e10009b50 comp rx=0 tx=0).stop 2023-06-09T04:36:58.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e21cb9700 1 -- 172.21.15.149:0/236235274 shutdown_connections 2023-06-09T04:36:58.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/236235274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0cd980 0x7f2e1c0b24f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e21cb9700 1 -- 172.21.15.149:0/236235274 >> 172.21.15.149:0/236235274 conn(0x7f2e1c06b7e0 msgr2=0x7f2e1c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:58.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e21cb9700 1 -- 172.21.15.149:0/236235274 shutdown_connections 2023-06-09T04:36:58.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.011+0000 7f2e21cb9700 1 -- 172.21.15.149:0/236235274 wait complete. 2023-06-09T04:36:58.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.014+0000 7f2e21cb9700 1 Processor -- start 2023-06-09T04:36:58.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.014+0000 7f2e21cb9700 1 -- start start 2023-06-09T04:36:58.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e21cb9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0afa30 0x7f2e1c156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e21cb9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e1c0b0c40 0x7f2e1c0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e21cb9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e1c0cd980 0x7f2e1c15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e21cb9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0ada90 con 0x7f2e1c0afa30 2023-06-09T04:36:58.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e21cb9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0ace10 con 0x7f2e1c0b0c40 2023-06-09T04:36:58.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e21cb9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c0ad0f0 con 0x7f2e1c0cd980 2023-06-09T04:36:58.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0afa30 0x7f2e1c156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0afa30 0x7f2e1c156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35982/0 (socket says 172.21.15.149:35982) 2023-06-09T04:36:58.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 -- 172.21.15.149:0/1173761628 learned_addr learned my addr 172.21.15.149:0/1173761628 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:58.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1bfff700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e1c0cd980 0x7f2e1c15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1affd700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e1c0b0c40 0x7f2e1c0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 -- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e1c0cd980 msgr2=0x7f2e1c15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e1c0cd980 0x7f2e1c15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 -- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e1c0b0c40 msgr2=0x7f2e1c0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e1c0b0c40 0x7f2e1c0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1b7fe700 1 -- 172.21.15.149:0/1173761628 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100094a0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.015+0000 7f2e1affd700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e1c0b0c40 0x7f2e1c0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.016+0000 7f2e1b7fe700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0afa30 0x7f2e1c156510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c700 tx=0x7f2e0c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.016+0000 7f2e03fff700 1 -- 172.21.15.149:0/1173761628 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0074e0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.016+0000 7f2e03fff700 1 -- 172.21.15.149:0/1173761628 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c007640 con 0x7f2e1c0afa30 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.016+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c0ad3d0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.016+0000 7f2e03fff700 1 -- 172.21.15.149:0/1173761628 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c005a30 con 0x7f2e1c0afa30 2023-06-09T04:36:58.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.016+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c0aeff0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.017+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1c0adbd0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.017+0000 7f2e03fff700 1 -- 172.21.15.149:0/1173761628 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e0c005b90 con 0x7f2e1c0afa30 2023-06-09T04:36:58.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.017+0000 7f2e03fff700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2e0806ace0 0x7f2e0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.018+0000 7f2e03fff700 1 -- 172.21.15.149:0/1173761628 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e0c088b20 con 0x7f2e1c0afa30 2023-06-09T04:36:58.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.018+0000 7f2e1affd700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2e0806ace0 0x7f2e0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.018+0000 7f2e1affd700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2e0806ace0 0x7f2e0806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c070840 tx=0x7f2e10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.022+0000 7f2e03fff700 1 -- 172.21.15.149:0/1173761628 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e1c0adbd0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.211+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e1c0adbd0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.212+0000 7f2e03fff700 1 -- 172.21.15.149:0/1173761628 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f2e1c0adbd0 con 0x7f2e1c0afa30 2023-06-09T04:36:58.213 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:58.214 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2e0806ace0 msgr2=0x7f2e0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2e0806ace0 0x7f2e0806d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c070840 tx=0x7f2e10008030 comp rx=0 tx=0).stop 2023-06-09T04:36:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0afa30 msgr2=0x7f2e1c156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0afa30 0x7f2e1c156510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c700 tx=0x7f2e0c00cac0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 shutdown_connections 2023-06-09T04:36:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2e0806ace0 0x7f2e0806d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2e1c0cd980 0x7f2e1c15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2e1c0afa30 0x7f2e1c156510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 --2- 172.21.15.149:0/1173761628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e1c0b0c40 0x7f2e1c0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 >> 172.21.15.149:0/1173761628 conn(0x7f2e1c06b7e0 msgr2=0x7f2e1c0cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 shutdown_connections 2023-06-09T04:36:58.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.214+0000 7f2e21cb9700 1 -- 172.21.15.149:0/1173761628 wait complete. 2023-06-09T04:36:58.228 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:58.334 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:36:58.336 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:36:58.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.347+0000 7f2c841e0700 1 Processor -- start 2023-06-09T04:36:58.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.347+0000 7f2c841e0700 1 -- start start 2023-06-09T04:36:58.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.348+0000 7f2c841e0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c7c15c590 0x7f2c7c0af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.348+0000 7f2c841e0700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2c7c0ccba0 0x7f2c7c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.348+0000 7f2c841e0700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0af050 con 0x7f2c7c069db0 2023-06-09T04:36:58.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.348+0000 7f2c841e0700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0afae0 con 0x7f2c7c15c590 2023-06-09T04:36:58.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.348+0000 7f2c841e0700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0af800 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.348+0000 7f2c81f7c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2c7c15c590 0x7f2c7c0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.348+0000 7f2c8277d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2c7c069db0 0x7f2c7c15fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59858/0 (socket says 172.21.15.149:59858) 2023-06-09T04:36:58.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c8277d700 1 -- 172.21.15.149:0/839251085 learned_addr learned my addr 172.21.15.149:0/839251085 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:58.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c8177b700 1 --2- 172.21.15.149:0/839251085 >> v2:172.21.15.184:3300/0 conn(0x7f2c7c0ccba0 0x7f2c7c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c81f7c700 1 -- 172.21.15.149:0/839251085 >> v2:172.21.15.184:3300/0 conn(0x7f2c7c0ccba0 msgr2=0x7f2c7c0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:58.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c81f7c700 1 --2- 172.21.15.149:0/839251085 >> v2:172.21.15.184:3300/0 conn(0x7f2c7c0ccba0 0x7f2c7c0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c81f7c700 1 -- 172.21.15.149:0/839251085 >> v1:172.21.15.149:6789/0 conn(0x7f2c7c069db0 legacy=0x7f2c7c15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c81f7c700 1 -- 172.21.15.149:0/839251085 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0cc0c0 con 0x7f2c7c15c590 2023-06-09T04:36:58.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c80f7a700 1 -- 172.21.15.149:0/839251085 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181050784 0 0) 0x7f2c7c0af050 con 0x7f2c7c069db0 2023-06-09T04:36:58.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c81f7c700 1 --2- 172.21.15.149:0/839251085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c15c590 0x7f2c7c0af220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0b21e0 tx=0x7f2c78009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2816b0d33334ca3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c80f7a700 1 -- 172.21.15.149:0/839251085 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78005e30 con 0x7f2c7c15c590 2023-06-09T04:36:58.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c80f7a700 1 -- 172.21.15.149:0/839251085 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c78006030 con 0x7f2c7c15c590 2023-06-09T04:36:58.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.349+0000 7f2c80f7a700 1 -- 172.21.15.149:0/839251085 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780063c0 con 0x7f2c7c15c590 2023-06-09T04:36:58.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 -- 172.21.15.149:0/839251085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c15c590 msgr2=0x7f2c7c0af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 --2- 172.21.15.149:0/839251085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c15c590 0x7f2c7c0af220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0b21e0 tx=0x7f2c78009b00 comp rx=0 tx=0).stop 2023-06-09T04:36:58.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 -- 172.21.15.149:0/839251085 shutdown_connections 2023-06-09T04:36:58.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 --2- 172.21.15.149:0/839251085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c15c590 0x7f2c7c0af220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 --2- 172.21.15.149:0/839251085 >> v2:172.21.15.184:3300/0 conn(0x7f2c7c0ccba0 0x7f2c7c0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 -- 172.21.15.149:0/839251085 >> 172.21.15.149:0/839251085 conn(0x7f2c7c06b7e0 msgr2=0x7f2c7c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:58.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 -- 172.21.15.149:0/839251085 shutdown_connections 2023-06-09T04:36:58.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.350+0000 7f2c841e0700 1 -- 172.21.15.149:0/839251085 wait complete. 2023-06-09T04:36:58.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.351+0000 7f2c841e0700 1 Processor -- start 2023-06-09T04:36:58.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.351+0000 7f2c841e0700 1 -- start start 2023-06-09T04:36:58.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c841e0700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c7c069db0 0x7f2c7c0c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c841e0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c0ccba0 0x7f2c7c157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c841e0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c7c15c590 0x7f2c7c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c841e0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0c5230 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c841e0700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0c36f0 con 0x7f2c7c069db0 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c841e0700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1593f0 con 0x7f2c7c15c590 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c0ccba0 0x7f2c7c157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c0ccba0 0x7f2c7c157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35998/0 (socket says 172.21.15.149:35998) 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 -- 172.21.15.149:0/4091990812 learned_addr learned my addr 172.21.15.149:0/4091990812 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c81f7c700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c7c069db0 0x7f2c7c0c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8277d700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c7c15c590 0x7f2c7c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 -- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c7c15c590 msgr2=0x7f2c7c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c7c15c590 0x7f2c7c0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 -- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c7c069db0 msgr2=0x7f2c7c0c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c7c069db0 0x7f2c7c0c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 -- 172.21.15.149:0/4091990812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c78009430 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.352+0000 7f2c8177b700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c0ccba0 0x7f2c7c157990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00e9b0 tx=0x7f2c6c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.353+0000 7f2c727fc700 1 -- 172.21.15.149:0/4091990812 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c009710 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.353+0000 7f2c727fc700 1 -- 172.21.15.149:0/4091990812 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c00ee50 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.353+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c1596d0 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.353+0000 7f2c727fc700 1 -- 172.21.15.149:0/4091990812 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00ca50 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.353+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c159c90 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.354+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c159eb0 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.354+0000 7f2c727fc700 1 -- 172.21.15.149:0/4091990812 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c6c00cbb0 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.354+0000 7f2c727fc700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2c6006ace0 0x7f2c6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.355+0000 7f2c727fc700 1 -- 172.21.15.149:0/4091990812 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2c6c089760 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.355+0000 7f2c81f7c700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2c6006ace0 0x7f2c6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.355+0000 7f2c81f7c700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2c6006ace0 0x7f2c6006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c78000c00 tx=0x7f2c78008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.359+0000 7f2c727fc700 1 -- 172.21.15.149:0/4091990812 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c6c057fb0 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.548+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c7c073fa0 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.549+0000 7f2c727fc700 1 -- 172.21.15.149:0/4091990812 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f2c6c00ce60 con 0x7f2c7c0ccba0 2023-06-09T04:36:58.551 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:58.551 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:58.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2c6006ace0 msgr2=0x7f2c6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2c6006ace0 0x7f2c6006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2c78000c00 tx=0x7f2c78008070 comp rx=0 tx=0).stop 2023-06-09T04:36:58.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c0ccba0 msgr2=0x7f2c7c157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c0ccba0 0x7f2c7c157990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00e9b0 tx=0x7f2c6c00ecc0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 shutdown_connections 2023-06-09T04:36:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2c6006ace0 0x7f2c6006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2c7c15c590 0x7f2c7c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c7c069db0 0x7f2c7c0c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 --2- 172.21.15.149:0/4091990812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c7c0ccba0 0x7f2c7c157990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 >> 172.21.15.149:0/4091990812 conn(0x7f2c7c06b7e0 msgr2=0x7f2c7c0b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:58.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 shutdown_connections 2023-06-09T04:36:58.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.552+0000 7f2c841e0700 1 -- 172.21.15.149:0/4091990812 wait complete. 2023-06-09T04:36:58.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:36:58.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.697+0000 7f2218a9e700 1 Processor -- start 2023-06-09T04:36:58.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.698+0000 7f2218a9e700 1 -- start start 2023-06-09T04:36:58.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.698+0000 7f2218a9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2218a9e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f221415e8c0 con 0x7f221415e1a0 2023-06-09T04:36:58.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2218a9e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140afeb0 con 0x7f221415d280 2023-06-09T04:36:58.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2218a9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140b3fa0 con 0x7f221415d650 2023-06-09T04:36:58.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2212d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f221415e1a0 0x7f22140cc570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59872/0 (socket says 172.21.15.149:59872) 2023-06-09T04:36:58.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2212d9d700 1 -- 172.21.15.149:0/1525330544 learned_addr learned my addr 172.21.15.149:0/1525330544 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:58.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2211d9b700 1 --2- 172.21.15.149:0/1525330544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934033840 0 0) 0x7f221415e8c0 con 0x7f221415e1a0 2023-06-09T04:36:58.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21fc0035b0 con 0x7f221415e1a0 2023-06-09T04:36:58.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830528874 0 0) 0x7f2208001110 con 0x7f221415d280 2023-06-09T04:36:58.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f221415e8c0 con 0x7f221415d280 2023-06-09T04:36:58.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1893090740 0 0) 0x7f21fc0035b0 con 0x7f221415e1a0 2023-06-09T04:36:58.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2211d9b700 1 -- 172.21.15.149:0/1525330544 >> v1:172.21.15.184:6789/0 conn(0x7f221415d280 legacy=0x7f221415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2211d9b700 1 -- 172.21.15.149:0/1525330544 >> v1:172.21.15.149:6789/0 conn(0x7f221415e1a0 legacy=0x7f22140cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2211d9b700 1 -- 172.21.15.149:0/1525330544 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140cdb10 con 0x7f221415d650 2023-06-09T04:36:58.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f2211d9b700 1 --2- 172.21.15.149:0/1525330544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140af970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f2204009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11048fe540f45bf3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.699+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c001970 con 0x7f221415d650 2023-06-09T04:36:58.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204004030 con 0x7f221415d650 2023-06-09T04:36:58.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f221159a700 1 -- 172.21.15.149:0/1525330544 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040043c0 con 0x7f221415d650 2023-06-09T04:36:58.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f2218a9e700 1 -- 172.21.15.149:0/1525330544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 msgr2=0x7f22140af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f2218a9e700 1 --2- 172.21.15.149:0/1525330544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140af970 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f2204009b80 comp rx=0 tx=0).stop 2023-06-09T04:36:58.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f2218a9e700 1 -- 172.21.15.149:0/1525330544 shutdown_connections 2023-06-09T04:36:58.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f2218a9e700 1 --2- 172.21.15.149:0/1525330544 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140af970 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f2218a9e700 1 -- 172.21.15.149:0/1525330544 >> 172.21.15.149:0/1525330544 conn(0x7f2214069db0 msgr2=0x7f221406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:58.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f2218a9e700 1 -- 172.21.15.149:0/1525330544 shutdown_connections 2023-06-09T04:36:58.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.700+0000 7f2218a9e700 1 -- 172.21.15.149:0/1525330544 wait complete. 2023-06-09T04:36:58.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.701+0000 7f2218a9e700 1 Processor -- start 2023-06-09T04:36:58.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2218a9e700 1 -- start start 2023-06-09T04:36:58.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2218a9e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415d280 0x7f22140aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2218a9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2218a9e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f221415e1a0 0x7f2214154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2218a9e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221406bf00 con 0x7f221415e1a0 2023-06-09T04:36:58.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2218a9e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221406b610 con 0x7f221415d280 2023-06-09T04:36:58.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2218a9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221406b8b0 con 0x7f221415d650 2023-06-09T04:36:58.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2212d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f221415e1a0 0x7f2214154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2212d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f221415e1a0 0x7f2214154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36014/0 (socket says 172.21.15.149:36014) 2023-06-09T04:36:58.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2212d9d700 1 -- 172.21.15.149:0/3525813104 learned_addr learned my addr 172.21.15.149:0/3525813104 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:58.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f221259c700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415d280 0x7f22140aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.702+0000 7f2211d9b700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2212d9d700 1 -- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 msgr2=0x7f22140ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2212d9d700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2212d9d700 1 -- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415d280 msgr2=0x7f22140aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2212d9d700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415d280 0x7f22140aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2212d9d700 1 -- 172.21.15.149:0/3525813104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040094a0 con 0x7f221415e1a0 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f221259c700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415d280 0x7f22140aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2211d9b700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2212d9d700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f221415e1a0 0x7f2214154360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f220c00cb60 tx=0x7f220c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2202ffd700 1 -- 172.21.15.149:0/3525813104 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c00ab10 con 0x7f221415e1a0 2023-06-09T04:36:58.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2202ffd700 1 -- 172.21.15.149:0/3525813104 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c00ac70 con 0x7f221415e1a0 2023-06-09T04:36:58.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2202ffd700 1 -- 172.21.15.149:0/3525813104 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0070d0 con 0x7f221415e1a0 2023-06-09T04:36:58.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221406bb90 con 0x7f221415e1a0 2023-06-09T04:36:58.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.703+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22140c7d80 con 0x7f221415e1a0 2023-06-09T04:36:58.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.704+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221406c070 con 0x7f221415e1a0 2023-06-09T04:36:58.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.704+0000 7f2202ffd700 1 -- 172.21.15.149:0/3525813104 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f220c007230 con 0x7f221415e1a0 2023-06-09T04:36:58.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.705+0000 7f2202ffd700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f21f406ace0 0x7f21f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:58.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.705+0000 7f221259c700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f21f406ace0 0x7f21f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:58.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.705+0000 7f2202ffd700 1 -- 172.21.15.149:0/3525813104 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f220c0892d0 con 0x7f221415e1a0 2023-06-09T04:36:58.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.705+0000 7f221259c700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f21f406ace0 0x7f21f406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2208000f60 tx=0x7f2208009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:58.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.709+0000 7f2202ffd700 1 -- 172.21.15.149:0/3525813104 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f220c054090 con 0x7f221415e1a0 2023-06-09T04:36:58.738 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T04:36:58.738+0000 7f273e8bb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:36:58.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.938+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2214073fa0 con 0x7f221415e1a0 2023-06-09T04:36:58.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.938+0000 7f2202ffd700 1 -- 172.21.15.149:0/3525813104 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f220c0576b0 con 0x7f221415e1a0 2023-06-09T04:36:58.939 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:58.940 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:36:57.496440+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-09T04:36:58.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f21f406ace0 msgr2=0x7f21f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f21f406ace0 0x7f21f406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2208000f60 tx=0x7f2208009040 comp rx=0 tx=0).stop 2023-06-09T04:36:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f221415e1a0 msgr2=0x7f2214154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f221415e1a0 0x7f2214154360 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f220c00cb60 tx=0x7f220c00cf20 comp rx=0 tx=0).stop 2023-06-09T04:36:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 shutdown_connections 2023-06-09T04:36:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f21f406ace0 0x7f21f406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f221415e1a0 0x7f2214154360 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f221415d280 0x7f22140aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 --2- 172.21.15.149:0/3525813104 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f221415d650 0x7f22140ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:58.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 >> 172.21.15.149:0/3525813104 conn(0x7f2214069db0 msgr2=0x7f221406a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:58.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 shutdown_connections 2023-06-09T04:36:58.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:58.940+0000 7f2218a9e700 1 -- 172.21.15.149:0/3525813104 wait complete. 2023-06-09T04:36:58.943 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 7 2023-06-09T04:36:58.954 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:36:59.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.072+0000 7f3bec2a2700 1 Processor -- start 2023-06-09T04:36:59.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.072+0000 7f3bec2a2700 1 -- start start 2023-06-09T04:36:59.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bec2a2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3be4069db0 0x7f3be406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bec2a2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be40d0380 0x7f3be40aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bec2a2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be40acbe0 con 0x7f3be40ae580 2023-06-09T04:36:59.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bec2a2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be40ac2d0 con 0x7f3be4069db0 2023-06-09T04:36:59.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bec2a2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be406a6c0 con 0x7f3be40d0380 2023-06-09T04:36:59.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bea03e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3be4069db0 0x7f3be406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bea83f700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3be40ae580 0x7f3be40af010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59882/0 (socket says 172.21.15.149:59882) 2023-06-09T04:36:59.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3bea83f700 1 -- 172.21.15.149:0/3620640751 learned_addr learned my addr 172.21.15.149:0/3620640751 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:59.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.073+0000 7f3be983d700 1 --2- 172.21.15.149:0/3620640751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be40d0380 0x7f3be40aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3bea03e700 1 -- 172.21.15.149:0/3620640751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be40d0380 msgr2=0x7f3be40aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3bea03e700 1 --2- 172.21.15.149:0/3620640751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be40d0380 0x7f3be40aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3bea03e700 1 -- 172.21.15.149:0/3620640751 >> v1:172.21.15.149:6789/0 conn(0x7f3be40ae580 legacy=0x7f3be40af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3bea03e700 1 -- 172.21.15.149:0/3620640751 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40b0860 con 0x7f3be4069db0 2023-06-09T04:36:59.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3be903c700 1 -- 172.21.15.149:0/3620640751 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609672544 0 0) 0x7f3be40acbe0 con 0x7f3be40ae580 2023-06-09T04:36:59.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3bea03e700 1 --2- 172.21.15.149:0/3620640751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4069db0 0x7f3be406a180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009820 tx=0x7f3bd4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc9cc556be89536 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3be903c700 1 -- 172.21.15.149:0/3620640751 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4005e30 con 0x7f3be4069db0 2023-06-09T04:36:59.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3be903c700 1 -- 172.21.15.149:0/3620640751 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd4006030 con 0x7f3be4069db0 2023-06-09T04:36:59.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3be903c700 1 -- 172.21.15.149:0/3620640751 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40063e0 con 0x7f3be4069db0 2023-06-09T04:36:59.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3620640751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4069db0 msgr2=0x7f3be406a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.074+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3620640751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4069db0 0x7f3be406a180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009820 tx=0x7f3bd4009b30 comp rx=0 tx=0).stop 2023-06-09T04:36:59.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.075+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3620640751 shutdown_connections 2023-06-09T04:36:59.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.075+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3620640751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be4069db0 0x7f3be406a180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.075+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3620640751 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be40d0380 0x7f3be40aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.075+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3620640751 >> 172.21.15.149:0/3620640751 conn(0x7f3be406b7e0 msgr2=0x7f3be40cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.075+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3620640751 shutdown_connections 2023-06-09T04:36:59.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.075+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3620640751 wait complete. 2023-06-09T04:36:59.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.076+0000 7f3bec2a2700 1 Processor -- start 2023-06-09T04:36:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.076+0000 7f3bec2a2700 1 -- start start 2023-06-09T04:36:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.076+0000 7f3bec2a2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be4069db0 0x7f3be41f5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.076+0000 7f3bec2a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be40ae580 0x7f3be4146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.076+0000 7f3bec2a2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3be40d0380 0x7f3be40c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bec2a2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be41f6020 con 0x7f3be40ae580 2023-06-09T04:36:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bec2a2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40cd810 con 0x7f3be40d0380 2023-06-09T04:36:59.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bec2a2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40cdaf0 con 0x7f3be4069db0 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be40ae580 0x7f3be4146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be40ae580 0x7f3be4146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36024/0 (socket says 172.21.15.149:36024) 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 -- 172.21.15.149:0/3507587181 learned_addr learned my addr 172.21.15.149:0/3507587181 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bea83f700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3be40d0380 0x7f3be40c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bea03e700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be4069db0 0x7f3be41f5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 -- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be4069db0 msgr2=0x7f3be41f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be4069db0 0x7f3be41f5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 -- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3be40d0380 msgr2=0x7f3be40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3be40d0380 0x7f3be40c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 -- 172.21.15.149:0/3507587181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd4009430 con 0x7f3be40ae580 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bea03e700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be4069db0 0x7f3be41f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3be983d700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be40ae580 0x7f3be4146b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3be000e810 tx=0x7f3be000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bdaffd700 1 -- 172.21.15.149:0/3507587181 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0013610 con 0x7f3be40ae580 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bdaffd700 1 -- 172.21.15.149:0/3507587181 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0013770 con 0x7f3be40ae580 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be40cddd0 con 0x7f3be40ae580 2023-06-09T04:36:59.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bdaffd700 1 -- 172.21.15.149:0/3507587181 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0013b20 con 0x7f3be40ae580 2023-06-09T04:36:59.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.077+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be40ce390 con 0x7f3be40ae580 2023-06-09T04:36:59.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.078+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be40ce5b0 con 0x7f3be40ae580 2023-06-09T04:36:59.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.079+0000 7f3bdaffd700 1 -- 172.21.15.149:0/3507587181 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3be0013c80 con 0x7f3be40ae580 2023-06-09T04:36:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.079+0000 7f3bdaffd700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3bc806ace0 0x7f3bc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.079+0000 7f3bdaffd700 1 -- 172.21.15.149:0/3507587181 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3be0089490 con 0x7f3be40ae580 2023-06-09T04:36:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.079+0000 7f3bea03e700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3bc806ace0 0x7f3bc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.079+0000 7f3bea03e700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3bc806ace0 0x7f3bc806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3be40b0440 tx=0x7f3bd4008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.083+0000 7f3bdaffd700 1 -- 172.21.15.149:0/3507587181 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3be0054260 con 0x7f3be40ae580 2023-06-09T04:36:59.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.271+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3be4073fa0 con 0x7f3be40ae580 2023-06-09T04:36:59.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.272+0000 7f3bdaffd700 1 -- 172.21.15.149:0/3507587181 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f3be0057880 con 0x7f3be40ae580 2023-06-09T04:36:59.274 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:36:59.274 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:36:59.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3bc806ace0 msgr2=0x7f3bc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3bc806ace0 0x7f3bc806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3be40b0440 tx=0x7f3bd4008070 comp rx=0 tx=0).stop 2023-06-09T04:36:59.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be40ae580 msgr2=0x7f3be4146b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be40ae580 0x7f3be4146b90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3be000e810 tx=0x7f3be000ebd0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 shutdown_connections 2023-06-09T04:36:59.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3bc806ace0 0x7f3bc806d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3be4069db0 0x7f3be41f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3be40d0380 0x7f3be40c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 --2- 172.21.15.149:0/3507587181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3be40ae580 0x7f3be4146b90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 >> 172.21.15.149:0/3507587181 conn(0x7f3be406b7e0 msgr2=0x7f3be40aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 shutdown_connections 2023-06-09T04:36:59.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.274+0000 7f3bec2a2700 1 -- 172.21.15.149:0/3507587181 wait complete. 2023-06-09T04:36:59.689 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:36:53.063490+0000', 'modified': '2023-06-09T04:36:57.496440+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6833/1611193931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 1611193931}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 1611193931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-09T04:36:59.690 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:36:59.690 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-09T04:36:59.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.812+0000 7f3f3fc9a700 1 Processor -- start 2023-06-09T04:36:59.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.813+0000 7f3f3fc9a700 1 -- start start 2023-06-09T04:36:59.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.813+0000 7f3f3fc9a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3f38159260 0x7f3f38071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.813+0000 7f3f3fc9a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f380ca5f0 0x7f3f380716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.813+0000 7f3f3fc9a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380ceb10 con 0x7f3f380cc020 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.813+0000 7f3f3fc9a700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f380aeee0 con 0x7f3f380ca5f0 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.813+0000 7f3f3fc9a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f38159630 con 0x7f3f38159260 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3d235700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f380ca5f0 0x7f3f380716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3e237700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3f380cc020 0x7f3f380cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59894/0 (socket says 172.21.15.149:59894) 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3d235700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f380ca5f0 0x7f3f380716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36030/0 (socket says 172.21.15.149:36030) 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3e237700 1 -- 172.21.15.149:0/1196700386 learned_addr learned my addr 172.21.15.149:0/1196700386 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:36:59.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3da36700 1 --2- 172.21.15.149:0/1196700386 >> v2:172.21.15.184:3300/0 conn(0x7f3f38159260 0x7f3f38071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3d235700 1 -- 172.21.15.149:0/1196700386 >> v2:172.21.15.184:3300/0 conn(0x7f3f38159260 msgr2=0x7f3f38071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3d235700 1 --2- 172.21.15.149:0/1196700386 >> v2:172.21.15.184:3300/0 conn(0x7f3f38159260 0x7f3f38071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3d235700 1 -- 172.21.15.149:0/1196700386 >> v1:172.21.15.149:6789/0 conn(0x7f3f380cc020 legacy=0x7f3f380cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3d235700 1 -- 172.21.15.149:0/1196700386 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380ce680 con 0x7f3f380ca5f0 2023-06-09T04:36:59.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3ca34700 1 -- 172.21.15.149:0/1196700386 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373940124 0 0) 0x7f3f30001490 con 0x7f3f380cc020 2023-06-09T04:36:59.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3d235700 1 --2- 172.21.15.149:0/1196700386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380ca5f0 0x7f3f380716c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f38067240 tx=0x7f3f34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270990b32dd01815 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3ca34700 1 -- 172.21.15.149:0/1196700386 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011830 con 0x7f3f380ca5f0 2023-06-09T04:36:59.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3ca34700 1 -- 172.21.15.149:0/1196700386 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34011990 con 0x7f3f380ca5f0 2023-06-09T04:36:59.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.814+0000 7f3f3ca34700 1 -- 172.21.15.149:0/1196700386 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011d20 con 0x7f3f380ca5f0 2023-06-09T04:36:59.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/1196700386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380ca5f0 msgr2=0x7f3f380716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/1196700386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380ca5f0 0x7f3f380716c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f38067240 tx=0x7f3f34009b20 comp rx=0 tx=0).stop 2023-06-09T04:36:59.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/1196700386 shutdown_connections 2023-06-09T04:36:59.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/1196700386 >> v2:172.21.15.184:3300/0 conn(0x7f3f38159260 0x7f3f38071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/1196700386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f380ca5f0 0x7f3f380716c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/1196700386 >> 172.21.15.149:0/1196700386 conn(0x7f3f3806aec0 msgr2=0x7f3f3806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/1196700386 shutdown_connections 2023-06-09T04:36:59.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.815+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/1196700386 wait complete. 2023-06-09T04:36:59.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.816+0000 7f3f3fc9a700 1 Processor -- start 2023-06-09T04:36:59.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.816+0000 7f3f3fc9a700 1 -- start start 2023-06-09T04:36:59.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f380ca5f0 0x7f3f380c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f380cc020 0x7f3f3815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f38159260 0x7f3f381f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3815ca80 con 0x7f3f38159260 2023-06-09T04:36:59.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3815bf00 con 0x7f3f380cc020 2023-06-09T04:36:59.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3815c1e0 con 0x7f3f380ca5f0 2023-06-09T04:36:59.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f38159260 0x7f3f381f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f38159260 0x7f3f381f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36038/0 (socket says 172.21.15.149:36038) 2023-06-09T04:36:59.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 -- 172.21.15.149:0/4201388596 learned_addr learned my addr 172.21.15.149:0/4201388596 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:59.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3d235700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f380cc020 0x7f3f3815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3da36700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f380ca5f0 0x7f3f380c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 -- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f380ca5f0 msgr2=0x7f3f380c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f380ca5f0 0x7f3f380c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 -- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f380cc020 msgr2=0x7f3f3815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f380cc020 0x7f3f3815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 -- 172.21.15.149:0/4201388596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340094a0 con 0x7f3f38159260 2023-06-09T04:36:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3da36700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f380ca5f0 0x7f3f380c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:36:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3e237700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f38159260 0x7f3f381f2390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f30002210 tx=0x7f3f3000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f2e7fc700 1 -- 172.21.15.149:0/4201388596 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300070d0 con 0x7f3f38159260 2023-06-09T04:36:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f2e7fc700 1 -- 172.21.15.149:0/4201388596 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30007230 con 0x7f3f38159260 2023-06-09T04:36:59.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f3815c4c0 con 0x7f3f38159260 2023-06-09T04:36:59.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f2e7fc700 1 -- 172.21.15.149:0/4201388596 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300075e0 con 0x7f3f38159260 2023-06-09T04:36:59.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.817+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f380c9450 con 0x7f3f38159260 2023-06-09T04:36:59.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.819+0000 7f3f2e7fc700 1 -- 172.21.15.149:0/4201388596 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f30007740 con 0x7f3f38159260 2023-06-09T04:36:59.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.820+0000 7f3f2e7fc700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f1c06ace0 0x7f3f1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.820+0000 7f3f3da36700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f1c06ace0 0x7f3f1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.820+0000 7f3f2e7fc700 1 -- 172.21.15.149:0/4201388596 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f3008c500 con 0x7f3f38159260 2023-06-09T04:36:59.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.820+0000 7f3f3da36700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f1c06ace0 0x7f3f1c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800aa50 tx=0x7f3f28008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 Processor -- start 2023-06-09T04:36:59.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 -- start start 2023-06-09T04:36:59.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb59eb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb59efb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb5a38c70 0x559cb5a390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb58f53b0 con 0x559cb59ef2f0 2023-06-09T04:36:59.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb58f6c60 con 0x559cb59ef6c0 2023-06-09T04:36:59.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.822+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cb5949570 con 0x559cb5a38c70 2023-06-09T04:36:59.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb59eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb59eb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36042/0 (socket says 172.21.15.149:36042) 2023-06-09T04:36:59.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 -- 172.21.15.149:0/4238950100 learned_addr learned my addr 172.21.15.149:0/4238950100 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:59.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3e237700 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb5a38c70 0x559cb5a390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3d235700 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb59efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 -- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb5a38c70 msgr2=0x559cb5a390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb5a38c70 0x559cb5a390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 -- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 msgr2=0x559cb59efb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb59efb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 -- 172.21.15.149:0/4238950100 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cb5770d90 con 0x559cb59ef2f0 2023-06-09T04:36:59.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f3da36700 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb59eb310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800f8f0 tx=0x7f3f28012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8d310274e7d695 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f1b7fe700 1 -- 172.21.15.149:0/4238950100 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28014760 con 0x559cb59ef2f0 2023-06-09T04:36:59.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f1b7fe700 1 -- 172.21.15.149:0/4238950100 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28019070 con 0x559cb59ef2f0 2023-06-09T04:36:59.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.823+0000 7f3f1b7fe700 1 -- 172.21.15.149:0/4238950100 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28014ac0 con 0x559cb59ef2f0 2023-06-09T04:36:59.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/4238950100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 msgr2=0x559cb59eb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb59eb310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800f8f0 tx=0x7f3f28012000 comp rx=0 tx=0).stop 2023-06-09T04:36:59.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/4238950100 shutdown_connections 2023-06-09T04:36:59.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb5a38c70 0x559cb5a390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb59eb310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/4238950100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb59efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/4238950100 >> 172.21.15.149:0/4238950100 conn(0x559cb59edce0 msgr2=0x559cb5a364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/4238950100 shutdown_connections 2023-06-09T04:36:59.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/4238950100 wait complete. 2023-06-09T04:36:59.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 -- start start 2023-06-09T04:36:59.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.824+0000 7f3f4be1fb80 1 Processor -- start 2023-06-09T04:36:59.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb5a12e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef6c0 0x559cb5a15160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb5a38c70 0x559cb5a1c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb5942a00 con 0x559cb59ef2f0 2023-06-09T04:36:59.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb58e2a70 con 0x559cb5a38c70 2023-06-09T04:36:59.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cb58e2770 con 0x559cb59ef6c0 2023-06-09T04:36:59.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f4be1fb80 10 client.0 _ll_register_callbacks cb 0x559cb58e0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:36:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f3da36700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb5a12e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f3da36700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb5a12e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36048/0 (socket says 172.21.15.149:36048) 2023-06-09T04:36:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.825+0000 7f3f3da36700 1 -- 172.21.15.149:0/3891997044 learned_addr learned my addr 172.21.15.149:0/3891997044 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3d235700 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef6c0 0x559cb5a15160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3e237700 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb5a38c70 0x559cb5a1c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3da36700 1 -- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef6c0 msgr2=0x559cb5a15160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3da36700 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef6c0 0x559cb5a15160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3da36700 1 -- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb5a38c70 msgr2=0x559cb5a1c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3da36700 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb5a38c70 0x559cb5a1c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3da36700 1 -- 172.21.15.149:0/3891997044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2800e040 con 0x559cb59ef2f0 2023-06-09T04:36:59.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f3da36700 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb5a12e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800f4c0 tx=0x7f3f28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64a50e2d8e2a4db server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-06-09T04:36:59.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f18ff9700 1 -- 172.21.15.149:0/3891997044 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28005e30 con 0x559cb59ef2f0 2023-06-09T04:36:59.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f18ff9700 1 -- 172.21.15.149:0/3891997044 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f28014e10 con 0x559cb59ef2f0 2023-06-09T04:36:59.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cb59e3850 con 0x559cb59ef2f0 2023-06-09T04:36:59.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f18ff9700 1 -- 172.21.15.149:0/3891997044 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f28006070 con 0x559cb59ef2f0 2023-06-09T04:36:59.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f4be1fb80 10 client.4428 fetch_fsmap learned FSMap version 7 2023-06-09T04:36:59.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559cb5759c10 con 0x559cb59ef2f0 2023-06-09T04:36:59.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f18ff9700 1 -- 172.21.15.149:0/3891997044 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cb59e3850 con 0x559cb59ef2f0 2023-06-09T04:36:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f18ff9700 1 -- 172.21.15.149:0/3891997044 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3f28030020 con 0x559cb59ef2f0 2023-06-09T04:36:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f4be1fb80 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-06-09T04:36:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f4be1fb80 10 client.4428 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:36:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.826+0000 7f3f4be1fb80 20 client.4428 populate_metadata read hostname 'smithi149' 2023-06-09T04:36:59.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.827+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a133d0 0x559cb5a1a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.827+0000 7f3f4be1fb80 4 client.4428 mds_command: new command op to 4270 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:36:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.827+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 --> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559cb593b9e0 con 0x559cb5a133d0 2023-06-09T04:36:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.827+0000 7f3f3d235700 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a133d0 0x559cb5a1a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.827+0000 7f3f18ff9700 10 client.4428 ms_handle_connect on v2:172.21.15.184:6832/1611193931 2023-06-09T04:36:59.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.827+0000 7f3f3d235700 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a133d0 0x559cb5a1a700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=667282e4b61674e1 server_cookie=811e4df7d4aa8007 in_seq=0 out_seq=0 2023-06-09T04:36:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f18ff9700 1 -- 172.21.15.149:0/3891997044 <== mds.0 v2:172.21.15.184:6832/1611193931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559cb593b9e0 con 0x559cb5a133d0 2023-06-09T04:36:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f18ff9700 10 client.4428 handle_command_reply: tid=0 2023-06-09T04:36:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 client.4428 shutdown 2023-06-09T04:36:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 msgr2=0x559cb5a12e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb5a12e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800f4c0 tx=0x7f3f28016000 comp rx=0 tx=0).stop 2023-06-09T04:36:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 shutdown_connections 2023-06-09T04:36:59.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a133d0 0x559cb5a1a700 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb5a38c70 0x559cb5a1c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f18ff9700 0 client.4428 ms_handle_reset on v2:172.21.15.184:6832/1611193931 2023-06-09T04:36:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb59ef2f0 0x559cb5a12e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/3891997044 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef6c0 0x559cb5a15160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 >> 172.21.15.149:0/3891997044 conn(0x559cb59edce0 msgr2=0x559cb5a36420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 shutdown_connections 2023-06-09T04:36:59.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/3891997044 wait complete. 2023-06-09T04:36:59.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.828+0000 7f3f4be1fb80 20 client.4428 trim_cache size 0 max 16384 2023-06-09T04:36:59.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 Processor -- start 2023-06-09T04:36:59.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 -- start start 2023-06-09T04:36:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5a37b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a1a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a1ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb57c68d0 con 0x559cb5a38c70 2023-06-09T04:36:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb5a1f9b0 con 0x559cb59ef6c0 2023-06-09T04:36:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cb59ebf60 con 0x559cb59ef2f0 2023-06-09T04:36:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f3e237700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a1ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f3e237700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a1ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36060/0 (socket says 172.21.15.149:36060) 2023-06-09T04:36:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.846+0000 7f3f3e237700 1 -- 172.21.15.149:0/2414844637 learned_addr learned my addr 172.21.15.149:0/2414844637 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3d235700 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a1a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3da36700 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5a37b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3e237700 1 -- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 msgr2=0x559cb5a37b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3e237700 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5a37b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3e237700 1 -- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 msgr2=0x559cb5a1a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3e237700 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a1a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3e237700 1 -- 172.21.15.149:0/2414844637 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cb5797200 con 0x559cb5a38c70 2023-06-09T04:36:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3d235700 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:36:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f3e237700 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a1ae70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f30057510 tx=0x7f3f3000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7ad8f7b88b158f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.852 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f1bfff700 1 -- 172.21.15.149:0/2414844637 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30059150 con 0x559cb5a38c70 2023-06-09T04:36:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f1bfff700 1 -- 172.21.15.149:0/2414844637 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300593b0 con 0x559cb5a38c70 2023-06-09T04:36:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f1bfff700 1 -- 172.21.15.149:0/2414844637 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300630f0 con 0x559cb5a38c70 2023-06-09T04:36:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/2414844637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 msgr2=0x559cb5a1ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a1ae70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3f30057510 tx=0x7f3f3000cf60 comp rx=0 tx=0).stop 2023-06-09T04:36:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/2414844637 shutdown_connections 2023-06-09T04:36:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5a37b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a1ae70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/2414844637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.847+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/2414844637 >> 172.21.15.149:0/2414844637 conn(0x559cb59edce0 msgr2=0x559cb59ec150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.848+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/2414844637 shutdown_connections 2023-06-09T04:36:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.848+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/2414844637 wait complete. 2023-06-09T04:36:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.848+0000 7f3f4be1fb80 1 -- start start 2023-06-09T04:36:59.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.848+0000 7f3f4be1fb80 1 Processor -- start 2023-06-09T04:36:59.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5aa0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a9acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f4be1fb80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a48370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb5aa14f0 con 0x559cb5a38c70 2023-06-09T04:36:59.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cb5a9da40 con 0x559cb59ef6c0 2023-06-09T04:36:59.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f4be1fb80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cb5a9dc90 con 0x559cb59ef2f0 2023-06-09T04:36:59.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f4be1fb80 10 client.0 _ll_register_callbacks cb 0x559cb58e0630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:36:59.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a48370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a48370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36066/0 (socket says 172.21.15.149:36066) 2023-06-09T04:36:59.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 -- 172.21.15.149:0/886606990 learned_addr learned my addr 172.21.15.149:0/886606990 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:59.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3d235700 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a9acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3da36700 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5aa0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 -- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 msgr2=0x559cb5aa0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5aa0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 -- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 msgr2=0x559cb5a9acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a9acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.849+0000 7f3f3e237700 1 -- 172.21.15.149:0/886606990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f380c9450 con 0x559cb5a38c70 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f3e237700 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a48370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f30001970 tx=0x7f3f3008a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625b15f08a901627 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f18ff9700 1 -- 172.21.15.149:0/886606990 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3005ade0 con 0x559cb5a38c70 2023-06-09T04:36:59.859 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f18ff9700 1 -- 172.21.15.149:0/886606990 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f3008c070 con 0x559cb5a38c70 2023-06-09T04:36:59.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f28019070 con 0x559cb5a38c70 2023-06-09T04:36:59.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f18ff9700 1 -- 172.21.15.149:0/886606990 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f3008c230 con 0x559cb5a38c70 2023-06-09T04:36:59.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 10 client.4434 fetch_fsmap learned FSMap version 7 2023-06-09T04:36:59.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559cb576f260 con 0x559cb5a38c70 2023-06-09T04:36:59.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f18ff9700 1 -- 172.21.15.149:0/886606990 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30083080 con 0x559cb5a38c70 2023-06-09T04:36:59.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f18ff9700 1 -- 172.21.15.149:0/886606990 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3f30056e00 con 0x559cb5a38c70 2023-06-09T04:36:59.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 10 client.4434 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 20 client.4434 populate_metadata read hostname 'smithi149' 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a48950 0x559cb5a16ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 4 client.4434 mds_command: new command op to 4270 tid=0[{"prefix": "status"}] 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 --> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559cb58fe000 con 0x559cb5a48950 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.850+0000 7f3f3da36700 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a48950 0x559cb5a16ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f18ff9700 10 client.4434 ms_handle_connect on v2:172.21.15.184:6832/1611193931 2023-06-09T04:36:59.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f3da36700 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a48950 0x559cb5a16ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4546a7faae630b91 server_cookie=8f11bfea7058d795 in_seq=0 out_seq=0 2023-06-09T04:36:59.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f18ff9700 1 -- 172.21.15.149:0/886606990 <== mds.0 v2:172.21.15.184:6832/1611193931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x559cb58fe000 con 0x559cb5a48950 2023-06-09T04:36:59.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f18ff9700 10 client.4434 handle_command_reply: tid=0 2023-06-09T04:36:59.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 client.4434 shutdown 2023-06-09T04:36:59.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 msgr2=0x559cb5a48370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a48370 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f30001970 tx=0x7f3f3008a540 comp rx=0 tx=0).stop 2023-06-09T04:36:59.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 shutdown_connections 2023-06-09T04:36:59.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x559cb5a48950 0x559cb5a16ff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x559cb59ef2f0 0x559cb5aa0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559cb5a38c70 0x559cb5a48370 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f18ff9700 0 client.4434 ms_handle_reset on v2:172.21.15.184:6832/1611193931 2023-06-09T04:36:59.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 --2- 172.21.15.149:0/886606990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559cb59ef6c0 0x559cb5a9acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 >> 172.21.15.149:0/886606990 conn(0x559cb59edce0 msgr2=0x559cb59f2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 shutdown_connections 2023-06-09T04:36:59.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 1 -- 172.21.15.149:0/886606990 wait complete. 2023-06-09T04:36:59.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.851+0000 7f3f4be1fb80 20 client.4434 trim_cache size 0 max 16384 2023-06-09T04:36:59.864 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-06-09T04:36:59.864 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "8958df92-450c-4c1c-8166-a5a3573afffd", 2023-06-09T04:36:59.864 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-06-09T04:36:59.864 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4270, 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 6.7863265689999999, 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 7, 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 26, 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 25, 2023-06-09T04:36:59.865 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 12.123159807 2023-06-09T04:36:59.866 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-06-09T04:36:59.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f1c06ace0 msgr2=0x7f3f1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f1c06ace0 0x7f3f1c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800aa50 tx=0x7f3f28008040 comp rx=0 tx=0).stop 2023-06-09T04:36:59.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f38159260 msgr2=0x7f3f381f2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f38159260 0x7f3f381f2390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f30002210 tx=0x7f3f3000c550 comp rx=0 tx=0).stop 2023-06-09T04:36:59.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 shutdown_connections 2023-06-09T04:36:59.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f1c06ace0 0x7f3f1c06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f380ca5f0 0x7f3f380c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f38159260 0x7f3f381f2390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 --2- 172.21.15.149:0/4201388596 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f380cc020 0x7f3f3815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 >> 172.21.15.149:0/4201388596 conn(0x7f3f3806aec0 msgr2=0x7f3f380b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 shutdown_connections 2023-06-09T04:36:59.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.852+0000 7f3f3fc9a700 1 -- 172.21.15.149:0/4201388596 wait complete. 2023-06-09T04:36:59.869 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:36:59.869 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:36:59.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:36:59.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.989+0000 7f0430416700 1 Processor -- start 2023-06-09T04:36:59.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.989+0000 7f0430416700 1 -- start start 2023-06-09T04:36:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f0430416700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280afa30 0x7f04280b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f0430416700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f04280b0c40 0x7f04280cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:36:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f0430416700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280b01a0 con 0x7f04280cf140 2023-06-09T04:36:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f0430416700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280b06f0 con 0x7f04280b0c40 2023-06-09T04:36:59.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f0430416700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04280b0900 con 0x7f04280afa30 2023-06-09T04:36:59.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042e1b2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280afa30 0x7f04280b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042d9b1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f04280b0c40 0x7f04280cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:36:59.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042e1b2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280afa30 0x7f04280b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:41682/0 (socket says 172.21.15.149:41682) 2023-06-09T04:36:59.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042e1b2700 1 -- 172.21.15.149:0/3006777770 learned_addr learned my addr 172.21.15.149:0/3006777770 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:36:59.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042e1b2700 1 -- 172.21.15.149:0/3006777770 >> v2:172.21.15.184:3300/0 conn(0x7f04280b0c40 msgr2=0x7f04280cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:36:59.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042e1b2700 1 --2- 172.21.15.149:0/3006777770 >> v2:172.21.15.184:3300/0 conn(0x7f04280b0c40 0x7f04280cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042e1b2700 1 -- 172.21.15.149:0/3006777770 >> v1:172.21.15.184:6789/0 conn(0x7f04280cf140 legacy=0x7f04280cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.990+0000 7f042e1b2700 1 -- 172.21.15.149:0/3006777770 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280ca7a0 con 0x7f04280afa30 2023-06-09T04:36:59.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f042e1b2700 1 --2- 172.21.15.149:0/3006777770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280afa30 0x7f04280b24f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f042400be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b8fd95873e1ace server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:36:59.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f042d1b0700 1 -- 172.21.15.149:0/3006777770 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424005e30 con 0x7f04280afa30 2023-06-09T04:36:59.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f042d1b0700 1 -- 172.21.15.149:0/3006777770 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424004030 con 0x7f04280afa30 2023-06-09T04:36:59.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f042d1b0700 1 -- 172.21.15.149:0/3006777770 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04240043e0 con 0x7f04280afa30 2023-06-09T04:36:59.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 -- 172.21.15.149:0/3006777770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280afa30 msgr2=0x7f04280b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:36:59.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 --2- 172.21.15.149:0/3006777770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280afa30 0x7f04280b24f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0424006fd0 tx=0x7f042400be70 comp rx=0 tx=0).stop 2023-06-09T04:36:59.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 -- 172.21.15.149:0/3006777770 shutdown_connections 2023-06-09T04:36:59.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 --2- 172.21.15.149:0/3006777770 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280afa30 0x7f04280b24f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 --2- 172.21.15.149:0/3006777770 >> v2:172.21.15.184:3300/0 conn(0x7f04280b0c40 0x7f04280cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:36:59.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 -- 172.21.15.149:0/3006777770 >> 172.21.15.149:0/3006777770 conn(0x7f042806b7e0 msgr2=0x7f04280cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:36:59.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 -- 172.21.15.149:0/3006777770 shutdown_connections 2023-06-09T04:36:59.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.991+0000 7f0430416700 1 -- 172.21.15.149:0/3006777770 wait complete. 2023-06-09T04:36:59.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 Processor -- start 2023-06-09T04:36:59.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 -- start start 2023-06-09T04:37:00.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04280afa30 0x7f04280aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:00.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280b0c40 0x7f04280c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:00.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cf140 0x7f04280c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:00.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280ae9c0 con 0x7f04280afa30 2023-06-09T04:37:00.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280add40 con 0x7f04280b0c40 2023-06-09T04:37:00.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f0430416700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04280ae020 con 0x7f04280cf140 2023-06-09T04:37:00.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f042e1b2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04280afa30 0x7f04280aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:00.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f042e1b2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04280afa30 0x7f04280aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36076/0 (socket says 172.21.15.149:36076) 2023-06-09T04:37:00.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f042e1b2700 1 -- 172.21.15.149:0/3489383771 learned_addr learned my addr 172.21.15.149:0/3489383771 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:00.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.993+0000 7f042d9b1700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280b0c40 0x7f04280c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:00.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f042e9b3700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cf140 0x7f04280c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:00.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f042e1b2700 1 -- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cf140 msgr2=0x7f04280c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:00.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f042e1b2700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cf140 0x7f04280c4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:00.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f042e1b2700 1 -- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280b0c40 msgr2=0x7f04280c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:00.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f042e1b2700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280b0c40 0x7f04280c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:00.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f042e1b2700 1 -- 172.21.15.149:0/3489383771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042400b7a0 con 0x7f04280afa30 2023-06-09T04:37:00.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f042e1b2700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04280afa30 0x7f04280aede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f042400b340 tx=0x7f0424004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:00.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f041effd700 1 -- 172.21.15.149:0/3489383771 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042401e070 con 0x7f04280afa30 2023-06-09T04:37:00.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f041effd700 1 -- 172.21.15.149:0/3489383771 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04240038b0 con 0x7f04280afa30 2023-06-09T04:37:00.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04280ae300 con 0x7f04280afa30 2023-06-09T04:37:00.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f041effd700 1 -- 172.21.15.149:0/3489383771 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424003c80 con 0x7f04280afa30 2023-06-09T04:37:00.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.994+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04280ad9d0 con 0x7f04280afa30 2023-06-09T04:37:00.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.995+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04280af320 con 0x7f04280afa30 2023-06-09T04:37:00.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.995+0000 7f041effd700 1 -- 172.21.15.149:0/3489383771 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f04240193f0 con 0x7f04280afa30 2023-06-09T04:37:00.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.996+0000 7f041effd700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f040c06ace0 0x7f040c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:00.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.996+0000 7f041effd700 1 -- 172.21.15.149:0/3489383771 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f042408a690 con 0x7f04280afa30 2023-06-09T04:37:00.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.996+0000 7f042d9b1700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f040c06ace0 0x7f040c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:00.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:36:59.996+0000 7f042d9b1700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f040c06ace0 0x7f040c06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f04280c5c10 tx=0x7f0418009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:00.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.000+0000 7f041effd700 1 -- 172.21.15.149:0/3489383771 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f04280af320 con 0x7f04280afa30 2023-06-09T04:37:00.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.230+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f04280af320 con 0x7f04280afa30 2023-06-09T04:37:00.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.230+0000 7f041effd700 1 -- 172.21.15.149:0/3489383771 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f04280af320 con 0x7f04280afa30 2023-06-09T04:37:00.232 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:37:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f040c06ace0 msgr2=0x7f040c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:00.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f040c06ace0 0x7f040c06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f04280c5c10 tx=0x7f0418009210 comp rx=0 tx=0).stop 2023-06-09T04:37:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04280afa30 msgr2=0x7f04280aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:00.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04280afa30 0x7f04280aede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f042400b340 tx=0x7f0424004750 comp rx=0 tx=0).stop 2023-06-09T04:37:00.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 shutdown_connections 2023-06-09T04:37:00.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f040c06ace0 0x7f040c06d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:00.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f04280cf140 0x7f04280c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:00.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04280afa30 0x7f04280aede0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:00.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 --2- 172.21.15.149:0/3489383771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04280b0c40 0x7f04280c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:00.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 >> 172.21.15.149:0/3489383771 conn(0x7f042806b7e0 msgr2=0x7f042806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:00.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 shutdown_connections 2023-06-09T04:37:00.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:00.233+0000 7f0430416700 1 -- 172.21.15.149:0/3489383771 wait complete. 2023-06-09T04:37:00.246 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-09T04:37:00.247 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:37:00.247 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-06-09T04:37:00.248 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-09T04:37:00.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:37:00.248 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-09T04:37:00.249 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:37:00.249 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:37:00.250 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-09T04:37:00.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.251 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-06-09T04:37:00.269 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:00.269 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:00.270 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:00.270 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:00.270 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:00.271 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:00.271 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:00.271 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:00.272 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:00.272 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:00.272 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:00.272 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:00.273 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:37:00.273 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:00.273 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:37:00.273 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42293sec preferred_lft 42293sec 2023-06-09T04:37:00.274 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c1e6:9d48:acd9:41ca/64 scope link noprefixroute 2023-06-09T04:37:00.274 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:00.274 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:37:00.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.275 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:00.275 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:00.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:37:00.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2023-06-09T04:37:00.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2023-06-09T04:37:00.277 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:37:00.277 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:00.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.433 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:37:00.460 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-06-09T04:37:00.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.462 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-06-09T04:37:00.539 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-06-09T04:37:00.539 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:37:00.539 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:37:00.540 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:37:00.540 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:37:00.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.541 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:00.542 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:00.542 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:37:00.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:37:00.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:37:00.544 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:00.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.807 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-06-09T04:37:00.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.824 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-06-09T04:37:00.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.880 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:00.880 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:00.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-09T04:37:00.881 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-09T04:37:00.881 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:00.974 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-09T04:37:00.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:00.975 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:00.976 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:00.976 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-09T04:37:00.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:37:00.977 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-09T04:37:00.978 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-09T04:37:00.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-09T04:37:00.979 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:01.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:01.170 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:01.170 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:01.170 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-06-09T04:37:01.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:37:01.171 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:01.270 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-09T04:37:01.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:01.271 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:37:01.291 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-09T04:37:01.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:01.292 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:37:01.347 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2023-06-09T04:37:01.413 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:37:01.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:37:01.480 INFO:teuthology.orchestra.run.smithi149.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:37:01.481 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:37:01.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:01.482 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2023-06-09T04:37:01.538 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:37:01.538 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-09T04:37:01.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo modprobe fuse 2023-06-09T04:37:01.605 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:37:01.606 DEBUG:teuthology.orchestra.run.smithi149:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:37:01.672 INFO:teuthology.orchestra.run.smithi149.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:37:01.673 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:37:01.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:01.674 DEBUG:teuthology.orchestra.run.smithi149:> ls /sys/fs/fuse/connections 2023-06-09T04:37:01.675 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:2023-06-09T04:37:01.673+0000 7fd6ebe8a5c0 -1 init, newargv = 0x55febbfba3a0 newargc=15 2023-06-09T04:37:01.675 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:ceph-fuse[107848]: starting ceph client 2023-06-09T04:37:01.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:ceph-fuse[107848]: starting fuse 2023-06-09T04:37:01.691 INFO:teuthology.orchestra.run.smithi149.stdout:47 2023-06-09T04:37:01.692 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-06-09T04:37:01.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:37:01.692 DEBUG:teuthology.orchestra.run.smithi149:> import glob 2023-06-09T04:37:01.693 DEBUG:teuthology.orchestra.run.smithi149:> import re 2023-06-09T04:37:01.693 DEBUG:teuthology.orchestra.run.smithi149:> import os 2023-06-09T04:37:01.693 DEBUG:teuthology.orchestra.run.smithi149:> import subprocess 2023-06-09T04:37:01.694 DEBUG:teuthology.orchestra.run.smithi149:> 2023-06-09T04:37:01.694 DEBUG:teuthology.orchestra.run.smithi149:> def _find_admin_socket(client_name): 2023-06-09T04:37:01.694 DEBUG:teuthology.orchestra.run.smithi149:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-09T04:37:01.695 DEBUG:teuthology.orchestra.run.smithi149:> files = glob.glob(asok_path) 2023-06-09T04:37:01.695 DEBUG:teuthology.orchestra.run.smithi149:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-09T04:37:01.695 DEBUG:teuthology.orchestra.run.smithi149:> 2023-06-09T04:37:01.695 DEBUG:teuthology.orchestra.run.smithi149:> # Given a non-glob path, it better be there 2023-06-09T04:37:01.696 DEBUG:teuthology.orchestra.run.smithi149:> if "*" not in asok_path: 2023-06-09T04:37:01.696 DEBUG:teuthology.orchestra.run.smithi149:> assert(len(files) == 1) 2023-06-09T04:37:01.696 DEBUG:teuthology.orchestra.run.smithi149:> return files[0] 2023-06-09T04:37:01.697 DEBUG:teuthology.orchestra.run.smithi149:> 2023-06-09T04:37:01.697 DEBUG:teuthology.orchestra.run.smithi149:> for f in files: 2023-06-09T04:37:01.697 DEBUG:teuthology.orchestra.run.smithi149:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:37:01.697 DEBUG:teuthology.orchestra.run.smithi149:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:37:01.698 DEBUG:teuthology.orchestra.run.smithi149:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:37:01.698 DEBUG:teuthology.orchestra.run.smithi149:> contents = proc_f.read() 2023-06-09T04:37:01.698 DEBUG:teuthology.orchestra.run.smithi149:> if mountpoint in contents: 2023-06-09T04:37:01.698 DEBUG:teuthology.orchestra.run.smithi149:> return f 2023-06-09T04:37:01.699 DEBUG:teuthology.orchestra.run.smithi149:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:37:01.699 DEBUG:teuthology.orchestra.run.smithi149:> 2023-06-09T04:37:01.699 DEBUG:teuthology.orchestra.run.smithi149:> print(_find_admin_socket("client.admin")) 2023-06-09T04:37:01.700 DEBUG:teuthology.orchestra.run.smithi149:> ' 2023-06-09T04:37:01.814 INFO:teuthology.orchestra.run.smithi149.stdout:/var/run/ceph/ceph-client.admin.107848.asok 2023-06-09T04:37:01.997 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.107848.asok 2023-06-09T04:37:01.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:01.997 DEBUG:teuthology.orchestra.run.smithi149:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.107848.asok status 2023-06-09T04:37:02.153 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-06-09T04:37:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "metadata": { 2023-06-09T04:37:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:37:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:37:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "entity_id": "admin", 2023-06-09T04:37:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "hostname": "smithi149", 2023-06-09T04:37:02.154 INFO:teuthology.orchestra.run.smithi149.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-09T04:37:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "pid": "107848", 2023-06-09T04:37:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "root": "/" 2023-06-09T04:37:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:37:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_count": 0, 2023-06-09T04:37:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "dentry_pinned_count": 0, 2023-06-09T04:37:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4443, 2023-06-09T04:37:02.155 INFO:teuthology.orchestra.run.smithi149.stdout: "inst": { 2023-06-09T04:37:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "name": { 2023-06-09T04:37:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "client", 2023-06-09T04:37:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "num": 4443 2023-06-09T04:37:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:37:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2023-06-09T04:37:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2023-06-09T04:37:02.156 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 87939594 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": { 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "type": "v1", 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: "nonce": 87939594 2023-06-09T04:37:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "inst_str": "client.4443 192.168.0.1:0/87939594", 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "addr_str": "192.168.0.1:0/87939594", 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "inode_count": 1, 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_epoch": 7, 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch": 26, 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "blocklisted": false, 2023-06-09T04:37:02.158 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs" 2023-06-09T04:37:02.159 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-06-09T04:37:02.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:02.164 DEBUG:teuthology.orchestra.run.smithi149:> stat --file-system '--printf=%T 2023-06-09T04:37:02.164 DEBUG:teuthology.orchestra.run.smithi149:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:37:02.181 INFO:teuthology.orchestra.run.smithi149.stdout:fuseblk 2023-06-09T04:37:02.181 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:37:02.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:02.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:37:02.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:02.248 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-09T04:37:02.351 INFO:teuthology.orchestra.run.smithi149.stdout:# file: . 2023-06-09T04:37:02.351 INFO:teuthology.orchestra.run.smithi149.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-09T04:37:02.352 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:02.352 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:02.352 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:02.369 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:02.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.529+0000 7f99a080e700 1 Processor -- start 2023-06-09T04:37:02.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.529+0000 7f99a080e700 1 -- start start 2023-06-09T04:37:02.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f99a080e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f999c1589c0 0x7f999c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f99a080e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f999c159650 0x7f999c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f99a080e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f99a080e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c15d2a0 con 0x7f999c159650 2023-06-09T04:37:02.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f99a080e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c0cce80 con 0x7f999c1589c0 2023-06-09T04:37:02.532 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f99a080e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c0cd160 con 0x7f999c159ad0 2023-06-09T04:37:02.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f999c159650 0x7f999c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f999c159650 0x7f999c0709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36108/0 (socket says 172.21.15.149:36108) 2023-06-09T04:37:02.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 -- 172.21.15.149:0/307823294 learned_addr learned my addr 172.21.15.149:0/307823294 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:02.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f999ad9d700 1 --2- 172.21.15.149:0/307823294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f999a59c700 1 --2- 172.21.15.149:0/307823294 >> v2:172.21.15.184:3300/0 conn(0x7f999c1589c0 0x7f999c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 -- 172.21.15.149:0/307823294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 msgr2=0x7f999c070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:02.533 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 --2- 172.21.15.149:0/307823294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 -- 172.21.15.149:0/307823294 >> v2:172.21.15.184:3300/0 conn(0x7f999c1589c0 msgr2=0x7f999c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:02.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 --2- 172.21.15.149:0/307823294 >> v2:172.21.15.184:3300/0 conn(0x7f999c1589c0 0x7f999c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.530+0000 7f9999d9b700 1 -- 172.21.15.149:0/307823294 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0cd440 con 0x7f999c159650 2023-06-09T04:37:02.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f9999d9b700 1 --2- 172.21.15.149:0/307823294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c159650 0x7f999c0709a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f999c0cfa40 tx=0x7f998c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b09f147078e622 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:02.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f999959a700 1 -- 172.21.15.149:0/307823294 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c00dc20 con 0x7f999c159650 2023-06-09T04:37:02.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f999959a700 1 -- 172.21.15.149:0/307823294 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c00dd80 con 0x7f999c159650 2023-06-09T04:37:02.534 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f999959a700 1 -- 172.21.15.149:0/307823294 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c017630 con 0x7f999c159650 2023-06-09T04:37:02.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 -- 172.21.15.149:0/307823294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c159650 msgr2=0x7f999c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 --2- 172.21.15.149:0/307823294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c159650 0x7f999c0709a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f999c0cfa40 tx=0x7f998c00be70 comp rx=0 tx=0).stop 2023-06-09T04:37:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 -- 172.21.15.149:0/307823294 shutdown_connections 2023-06-09T04:37:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 --2- 172.21.15.149:0/307823294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 --2- 172.21.15.149:0/307823294 >> v2:172.21.15.184:3300/0 conn(0x7f999c1589c0 0x7f999c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 --2- 172.21.15.149:0/307823294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c159650 0x7f999c0709a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 -- 172.21.15.149:0/307823294 >> 172.21.15.149:0/307823294 conn(0x7f999c0ceed0 msgr2=0x7f999c0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 -- 172.21.15.149:0/307823294 shutdown_connections 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.531+0000 7f99a080e700 1 -- 172.21.15.149:0/307823294 wait complete. 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 Processor -- start 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 -- start start 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c1589c0 0x7f999c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999c159650 0x7f999c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c15a2d0 con 0x7f999c1589c0 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c15a5b0 con 0x7f999c159650 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.533+0000 7f99a080e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c15a890 con 0x7f999c159ad0 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c1589c0 0x7f999c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c1589c0 0x7f999c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36112/0 (socket says 172.21.15.149:36112) 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 -- 172.21.15.149:0/1569372031 learned_addr learned my addr 172.21.15.149:0/1569372031 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999ad9d700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f9999d9b700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999c159650 0x7f999c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 -- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 msgr2=0x7f999c0ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c0ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 -- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999c159650 msgr2=0x7f999c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999c159650 0x7f999c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 -- 172.21.15.149:0/1569372031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c00b7f0 con 0x7f999c1589c0 2023-06-09T04:37:02.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f999a59c700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c1589c0 0x7f999c0b3c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f999000d800 tx=0x7f999000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:02.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f998affd700 1 -- 172.21.15.149:0/1569372031 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900125f0 con 0x7f999c1589c0 2023-06-09T04:37:02.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f998affd700 1 -- 172.21.15.149:0/1569372031 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990012750 con 0x7f999c1589c0 2023-06-09T04:37:02.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c15ab70 con 0x7f999c1589c0 2023-06-09T04:37:02.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f998affd700 1 -- 172.21.15.149:0/1569372031 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990012ae0 con 0x7f999c1589c0 2023-06-09T04:37:02.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.534+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c0b4170 con 0x7f999c1589c0 2023-06-09T04:37:02.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.535+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999c0c3310 con 0x7f999c1589c0 2023-06-09T04:37:02.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.536+0000 7f998affd700 1 -- 172.21.15.149:0/1569372031 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9990012c40 con 0x7f999c1589c0 2023-06-09T04:37:02.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.536+0000 7f998affd700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f997c06ace0 0x7f997c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.536+0000 7f998affd700 1 -- 172.21.15.149:0/1569372031 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9990089760 con 0x7f999c1589c0 2023-06-09T04:37:02.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.536+0000 7f9999d9b700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f997c06ace0 0x7f997c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.536+0000 7f9999d9b700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f997c06ace0 0x7f997c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f998c019040 tx=0x7f998c00bf90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:02.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.540+0000 7f998affd700 1 -- 172.21.15.149:0/1569372031 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99900545d0 con 0x7f999c1589c0 2023-06-09T04:37:02.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.731+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f999c15ad00 con 0x7f999c1589c0 2023-06-09T04:37:02.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.732+0000 7f998affd700 1 -- 172.21.15.149:0/1569372031 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f9990057bf0 con 0x7f999c1589c0 2023-06-09T04:37:02.734 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:02.734 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:02.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.734+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f997c06ace0 msgr2=0x7f997c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.734+0000 7f99a080e700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f997c06ace0 0x7f997c06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f998c019040 tx=0x7f998c00bf90 comp rx=0 tx=0).stop 2023-06-09T04:37:02.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.734+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c1589c0 msgr2=0x7f999c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.734+0000 7f99a080e700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c1589c0 0x7f999c0b3c30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f999000d800 tx=0x7f999000db10 comp rx=0 tx=0).stop 2023-06-09T04:37:02.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 shutdown_connections 2023-06-09T04:37:02.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f997c06ace0 0x7f997c06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f999c159ad0 0x7f999c0ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f999c1589c0 0x7f999c0b3c30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 --2- 172.21.15.149:0/1569372031 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f999c159650 0x7f999c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 >> 172.21.15.149:0/1569372031 conn(0x7f999c0ceed0 msgr2=0x7f999c154b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 shutdown_connections 2023-06-09T04:37:02.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.735+0000 7f99a080e700 1 -- 172.21.15.149:0/1569372031 wait complete. 2023-06-09T04:37:02.748 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:02.749 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:02.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.872+0000 7fc408b0a700 1 Processor -- start 2023-06-09T04:37:02.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.872+0000 7fc408b0a700 1 -- start start 2023-06-09T04:37:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc408b0a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc404070900 0x7fc404070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc408b0a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040712a0 con 0x7fc4040ce040 2023-06-09T04:37:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc408b0a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40415dad0 con 0x7fc4040ae0e0 2023-06-09T04:37:02.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc408b0a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40415adc0 con 0x7fc404070900 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40259c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fc4040ce040 0x7fc40415a500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:59984/0 (socket says 172.21.15.149:59984) 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40259c700 1 -- 172.21.15.149:0/3547930630 learned_addr learned my addr 172.21.15.149:0/3547930630 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc402d9d700 1 --2- 172.21.15.149:0/3547930630 >> v2:172.21.15.184:3300/0 conn(0x7fc404070900 0x7fc404070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930212255 0 0) 0x7fc4040712a0 con 0x7fc4040ce040 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec0035b0 con 0x7fc4040ce040 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355531947 0 0) 0x7fc40415dad0 con 0x7fc4040ae0e0 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4040712a0 con 0x7fc4040ae0e0 2023-06-09T04:37:02.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 606688731 0 0) 0x7fc3ec0035b0 con 0x7fc4040ce040 2023-06-09T04:37:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 >> v2:172.21.15.184:3300/0 conn(0x7fc404070900 msgr2=0x7fc404070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 --2- 172.21.15.149:0/3547930630 >> v2:172.21.15.184:3300/0 conn(0x7fc404070900 0x7fc404070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 >> v1:172.21.15.184:6789/0 conn(0x7fc4040ae0e0 legacy=0x7fc40415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40415b0a0 con 0x7fc4040ce040 2023-06-09T04:37:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7fc3f4001670 con 0x7fc4040ce040 2023-06-09T04:37:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.873+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 >> v1:172.21.15.149:6789/0 conn(0x7fc4040ce040 legacy=0x7fc40415a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3ec003b90 0x7fc3ec003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec004850 0x7fc3ec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec005200 0x7fc3ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40415adc0 con 0x7fc3ec005200 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00c060 con 0x7fc3ec004850 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec00c220 con 0x7fc3ec003b90 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 --2- 172.21.15.149:0/3547930630 >> v2:172.21.15.184:3300/0 conn(0x7fc404070900 0x7fc404070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec005200 0x7fc3ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc401d9b700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec004850 0x7fc3ec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40259c700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3ec003b90 0x7fc3ec003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 -- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3ec003b90 msgr2=0x7fc3ec003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3ec003b90 0x7fc3ec003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 -- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec004850 msgr2=0x7fc3ec004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec004850 0x7fc3ec004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 -- 172.21.15.149:0/3547930630 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0035b0 con 0x7fc3ec005200 2023-06-09T04:37:02.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 -- 172.21.15.149:0/3547930630 reap_dead start 2023-06-09T04:37:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc402d9d700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec005200 0x7fc3ec00ba10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00e350 tx=0x7fc3ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd83fe4413480103 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc00ee10 con 0x7fc3ec005200 2023-06-09T04:37:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc00f040 con 0x7fc3ec005200 2023-06-09T04:37:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.874+0000 7fc40159a700 1 -- 172.21.15.149:0/3547930630 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc003c60 con 0x7fc3ec005200 2023-06-09T04:37:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.875+0000 7fc408b0a700 1 -- 172.21.15.149:0/3547930630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec005200 msgr2=0x7fc3ec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.875+0000 7fc408b0a700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec005200 0x7fc3ec00ba10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00e350 tx=0x7fc3ec005880 comp rx=0 tx=0).stop 2023-06-09T04:37:02.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.875+0000 7fc408b0a700 1 -- 172.21.15.149:0/3547930630 shutdown_connections 2023-06-09T04:37:02.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.875+0000 7fc408b0a700 1 --2- 172.21.15.149:0/3547930630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3ec005200 0x7fc3ec00ba10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.875+0000 7fc408b0a700 1 -- 172.21.15.149:0/3547930630 >> 172.21.15.149:0/3547930630 conn(0x7fc4040cee30 msgr2=0x7fc4040cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:02.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.875+0000 7fc408b0a700 1 -- 172.21.15.149:0/3547930630 shutdown_connections 2023-06-09T04:37:02.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.875+0000 7fc408b0a700 1 -- 172.21.15.149:0/3547930630 wait complete. 2023-06-09T04:37:02.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.876+0000 7fc408b0a700 1 Processor -- start 2023-06-09T04:37:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.876+0000 7fc408b0a700 1 -- start start 2023-06-09T04:37:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc408b0a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec005200 0x7fc40406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc408b0a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4040c5550 0x7fc40406c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc408b0a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc40406cd30 0x7fc40414c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc408b0a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40414c230 con 0x7fc40406cd30 2023-06-09T04:37:02.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc408b0a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040b4bb0 con 0x7fc3ec005200 2023-06-09T04:37:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc408b0a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4040b48d0 con 0x7fc4040c5550 2023-06-09T04:37:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc40406cd30 0x7fc40414c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc40406cd30 0x7fc40414c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36136/0 (socket says 172.21.15.149:36136) 2023-06-09T04:37:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 -- 172.21.15.149:0/890513154 learned_addr learned my addr 172.21.15.149:0/890513154 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc401d9b700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4040c5550 0x7fc40406c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc40259c700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec005200 0x7fc40406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 -- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4040c5550 msgr2=0x7fc40406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4040c5550 0x7fc40406c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 -- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec005200 msgr2=0x7fc40406c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec005200 0x7fc40406c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc402d9d700 1 -- 172.21.15.149:0/890513154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40414bbe0 con 0x7fc40406cd30 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.877+0000 7fc401d9b700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4040c5550 0x7fc40406c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.878+0000 7fc402d9d700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc40406cd30 0x7fc40414c6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00afd0 tx=0x7fc3fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.878+0000 7fc3f2ffd700 1 -- 172.21.15.149:0/890513154 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc003e10 con 0x7fc40406cd30 2023-06-09T04:37:02.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.878+0000 7fc3f2ffd700 1 -- 172.21.15.149:0/890513154 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0046e0 con 0x7fc40406cd30 2023-06-09T04:37:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.878+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40414c230 con 0x7fc40406cd30 2023-06-09T04:37:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.878+0000 7fc3f2ffd700 1 -- 172.21.15.149:0/890513154 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc01d480 con 0x7fc40406cd30 2023-06-09T04:37:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.878+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40414e8a0 con 0x7fc40406cd30 2023-06-09T04:37:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.879+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4040cb6b0 con 0x7fc40406cd30 2023-06-09T04:37:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.879+0000 7fc3f2ffd700 1 -- 172.21.15.149:0/890513154 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3fc01d5e0 con 0x7fc40406cd30 2023-06-09T04:37:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.880+0000 7fc3f2ffd700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3e406ace0 0x7fc3e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:02.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.880+0000 7fc3f2ffd700 1 -- 172.21.15.149:0/890513154 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3fc08ad20 con 0x7fc40406cd30 2023-06-09T04:37:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.880+0000 7fc40259c700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3e406ace0 0x7fc3e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.880+0000 7fc40259c700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3e406ace0 0x7fc3e406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4000c00 tx=0x7fc3f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:02.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:02.884+0000 7fc3f2ffd700 1 -- 172.21.15.149:0/890513154 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3fc055c90 con 0x7fc40406cd30 2023-06-09T04:37:03.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.069+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc40414c3c0 con 0x7fc40406cd30 2023-06-09T04:37:03.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.069+0000 7fc3f2ffd700 1 -- 172.21.15.149:0/890513154 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3fc02b020 con 0x7fc40406cd30 2023-06-09T04:37:03.071 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:03.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3e406ace0 msgr2=0x7fc3e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3e406ace0 0x7fc3e406d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4000c00 tx=0x7fc3f4009040 comp rx=0 tx=0).stop 2023-06-09T04:37:03.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc40406cd30 msgr2=0x7fc40414c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc40406cd30 0x7fc40414c6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc00afd0 tx=0x7fc3fc009750 comp rx=0 tx=0).stop 2023-06-09T04:37:03.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 shutdown_connections 2023-06-09T04:37:03.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3e406ace0 0x7fc3e406d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc40406cd30 0x7fc40414c6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3ec005200 0x7fc40406c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 --2- 172.21.15.149:0/890513154 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc4040c5550 0x7fc40406c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.071+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 >> 172.21.15.149:0/890513154 conn(0x7fc4040cee30 msgr2=0x7fc4040cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:03.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.072+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 shutdown_connections 2023-06-09T04:37:03.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.072+0000 7fc408b0a700 1 -- 172.21.15.149:0/890513154 wait complete. 2023-06-09T04:37:03.085 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:03.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.207+0000 7f904fd62700 1 Processor -- start 2023-06-09T04:37:03.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.207+0000 7f904fd62700 1 -- start start 2023-06-09T04:37:03.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.207+0000 7f904fd62700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f904806b380 0x7f9048070900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904fd62700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9048070e40 0x7f904815c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904fd62700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90480712a0 con 0x7f90481588a0 2023-06-09T04:37:03.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904fd62700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904806b7f0 con 0x7f904806b380 2023-06-09T04:37:03.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904fd62700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90480caec0 con 0x7f9048070e40 2023-06-09T04:37:03.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f904806b380 0x7f9048070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f904806b380 0x7f9048070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36140/0 (socket says 172.21.15.149:36140) 2023-06-09T04:37:03.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 -- 172.21.15.149:0/2816335552 learned_addr learned my addr 172.21.15.149:0/2816335552 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904e2ff700 1 --2- 172.21.15.149:0/2816335552 >> v2:172.21.15.184:3300/0 conn(0x7f9048070e40 0x7f904815c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 -- 172.21.15.149:0/2816335552 >> v2:172.21.15.184:3300/0 conn(0x7f9048070e40 msgr2=0x7f904815c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 --2- 172.21.15.149:0/2816335552 >> v2:172.21.15.184:3300/0 conn(0x7f9048070e40 0x7f904815c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 -- 172.21.15.149:0/2816335552 >> v1:172.21.15.184:6789/0 conn(0x7f90481588a0 legacy=0x7f904806c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 -- 172.21.15.149:0/2816335552 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480cb5f0 con 0x7f904806b380 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904d2fd700 1 --2- 172.21.15.149:0/2816335552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904806b380 0x7f9048070900 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f904815c3c0 tx=0x7f903800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3005dbaee11cc225 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904cafc700 1 -- 172.21.15.149:0/2816335552 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903800db60 con 0x7f904806b380 2023-06-09T04:37:03.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904cafc700 1 -- 172.21.15.149:0/2816335552 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903800dcc0 con 0x7f904806b380 2023-06-09T04:37:03.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.208+0000 7f904cafc700 1 -- 172.21.15.149:0/2816335552 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9038017630 con 0x7f904806b380 2023-06-09T04:37:03.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 -- 172.21.15.149:0/2816335552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904806b380 msgr2=0x7f9048070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 --2- 172.21.15.149:0/2816335552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904806b380 0x7f9048070900 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f904815c3c0 tx=0x7f903800be70 comp rx=0 tx=0).stop 2023-06-09T04:37:03.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 -- 172.21.15.149:0/2816335552 shutdown_connections 2023-06-09T04:37:03.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 --2- 172.21.15.149:0/2816335552 >> v2:172.21.15.184:3300/0 conn(0x7f9048070e40 0x7f904815c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 --2- 172.21.15.149:0/2816335552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f904806b380 0x7f9048070900 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 -- 172.21.15.149:0/2816335552 >> 172.21.15.149:0/2816335552 conn(0x7f90480cee30 msgr2=0x7f90480cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 -- 172.21.15.149:0/2816335552 shutdown_connections 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.209+0000 7f904fd62700 1 -- 172.21.15.149:0/2816335552 wait complete. 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.210+0000 7f904fd62700 1 Processor -- start 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.210+0000 7f904fd62700 1 -- start start 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904fd62700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806b380 0x7f90480c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904fd62700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9048070e40 0x7f90480b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904fd62700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90481588a0 0x7f90481f1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904fd62700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480b3a60 con 0x7f90481588a0 2023-06-09T04:37:03.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904fd62700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90480b2bb0 con 0x7f9048070e40 2023-06-09T04:37:03.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904fd62700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90480b2e50 con 0x7f904806b380 2023-06-09T04:37:03.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90481588a0 0x7f90481f1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90481588a0 0x7f90481f1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36150/0 (socket says 172.21.15.149:36150) 2023-06-09T04:37:03.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 -- 172.21.15.149:0/4104852273 learned_addr learned my addr 172.21.15.149:0/4104852273 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:03.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904dafe700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806b380 0x7f90480c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904d2fd700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9048070e40 0x7f90480b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 -- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806b380 msgr2=0x7f90480c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806b380 0x7f90480c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 -- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9048070e40 msgr2=0x7f90480b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9048070e40 0x7f90480b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.211+0000 7f904e2ff700 1 -- 172.21.15.149:0/4104852273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903800b7f0 con 0x7f90481588a0 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.212+0000 7f904e2ff700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90481588a0 0x7f90481f1940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f904000efc0 tx=0x7f904000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.212+0000 7f903e7fc700 1 -- 172.21.15.149:0/4104852273 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040009ea0 con 0x7f90481588a0 2023-06-09T04:37:03.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.212+0000 7f903e7fc700 1 -- 172.21.15.149:0/4104852273 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904000f040 con 0x7f90481588a0 2023-06-09T04:37:03.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.212+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90480b3130 con 0x7f90481588a0 2023-06-09T04:37:03.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.212+0000 7f903e7fc700 1 -- 172.21.15.149:0/4104852273 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904000ced0 con 0x7f90481588a0 2023-06-09T04:37:03.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.212+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90480b36f0 con 0x7f90481588a0 2023-06-09T04:37:03.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.213+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904806d0f0 con 0x7f90481588a0 2023-06-09T04:37:03.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.213+0000 7f903e7fc700 1 -- 172.21.15.149:0/4104852273 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9040014480 con 0x7f90481588a0 2023-06-09T04:37:03.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.214+0000 7f903e7fc700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f902c06ace0 0x7f902c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.214+0000 7f903e7fc700 1 -- 172.21.15.149:0/4104852273 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f904008a6a0 con 0x7f90481588a0 2023-06-09T04:37:03.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.214+0000 7f904dafe700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f902c06ace0 0x7f902c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.214+0000 7f904dafe700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f902c06ace0 0x7f902c06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9044001800 tx=0x7f9044009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.217+0000 7f903e7fc700 1 -- 172.21.15.149:0/4104852273 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9040055540 con 0x7f90481588a0 2023-06-09T04:37:03.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.402+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f904806d2f0 con 0x7f90481588a0 2023-06-09T04:37:03.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.402+0000 7f903e7fc700 1 -- 172.21.15.149:0/4104852273 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9040058b60 con 0x7f90481588a0 2023-06-09T04:37:03.404 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:03.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f902c06ace0 msgr2=0x7f902c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f902c06ace0 0x7f902c06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9044001800 tx=0x7f9044009040 comp rx=0 tx=0).stop 2023-06-09T04:37:03.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90481588a0 msgr2=0x7f90481f1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90481588a0 0x7f90481f1940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f904000efc0 tx=0x7f904000c3a0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 shutdown_connections 2023-06-09T04:37:03.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f902c06ace0 0x7f902c06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f904806b380 0x7f90480c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90481588a0 0x7f90481f1940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 --2- 172.21.15.149:0/4104852273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9048070e40 0x7f90480b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 >> 172.21.15.149:0/4104852273 conn(0x7f90480cee30 msgr2=0x7f904806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:03.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 shutdown_connections 2023-06-09T04:37:03.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.404+0000 7f904fd62700 1 -- 172.21.15.149:0/4104852273 wait complete. 2023-06-09T04:37:03.418 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:03.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.541+0000 7f174e8b3700 1 Processor -- start 2023-06-09T04:37:03.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.541+0000 7f174e8b3700 1 -- start start 2023-06-09T04:37:03.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f174e8b3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f174815c270 0x7f17480d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f174e8b3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f17480cd840 0x7f17480cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f174e8b3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17480d0d30 con 0x7f17480ce310 2023-06-09T04:37:03.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f174e8b3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174806aec0 con 0x7f174815c270 2023-06-09T04:37:03.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f174e8b3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480d1520 con 0x7f17480cd840 2023-06-09T04:37:03.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f174815c270 0x7f17480d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f174815c270 0x7f17480d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36154/0 (socket says 172.21.15.149:36154) 2023-06-09T04:37:03.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 -- 172.21.15.149:0/729510174 learned_addr learned my addr 172.21.15.149:0/729510174 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:03.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f174ce50700 1 --2- 172.21.15.149:0/729510174 >> v2:172.21.15.184:3300/0 conn(0x7f17480cd840 0x7f17480cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 -- 172.21.15.149:0/729510174 >> v2:172.21.15.184:3300/0 conn(0x7f17480cd840 msgr2=0x7f17480cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:03.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 --2- 172.21.15.149:0/729510174 >> v2:172.21.15.184:3300/0 conn(0x7f17480cd840 0x7f17480cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 -- 172.21.15.149:0/729510174 >> v1:172.21.15.184:6789/0 conn(0x7f17480ce310 legacy=0x7f17480cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 -- 172.21.15.149:0/729510174 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480cb1a0 con 0x7f174815c270 2023-06-09T04:37:03.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.542+0000 7f1747fff700 1 --2- 172.21.15.149:0/729510174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174815c270 0x7f17480d07f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f174806f700 tx=0x7f1738009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30d06c96c3fd799 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f1746ffd700 1 -- 172.21.15.149:0/729510174 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800b870 con 0x7f174815c270 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f1746ffd700 1 -- 172.21.15.149:0/729510174 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173800b9d0 con 0x7f174815c270 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f1746ffd700 1 -- 172.21.15.149:0/729510174 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173800bd60 con 0x7f174815c270 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 -- 172.21.15.149:0/729510174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174815c270 msgr2=0x7f17480d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 --2- 172.21.15.149:0/729510174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174815c270 0x7f17480d07f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f174806f700 tx=0x7f1738009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 -- 172.21.15.149:0/729510174 shutdown_connections 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 --2- 172.21.15.149:0/729510174 >> v2:172.21.15.184:3300/0 conn(0x7f17480cd840 0x7f17480cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 --2- 172.21.15.149:0/729510174 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f174815c270 0x7f17480d07f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 -- 172.21.15.149:0/729510174 >> 172.21.15.149:0/729510174 conn(0x7f1748069db0 msgr2=0x7f174806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:03.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 -- 172.21.15.149:0/729510174 shutdown_connections 2023-06-09T04:37:03.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.543+0000 7f174e8b3700 1 -- 172.21.15.149:0/729510174 wait complete. 2023-06-09T04:37:03.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.544+0000 7f174e8b3700 1 Processor -- start 2023-06-09T04:37:03.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.544+0000 7f174e8b3700 1 -- start start 2023-06-09T04:37:03.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f174e8b3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17480cd840 0x7f174815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f174e8b3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17480ce310 0x7f174815d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f174e8b3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f174815c270 0x7f174815d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f174e8b3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480b1e60 con 0x7f17480ce310 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f174e8b3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480b0f90 con 0x7f17480cd840 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f174e8b3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480b11e0 con 0x7f174815c270 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f17477fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17480ce310 0x7f174815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f17477fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17480ce310 0x7f174815d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36162/0 (socket says 172.21.15.149:36162) 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f17477fe700 1 -- 172.21.15.149:0/160078408 learned_addr learned my addr 172.21.15.149:0/160078408 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f174ce50700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f174815c270 0x7f174815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.545+0000 7f1747fff700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17480cd840 0x7f174815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f17477fe700 1 -- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f174815c270 msgr2=0x7f174815d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f17477fe700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f174815c270 0x7f174815d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f17477fe700 1 -- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17480cd840 msgr2=0x7f174815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f17477fe700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17480cd840 0x7f174815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f17477fe700 1 -- 172.21.15.149:0/160078408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738009550 con 0x7f17480ce310 2023-06-09T04:37:03.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f17477fe700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17480ce310 0x7f174815d050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f173000c4e0 tx=0x7f173000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f1744ff9700 1 -- 172.21.15.149:0/160078408 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300052d0 con 0x7f17480ce310 2023-06-09T04:37:03.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f1744ff9700 1 -- 172.21.15.149:0/160078408 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1730005430 con 0x7f17480ce310 2023-06-09T04:37:03.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f1744ff9700 1 -- 172.21.15.149:0/160078408 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300038c0 con 0x7f17480ce310 2023-06-09T04:37:03.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17480b14c0 con 0x7f17480ce310 2023-06-09T04:37:03.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.546+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174814b4a0 con 0x7f17480ce310 2023-06-09T04:37:03.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.547+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1748073fa0 con 0x7f17480ce310 2023-06-09T04:37:03.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.548+0000 7f1744ff9700 1 -- 172.21.15.149:0/160078408 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1730003a20 con 0x7f17480ce310 2023-06-09T04:37:03.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.548+0000 7f1744ff9700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.548+0000 7f1744ff9700 1 -- 172.21.15.149:0/160078408 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1730088ad0 con 0x7f17480ce310 2023-06-09T04:37:03.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.548+0000 7f1747fff700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.548+0000 7f1747fff700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f172806ace0 0x7f172806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1738014040 tx=0x7f1738008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.552+0000 7f1744ff9700 1 -- 172.21.15.149:0/160078408 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1730053890 con 0x7f17480ce310 2023-06-09T04:37:03.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.742+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17480b2790 con 0x7f17480ce310 2023-06-09T04:37:03.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.743+0000 7f1744ff9700 1 -- 172.21.15.149:0/160078408 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1730056eb0 con 0x7f17480ce310 2023-06-09T04:37:03.745 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:03.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f172806ace0 msgr2=0x7f172806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f172806ace0 0x7f172806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1738014040 tx=0x7f1738008030 comp rx=0 tx=0).stop 2023-06-09T04:37:03.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17480ce310 msgr2=0x7f174815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17480ce310 0x7f174815d050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f173000c4e0 tx=0x7f173000c7f0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 shutdown_connections 2023-06-09T04:37:03.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f172806ace0 0x7f172806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f174815c270 0x7f174815d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17480cd840 0x7f174815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 --2- 172.21.15.149:0/160078408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f17480ce310 0x7f174815d050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 >> 172.21.15.149:0/160078408 conn(0x7f1748069db0 msgr2=0x7f1748156780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:03.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 shutdown_connections 2023-06-09T04:37:03.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.745+0000 7f174e8b3700 1 -- 172.21.15.149:0/160078408 wait complete. 2023-06-09T04:37:03.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:03.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.881+0000 7f3059c09700 1 Processor -- start 2023-06-09T04:37:03.883 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.881+0000 7f3059c09700 1 -- start start 2023-06-09T04:37:03.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3059c09700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3054071770 0x7f3054069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3059c09700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f305415c6f0 0x7f305406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3059c09700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3054071290 con 0x7f305415c320 2023-06-09T04:37:03.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3059c09700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540b2050 con 0x7f305415c6f0 2023-06-09T04:37:03.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3059c09700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30540cd2c0 con 0x7f3054071770 2023-06-09T04:37:03.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f305415c6f0 0x7f305406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f305415c6f0 0x7f305406a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36172/0 (socket says 172.21.15.149:36172) 2023-06-09T04:37:03.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 -- 172.21.15.149:0/2778037805 learned_addr learned my addr 172.21.15.149:0/2778037805 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:03.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3052ffd700 1 --2- 172.21.15.149:0/2778037805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3054071770 0x7f3054069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 -- 172.21.15.149:0/2778037805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3054071770 msgr2=0x7f3054069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:03.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 --2- 172.21.15.149:0/2778037805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3054071770 0x7f3054069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 -- 172.21.15.149:0/2778037805 >> v1:172.21.15.184:6789/0 conn(0x7f305415c320 legacy=0x7f30540cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 -- 172.21.15.149:0/2778037805 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30540cd5a0 con 0x7f305415c6f0 2023-06-09T04:37:03.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f3053fff700 1 --2- 172.21.15.149:0/2778037805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c6f0 0x7f305406a2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f304c009e50 tx=0x7f304c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c85c0f950731f5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f30527fc700 1 -- 172.21.15.149:0/2778037805 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00e070 con 0x7f305415c6f0 2023-06-09T04:37:03.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f30527fc700 1 -- 172.21.15.149:0/2778037805 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c00b910 con 0x7f305415c6f0 2023-06-09T04:37:03.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.882+0000 7f30527fc700 1 -- 172.21.15.149:0/2778037805 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c00bcc0 con 0x7f305415c6f0 2023-06-09T04:37:03.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 -- 172.21.15.149:0/2778037805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c6f0 msgr2=0x7f305406a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 --2- 172.21.15.149:0/2778037805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c6f0 0x7f305406a2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f304c009e50 tx=0x7f304c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:03.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 -- 172.21.15.149:0/2778037805 shutdown_connections 2023-06-09T04:37:03.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 --2- 172.21.15.149:0/2778037805 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c6f0 0x7f305406a2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 --2- 172.21.15.149:0/2778037805 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3054071770 0x7f3054069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 -- 172.21.15.149:0/2778037805 >> 172.21.15.149:0/2778037805 conn(0x7f305406aec0 msgr2=0x7f305406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:03.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 -- 172.21.15.149:0/2778037805 shutdown_connections 2023-06-09T04:37:03.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.883+0000 7f3059c09700 1 -- 172.21.15.149:0/2778037805 wait complete. 2023-06-09T04:37:03.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.885+0000 7f3059c09700 1 Processor -- start 2023-06-09T04:37:03.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.885+0000 7f3059c09700 1 -- start start 2023-06-09T04:37:03.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3054071770 0x7f30541ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c320 0x7f30540cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f305415c6f0 0x7f30540b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540cb400 con 0x7f305415c320 2023-06-09T04:37:03.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540cc8b0 con 0x7f3054071770 2023-06-09T04:37:03.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30541f28a0 con 0x7f305415c6f0 2023-06-09T04:37:03.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c320 0x7f30540cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c320 0x7f30540cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36176/0 (socket says 172.21.15.149:36176) 2023-06-09T04:37:03.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 -- 172.21.15.149:0/3017964749 learned_addr learned my addr 172.21.15.149:0/3017964749 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:03.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f30537fe700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3054071770 0x7f30541ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3053fff700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f305415c6f0 0x7f30540b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 -- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f305415c6f0 msgr2=0x7f30540b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f305415c6f0 0x7f30540b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 -- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3054071770 msgr2=0x7f30541ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:03.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3054071770 0x7f30541ef050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:03.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 -- 172.21.15.149:0/3017964749 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c009b30 con 0x7f305415c320 2023-06-09T04:37:03.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3052ffd700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c320 0x7f30540cb820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f304400e980 tx=0x7f304400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f304bfff700 1 -- 172.21.15.149:0/3017964749 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044009710 con 0x7f305415c320 2023-06-09T04:37:03.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f304bfff700 1 -- 172.21.15.149:0/3017964749 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400c850 con 0x7f305415c320 2023-06-09T04:37:03.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30541f2b80 con 0x7f305415c320 2023-06-09T04:37:03.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f304bfff700 1 -- 172.21.15.149:0/3017964749 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400cc00 con 0x7f305415c320 2023-06-09T04:37:03.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.886+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30540cb020 con 0x7f305415c320 2023-06-09T04:37:03.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.887+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054073fa0 con 0x7f305415c320 2023-06-09T04:37:03.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.888+0000 7f304bfff700 1 -- 172.21.15.149:0/3017964749 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3044013470 con 0x7f305415c320 2023-06-09T04:37:03.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.888+0000 7f304bfff700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f303406ace0 0x7f303406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:03.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.888+0000 7f304bfff700 1 -- 172.21.15.149:0/3017964749 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f30440897f0 con 0x7f305415c320 2023-06-09T04:37:03.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.888+0000 7f30537fe700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f303406ace0 0x7f303406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:03.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.889+0000 7f30537fe700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f303406ace0 0x7f303406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f303c000f60 tx=0x7f303c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:03.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:03.893+0000 7f304bfff700 1 -- 172.21.15.149:0/3017964749 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3044058190 con 0x7f305415c320 2023-06-09T04:37:04.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.077+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30540cf030 con 0x7f305415c320 2023-06-09T04:37:04.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.078+0000 7f304bfff700 1 -- 172.21.15.149:0/3017964749 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3044057d20 con 0x7f305415c320 2023-06-09T04:37:04.079 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:04.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f303406ace0 msgr2=0x7f303406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f303406ace0 0x7f303406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f303c000f60 tx=0x7f303c009040 comp rx=0 tx=0).stop 2023-06-09T04:37:04.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c320 msgr2=0x7f30540cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c320 0x7f30540cb820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f304400e980 tx=0x7f304400ed40 comp rx=0 tx=0).stop 2023-06-09T04:37:04.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 shutdown_connections 2023-06-09T04:37:04.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f303406ace0 0x7f303406d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f305415c6f0 0x7f30540b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3054071770 0x7f30541ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 --2- 172.21.15.149:0/3017964749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f305415c320 0x7f30540cb820 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 >> 172.21.15.149:0/3017964749 conn(0x7f305406aec0 msgr2=0x7f30540cfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:04.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 shutdown_connections 2023-06-09T04:37:04.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.080+0000 7f3059c09700 1 -- 172.21.15.149:0/3017964749 wait complete. 2023-06-09T04:37:04.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:04.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.215+0000 7fa4c685d700 1 Processor -- start 2023-06-09T04:37:04.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.215+0000 7fa4c685d700 1 -- start start 2023-06-09T04:37:04.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.215+0000 7fa4c685d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa4c00ccb00 0x7fa4c00d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.215+0000 7fa4c685d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.215+0000 7fa4c685d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c015c750 con 0x7fa4c00b43f0 2023-06-09T04:37:04.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c685d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c00ccfc0 con 0x7fa4c00ccb00 2023-06-09T04:37:04.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c685d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00cf740 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c4dfa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4bf7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa4c00ccb00 0x7fa4c00d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4bffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa4c00b43f0 0x7fa4c00b47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:37812/0 (socket says 172.21.15.149:37812) 2023-06-09T04:37:04.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c4dfa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:41798/0 (socket says 172.21.15.149:41798) 2023-06-09T04:37:04.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4bffff700 1 -- 172.21.15.149:0/4183896257 learned_addr learned my addr 172.21.15.149:0/4183896257 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:04.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4beffd700 1 -- 172.21.15.149:0/4183896257 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421521703 0 0) 0x7fa4b0001110 con 0x7fa4c00b43f0 2023-06-09T04:37:04.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c4dfa700 1 -- 172.21.15.149:0/4183896257 >> v2:172.21.15.184:3300/0 conn(0x7fa4c00ccb00 msgr2=0x7fa4c00d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:04.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c4dfa700 1 --2- 172.21.15.149:0/4183896257 >> v2:172.21.15.184:3300/0 conn(0x7fa4c00ccb00 0x7fa4c00d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c4dfa700 1 -- 172.21.15.149:0/4183896257 >> v1:172.21.15.184:6789/0 conn(0x7fa4c00b43f0 legacy=0x7fa4c00b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c4dfa700 1 -- 172.21.15.149:0/4183896257 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00cd540 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4c4dfa700 1 --2- 172.21.15.149:0/4183896257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473d698204bf5540 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4beffd700 1 -- 172.21.15.149:0/4183896257 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800e070 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4beffd700 1 -- 172.21.15.149:0/4183896257 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b800bb20 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.216+0000 7fa4beffd700 1 -- 172.21.15.149:0/4183896257 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8012430 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 -- 172.21.15.149:0/4183896257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b4ed0 msgr2=0x7fa4c00d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 --2- 172.21.15.149:0/4183896257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0b80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:04.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 -- 172.21.15.149:0/4183896257 shutdown_connections 2023-06-09T04:37:04.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 --2- 172.21.15.149:0/4183896257 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0b80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 --2- 172.21.15.149:0/4183896257 >> v2:172.21.15.184:3300/0 conn(0x7fa4c00ccb00 0x7fa4c00d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 -- 172.21.15.149:0/4183896257 >> 172.21.15.149:0/4183896257 conn(0x7fa4c0072120 msgr2=0x7fa4c006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 -- 172.21.15.149:0/4183896257 shutdown_connections 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.217+0000 7fa4c685d700 1 -- 172.21.15.149:0/4183896257 wait complete. 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.218+0000 7fa4c685d700 1 Processor -- start 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.218+0000 7fa4c685d700 1 -- start start 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4c685d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b43f0 0x7fa4c015f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4c685d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4c685d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00ccb00 0x7fa4c0143b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4c685d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c0141a90 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4c685d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00cba40 con 0x7fa4c00ccb00 2023-06-09T04:37:04.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4c685d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c00cbd20 con 0x7fa4c00b43f0 2023-06-09T04:37:04.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4bf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4bf7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36190/0 (socket says 172.21.15.149:36190) 2023-06-09T04:37:04.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4bf7fe700 1 -- 172.21.15.149:0/598411903 learned_addr learned my addr 172.21.15.149:0/598411903 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:04.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4c4dfa700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00ccb00 0x7fa4c0143b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.219+0000 7fa4bffff700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b43f0 0x7fa4c015f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bf7fe700 1 -- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b43f0 msgr2=0x7fa4c015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bf7fe700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b43f0 0x7fa4c015f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bf7fe700 1 -- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00ccb00 msgr2=0x7fa4c0143b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bf7fe700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00ccb00 0x7fa4c0143b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bf7fe700 1 -- 172.21.15.149:0/598411903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009a70 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bffff700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b43f0 0x7fa4c015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4c4dfa700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00ccb00 0x7fa4c0143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:04.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bf7fe700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e980 tx=0x7fa4b400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bcff9700 1 -- 172.21.15.149:0/598411903 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4009710 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bcff9700 1 -- 172.21.15.149:0/598411903 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b400c850 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c00cc000 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4bcff9700 1 -- 172.21.15.149:0/598411903 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400cbe0 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.220+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c00d0db0 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.221+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c0073fa0 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.221+0000 7fa4bcff9700 1 -- 172.21.15.149:0/598411903 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4b400cd40 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.222+0000 7fa4bcff9700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa4ac06ace0 0x7fa4ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.222+0000 7fa4bcff9700 1 -- 172.21.15.149:0/598411903 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa4b40898d0 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.222+0000 7fa4bffff700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa4ac06ace0 0x7fa4ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.222+0000 7fa4bffff700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa4ac06ace0 0x7fa4ac06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000f60 tx=0x7fa4b0007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.226+0000 7fa4bcff9700 1 -- 172.21.15.149:0/598411903 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4b40581e0 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.413+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa4c00b1e10 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.414+0000 7fa4bcff9700 1 -- 172.21.15.149:0/598411903 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa4b4057d70 con 0x7fa4c00b4ed0 2023-06-09T04:37:04.415 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:04.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa4ac06ace0 msgr2=0x7fa4ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa4ac06ace0 0x7fa4ac06d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0000f60 tx=0x7fa4b0007d30 comp rx=0 tx=0).stop 2023-06-09T04:37:04.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00b4ed0 msgr2=0x7fa4c00d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400e980 tx=0x7fa4b400ed40 comp rx=0 tx=0).stop 2023-06-09T04:37:04.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 shutdown_connections 2023-06-09T04:37:04.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa4ac06ace0 0x7fa4ac06d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa4c00b43f0 0x7fa4c015f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa4c00ccb00 0x7fa4c0143b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 --2- 172.21.15.149:0/598411903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4c00b4ed0 0x7fa4c00d0870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 >> 172.21.15.149:0/598411903 conn(0x7fa4c0072120 msgr2=0x7fa4c00b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:04.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 shutdown_connections 2023-06-09T04:37:04.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.416+0000 7fa4c685d700 1 -- 172.21.15.149:0/598411903 wait complete. 2023-06-09T04:37:04.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:37:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.552+0000 7fcb5ed05700 1 Processor -- start 2023-06-09T04:37:04.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.552+0000 7fcb5ed05700 1 -- start start 2023-06-09T04:37:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5ed05700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb58069db0 0x7fcb58071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5ed05700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcb5815c650 0x7fcb5806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5ed05700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcb580cd220 0x7fcb580b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5ed05700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb580cf1a0 con 0x7fcb5815c650 2023-06-09T04:37:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5ed05700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb580cd7e0 con 0x7fcb580cd220 2023-06-09T04:37:04.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5ed05700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb580711f0 con 0x7fcb58069db0 2023-06-09T04:37:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcb5815c650 0x7fcb5806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcb5815c650 0x7fcb5806a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36196/0 (socket says 172.21.15.149:36196) 2023-06-09T04:37:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 -- 172.21.15.149:0/4193335173 learned_addr learned my addr 172.21.15.149:0/4193335173 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5d2a2700 1 --2- 172.21.15.149:0/4193335173 >> v2:172.21.15.184:3300/0 conn(0x7fcb580cd220 0x7fcb580b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5caa1700 1 --2- 172.21.15.149:0/4193335173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb58069db0 0x7fcb58071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 -- 172.21.15.149:0/4193335173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb58069db0 msgr2=0x7fcb58071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:04.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 --2- 172.21.15.149:0/4193335173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb58069db0 0x7fcb58071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 -- 172.21.15.149:0/4193335173 >> v2:172.21.15.184:3300/0 conn(0x7fcb580cd220 msgr2=0x7fcb580b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 --2- 172.21.15.149:0/4193335173 >> v2:172.21.15.184:3300/0 conn(0x7fcb580cd220 0x7fcb580b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 -- 172.21.15.149:0/4193335173 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580cebd0 con 0x7fcb5815c650 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb5d2a2700 1 --2- 172.21.15.149:0/4193335173 >> v2:172.21.15.184:3300/0 conn(0x7fcb580cd220 0x7fcb580b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb57fff700 1 --2- 172.21.15.149:0/4193335173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb5806a180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb580ae8d0 tx=0x7fcb44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d052309246b73ac server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.553+0000 7fcb577fe700 1 -- 172.21.15.149:0/4193335173 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400b870 con 0x7fcb5815c650 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb577fe700 1 -- 172.21.15.149:0/4193335173 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4400b9d0 con 0x7fcb5815c650 2023-06-09T04:37:04.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb577fe700 1 -- 172.21.15.149:0/4193335173 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4400bd60 con 0x7fcb5815c650 2023-06-09T04:37:04.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 -- 172.21.15.149:0/4193335173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 msgr2=0x7fcb5806a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/4193335173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb5806a180 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcb580ae8d0 tx=0x7fcb44009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 -- 172.21.15.149:0/4193335173 shutdown_connections 2023-06-09T04:37:04.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/4193335173 >> v2:172.21.15.184:3300/0 conn(0x7fcb580cd220 0x7fcb580b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/4193335173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb58069db0 0x7fcb58071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/4193335173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb5806a180 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 -- 172.21.15.149:0/4193335173 >> 172.21.15.149:0/4193335173 conn(0x7fcb5806aec0 msgr2=0x7fcb5806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 -- 172.21.15.149:0/4193335173 shutdown_connections 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.554+0000 7fcb5ed05700 1 -- 172.21.15.149:0/4193335173 wait complete. 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.555+0000 7fcb5ed05700 1 Processor -- start 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.555+0000 7fcb5ed05700 1 -- start start 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5ed05700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb58069db0 0x7fcb581f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5ed05700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb580cd220 0x7fcb580c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5ed05700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb580c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5ed05700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb581f65b0 con 0x7fcb5815c650 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5ed05700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb581f5970 con 0x7fcb58069db0 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5ed05700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb581f5c10 con 0x7fcb580cd220 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5d2a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb580c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5d2a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb580c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36204/0 (socket says 172.21.15.149:36204) 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.556+0000 7fcb5d2a2700 1 -- 172.21.15.149:0/428668740 learned_addr learned my addr 172.21.15.149:0/428668740 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb57fff700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb580cd220 0x7fcb580c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5caa1700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb58069db0 0x7fcb581f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5d2a2700 1 -- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb580cd220 msgr2=0x7fcb580c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5d2a2700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb580cd220 0x7fcb580c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5d2a2700 1 -- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb58069db0 msgr2=0x7fcb581f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5d2a2700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb58069db0 0x7fcb581f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5d2a2700 1 -- 172.21.15.149:0/428668740 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb44009550 con 0x7fcb5815c650 2023-06-09T04:37:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb57fff700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb580cd220 0x7fcb580c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5caa1700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb58069db0 0x7fcb581f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5d2a2700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb580c57b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000cef0 tx=0x7fcb5000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb557fa700 1 -- 172.21.15.149:0/428668740 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5000ae50 con 0x7fcb5815c650 2023-06-09T04:37:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb557fa700 1 -- 172.21.15.149:0/428668740 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50015440 con 0x7fcb5815c650 2023-06-09T04:37:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb581f5ef0 con 0x7fcb5815c650 2023-06-09T04:37:04.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb557fa700 1 -- 172.21.15.149:0/428668740 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500157f0 con 0x7fcb5815c650 2023-06-09T04:37:04.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.557+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb581f3030 con 0x7fcb5815c650 2023-06-09T04:37:04.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.558+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb581f66f0 con 0x7fcb5815c650 2023-06-09T04:37:04.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.558+0000 7fcb557fa700 1 -- 172.21.15.149:0/428668740 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb5000d430 con 0x7fcb5815c650 2023-06-09T04:37:04.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.559+0000 7fcb557fa700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcb3c06ace0 0x7fcb3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.559+0000 7fcb557fa700 1 -- 172.21.15.149:0/428668740 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcb50089d40 con 0x7fcb5815c650 2023-06-09T04:37:04.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.559+0000 7fcb5caa1700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcb3c06ace0 0x7fcb3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.559+0000 7fcb5caa1700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcb3c06ace0 0x7fcb3c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb580c4b00 tx=0x7fcb4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.563+0000 7fcb557fa700 1 -- 172.21.15.149:0/428668740 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcb581f66f0 con 0x7fcb5815c650 2023-06-09T04:37:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.767+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb581f68d0 con 0x7fcb5815c650 2023-06-09T04:37:04.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.768+0000 7fcb557fa700 1 -- 172.21.15.149:0/428668740 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb581f68d0 con 0x7fcb5815c650 2023-06-09T04:37:04.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcb3c06ace0 msgr2=0x7fcb3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcb3c06ace0 0x7fcb3c06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcb580c4b00 tx=0x7fcb4c008040 comp rx=0 tx=0).stop 2023-06-09T04:37:04.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 msgr2=0x7fcb580c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb580c57b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000cef0 tx=0x7fcb5000a340 comp rx=0 tx=0).stop 2023-06-09T04:37:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 shutdown_connections 2023-06-09T04:37:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcb3c06ace0 0x7fcb3c06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb5815c650 0x7fcb580c57b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb58069db0 0x7fcb581f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 --2- 172.21.15.149:0/428668740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcb580cd220 0x7fcb580c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 >> 172.21.15.149:0/428668740 conn(0x7fcb5806aec0 msgr2=0x7fcb5806a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 shutdown_connections 2023-06-09T04:37:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.770+0000 7fcb5ed05700 1 -- 172.21.15.149:0/428668740 wait complete. 2023-06-09T04:37:04.773 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-06-09T04:37:04.783 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:04.783 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:04.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:04.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.958+0000 7f47f03d3700 1 Processor -- start 2023-06-09T04:37:04.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.958+0000 7f47f03d3700 1 -- start start 2023-06-09T04:37:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47f03d3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47f03d3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47e806a4c0 0x7f47e80b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47f03d3700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80af050 con 0x7f47e80ccba0 2023-06-09T04:37:04.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47f03d3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80afae0 con 0x7f47e806a4c0 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47f03d3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80ccff0 con 0x7f47e815c590 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47ee970700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47e806a4c0 0x7f47e80b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47ee970700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f47e806a4c0 0x7f47e80b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36212/0 (socket says 172.21.15.149:36212) 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47ee970700 1 -- 172.21.15.149:0/1927021338 learned_addr learned my addr 172.21.15.149:0/1927021338 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.959+0000 7f47ed96e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f47e80ccba0 0x7f47e8069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60072/0 (socket says 172.21.15.149:60072) 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ee16f700 1 --2- 172.21.15.149:0/1927021338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ee970700 1 -- 172.21.15.149:0/1927021338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 msgr2=0x7f47e80af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:04.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ee970700 1 --2- 172.21.15.149:0/1927021338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ee970700 1 -- 172.21.15.149:0/1927021338 >> v1:172.21.15.149:6789/0 conn(0x7f47e80ccba0 legacy=0x7f47e8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ee970700 1 -- 172.21.15.149:0/1927021338 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80af800 con 0x7f47e806a4c0 2023-06-09T04:37:04.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ed16d700 1 -- 172.21.15.149:0/1927021338 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818822983 0 0) 0x7f47e80af050 con 0x7f47e80ccba0 2023-06-09T04:37:04.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ee970700 1 --2- 172.21.15.149:0/1927021338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e806a4c0 0x7f47e80b06d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e50 tx=0x7f47e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae29d62240ae0baa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ed16d700 1 -- 172.21.15.149:0/1927021338 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000e070 con 0x7f47e806a4c0 2023-06-09T04:37:04.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ed16d700 1 -- 172.21.15.149:0/1927021338 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000b910 con 0x7f47e806a4c0 2023-06-09T04:37:04.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.960+0000 7f47ed16d700 1 -- 172.21.15.149:0/1927021338 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000bcc0 con 0x7f47e806a4c0 2023-06-09T04:37:04.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 -- 172.21.15.149:0/1927021338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e806a4c0 msgr2=0x7f47e80b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 --2- 172.21.15.149:0/1927021338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e806a4c0 0x7f47e80b06d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e50 tx=0x7f47e000b330 comp rx=0 tx=0).stop 2023-06-09T04:37:04.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 -- 172.21.15.149:0/1927021338 shutdown_connections 2023-06-09T04:37:04.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 --2- 172.21.15.149:0/1927021338 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e806a4c0 0x7f47e80b06d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 --2- 172.21.15.149:0/1927021338 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 -- 172.21.15.149:0/1927021338 >> 172.21.15.149:0/1927021338 conn(0x7f47e806b7e0 msgr2=0x7f47e80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:04.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 -- 172.21.15.149:0/1927021338 shutdown_connections 2023-06-09T04:37:04.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.961+0000 7f47f03d3700 1 -- 172.21.15.149:0/1927021338 wait complete. 2023-06-09T04:37:04.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.962+0000 7f47f03d3700 1 Processor -- start 2023-06-09T04:37:04.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.962+0000 7f47f03d3700 1 -- start start 2023-06-09T04:37:04.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47e806a4c0 0x7f47e80b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e80ccba0 0x7f47e80cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80c31d0 con 0x7f47e80ccba0 2023-06-09T04:37:04.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80b2570 con 0x7f47e806a4c0 2023-06-09T04:37:04.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80b5460 con 0x7f47e815c590 2023-06-09T04:37:04.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e80ccba0 0x7f47e80cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e80ccba0 0x7f47e80cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36216/0 (socket says 172.21.15.149:36216) 2023-06-09T04:37:04.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 -- 172.21.15.149:0/4190151479 learned_addr learned my addr 172.21.15.149:0/4190151479 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ee970700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ee16f700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47e806a4c0 0x7f47e80b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 -- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 msgr2=0x7f47e80ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 -- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47e806a4c0 msgr2=0x7f47e80b4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47e806a4c0 0x7f47e80b4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 -- 172.21.15.149:0/4190151479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e0009b30 con 0x7f47e80ccba0 2023-06-09T04:37:04.969 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ee970700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:04.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47ed96e700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e80ccba0 0x7f47e80cb600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f47e40011e0 tx=0x7f47e400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47deffd700 1 -- 172.21.15.149:0/4190151479 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4004c80 con 0x7f47e80ccba0 2023-06-09T04:37:04.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47deffd700 1 -- 172.21.15.149:0/4190151479 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e4004e00 con 0x7f47e80ccba0 2023-06-09T04:37:04.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e80cbb40 con 0x7f47e80ccba0 2023-06-09T04:37:04.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47deffd700 1 -- 172.21.15.149:0/4190151479 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4007310 con 0x7f47e80ccba0 2023-06-09T04:37:04.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.963+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e80b2ac0 con 0x7f47e80ccba0 2023-06-09T04:37:04.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.964+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8073fa0 con 0x7f47e80ccba0 2023-06-09T04:37:04.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.965+0000 7f47deffd700 1 -- 172.21.15.149:0/4190151479 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47e4007470 con 0x7f47e80ccba0 2023-06-09T04:37:04.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.965+0000 7f47deffd700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47cc06ace0 0x7f47cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:04.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.965+0000 7f47deffd700 1 -- 172.21.15.149:0/4190151479 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f47e4089510 con 0x7f47e80ccba0 2023-06-09T04:37:04.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.965+0000 7f47ee16f700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47cc06ace0 0x7f47cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:04.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.966+0000 7f47ee16f700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47cc06ace0 0x7f47cc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009ab0 tx=0x7f47d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:04.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:04.970+0000 7f47deffd700 1 -- 172.21.15.149:0/4190151479 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47e40542d0 con 0x7f47e80ccba0 2023-06-09T04:37:05.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.163+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e8071dc0 con 0x7f47e80ccba0 2023-06-09T04:37:05.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.165+0000 7f47deffd700 1 -- 172.21.15.149:0/4190151479 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f47e40578f0 con 0x7f47e80ccba0 2023-06-09T04:37:05.166 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:05.167 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:05.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47cc06ace0 msgr2=0x7f47cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47cc06ace0 0x7f47cc06d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009ab0 tx=0x7f47d8008040 comp rx=0 tx=0).stop 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e80ccba0 msgr2=0x7f47e80cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e80ccba0 0x7f47e80cb600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f47e40011e0 tx=0x7f47e400cae0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 shutdown_connections 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f47cc06ace0 0x7f47cc06d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f47e815c590 0x7f47e80ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47e806a4c0 0x7f47e80b4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 --2- 172.21.15.149:0/4190151479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f47e80ccba0 0x7f47e80cb600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 >> 172.21.15.149:0/4190151479 conn(0x7f47e806b7e0 msgr2=0x7f47e80b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:05.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 shutdown_connections 2023-06-09T04:37:05.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.167+0000 7f47f03d3700 1 -- 172.21.15.149:0/4190151479 wait complete. 2023-06-09T04:37:05.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:05.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:05.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.303+0000 7f18d3e5d700 1 Processor -- start 2023-06-09T04:37:05.304 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.303+0000 7f18d3e5d700 1 -- start start 2023-06-09T04:37:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d3e5d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f18cc0ccb00 0x7f18cc0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d3e5d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f18cc0b4ed0 0x7f18cc0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d3e5d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc15c750 con 0x7f18cc0b43f0 2023-06-09T04:37:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d3e5d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0ccfc0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d3e5d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc0cf740 con 0x7f18cc0ccb00 2023-06-09T04:37:05.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f18cc0b4ed0 0x7f18cc0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f18cc0b4ed0 0x7f18cc0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36226/0 (socket says 172.21.15.149:36226) 2023-06-09T04:37:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 -- 172.21.15.149:0/146241492 learned_addr learned my addr 172.21.15.149:0/146241492 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d13f8700 1 --2- 172.21.15.149:0/146241492 >> v2:172.21.15.184:3300/0 conn(0x7f18cc0ccb00 0x7f18cc0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 -- 172.21.15.149:0/146241492 >> v2:172.21.15.184:3300/0 conn(0x7f18cc0ccb00 msgr2=0x7f18cc0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 --2- 172.21.15.149:0/146241492 >> v2:172.21.15.184:3300/0 conn(0x7f18cc0ccb00 0x7f18cc0d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 -- 172.21.15.149:0/146241492 >> v1:172.21.15.184:6789/0 conn(0x7f18cc0b43f0 legacy=0x7f18cc0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:05.307 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 -- 172.21.15.149:0/146241492 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc0cd540 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.304+0000 7f18d23fa700 1 --2- 172.21.15.149:0/146241492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0d0b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0d2890 tx=0x7f18c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434c503081194b26 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d0bf7700 1 -- 172.21.15.149:0/146241492 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400e070 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d0bf7700 1 -- 172.21.15.149:0/146241492 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4003a20 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d0bf7700 1 -- 172.21.15.149:0/146241492 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003dd0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 -- 172.21.15.149:0/146241492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 msgr2=0x7f18cc0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/146241492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0d0b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0d2890 tx=0x7f18c400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:05.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 -- 172.21.15.149:0/146241492 shutdown_connections 2023-06-09T04:37:05.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/146241492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0d0b80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/146241492 >> v2:172.21.15.184:3300/0 conn(0x7f18cc0ccb00 0x7f18cc0d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 -- 172.21.15.149:0/146241492 >> 172.21.15.149:0/146241492 conn(0x7f18cc072120 msgr2=0x7f18cc06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 -- 172.21.15.149:0/146241492 shutdown_connections 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.305+0000 7f18d3e5d700 1 -- 172.21.15.149:0/146241492 wait complete. 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.306+0000 7f18d3e5d700 1 Processor -- start 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.306+0000 7f18d3e5d700 1 -- start start 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d3e5d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18cc0b43f0 0x7f18cc0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.311 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d3e5d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d3e5d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc0ccb00 0x7f18cc145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d3e5d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc1f2d90 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d3e5d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0cb2b0 con 0x7f18cc0ccb00 2023-06-09T04:37:05.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d3e5d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0cb590 con 0x7f18cc0b43f0 2023-06-09T04:37:05.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d13f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d13f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36230/0 (socket says 172.21.15.149:36230) 2023-06-09T04:37:05.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d13f8700 1 -- 172.21.15.149:0/2921010427 learned_addr learned my addr 172.21.15.149:0/2921010427 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d1bf9700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18cc0b43f0 0x7f18cc0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.307+0000 7f18d23fa700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc0ccb00 0x7f18cc145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d13f8700 1 -- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18cc0b43f0 msgr2=0x7f18cc0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d13f8700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18cc0b43f0 0x7f18cc0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d13f8700 1 -- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc0ccb00 msgr2=0x7f18cc145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d13f8700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc0ccb00 0x7f18cc145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d13f8700 1 -- 172.21.15.149:0/2921010427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4009b30 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d23fa700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc0ccb00 0x7f18cc145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d1bf9700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18cc0b43f0 0x7f18cc0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d13f8700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0cc350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d7d0 tx=0x7f18c800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18c27fc700 1 -- 172.21.15.149:0/2921010427 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80125f0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18c27fc700 1 -- 172.21.15.149:0/2921010427 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c8012750 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc0cb870 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18c27fc700 1 -- 172.21.15.149:0/2921010427 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8012ac0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.308+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc0cbe30 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.309+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc0cbff0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.309+0000 7f18c27fc700 1 -- 172.21.15.149:0/2921010427 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f18c8012c20 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.310+0000 7f18c27fc700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f18b006ace0 0x7f18b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.310+0000 7f18c27fc700 1 -- 172.21.15.149:0/2921010427 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f18c8089b60 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.310+0000 7f18d1bf9700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f18b006ace0 0x7f18b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.310+0000 7f18d1bf9700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f18b006ace0 0x7f18b006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18bc003fc0 tx=0x7f18bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.315+0000 7f18c27fc700 1 -- 172.21.15.149:0/2921010427 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f18c80583b0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.503+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f18cc073fa0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.503+0000 7f18c27fc700 1 -- 172.21.15.149:0/2921010427 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18c8012ed0 con 0x7f18cc0b4ed0 2023-06-09T04:37:05.505 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:05.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.505+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f18b006ace0 msgr2=0x7f18b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f18b006ace0 0x7f18b006d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18bc003fc0 tx=0x7f18bc009040 comp rx=0 tx=0).stop 2023-06-09T04:37:05.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 msgr2=0x7f18cc0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0cc350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d7d0 tx=0x7f18c800db90 comp rx=0 tx=0).stop 2023-06-09T04:37:05.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 shutdown_connections 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f18b006ace0 0x7f18b006d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f18cc0b43f0 0x7f18cc0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f18cc0ccb00 0x7f18cc145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 --2- 172.21.15.149:0/2921010427 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18cc0b4ed0 0x7f18cc0cc350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 >> 172.21.15.149:0/2921010427 conn(0x7f18cc072120 msgr2=0x7f18cc0d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 shutdown_connections 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.506+0000 7f18d3e5d700 1 -- 172.21.15.149:0/2921010427 wait complete. 2023-06-09T04:37:05.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:05.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.641+0000 7fd0974a7700 1 Processor -- start 2023-06-09T04:37:05.643 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.641+0000 7fd0974a7700 1 -- start start 2023-06-09T04:37:05.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd0974a7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd090159380 0x7fd0900716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd0974a7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd0900b1dc0 0x7fd0900cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd0974a7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09006f480 con 0x7fd090071d50 2023-06-09T04:37:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd0974a7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900b10d0 con 0x7fd0900b1dc0 2023-06-09T04:37:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd0974a7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900cb590 con 0x7fd090159380 2023-06-09T04:37:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd094a42700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd0900b1dc0 0x7fd0900cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd094a42700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd0900b1dc0 0x7fd0900cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36236/0 (socket says 172.21.15.149:36236) 2023-06-09T04:37:05.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd094a42700 1 -- 172.21.15.149:0/2109070155 learned_addr learned my addr 172.21.15.149:0/2109070155 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd095a44700 1 --1- 172.21.15.149:0/2109070155 >> v1:172.21.15.149:6789/0 conn(0x7fd090071d50 0x7fd09015cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60104/0 (socket says 172.21.15.149:60104) 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd095243700 1 --2- 172.21.15.149:0/2109070155 >> v2:172.21.15.184:3300/0 conn(0x7fd090159380 0x7fd0900716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd094a42700 1 -- 172.21.15.149:0/2109070155 >> v2:172.21.15.184:3300/0 conn(0x7fd090159380 msgr2=0x7fd0900716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd094a42700 1 --2- 172.21.15.149:0/2109070155 >> v2:172.21.15.184:3300/0 conn(0x7fd090159380 0x7fd0900716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd094a42700 1 -- 172.21.15.149:0/2109070155 >> v1:172.21.15.149:6789/0 conn(0x7fd090071d50 legacy=0x7fd09015cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.642+0000 7fd094a42700 1 -- 172.21.15.149:0/2109070155 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09006f760 con 0x7fd0900b1dc0 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd094a42700 1 --2- 172.21.15.149:0/2109070155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0900b1dc0 0x7fd0900cd220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd090066830 tx=0x7fd08c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83dc0eceb93245fd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd087fff700 1 -- 172.21.15.149:0/2109070155 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00b870 con 0x7fd0900b1dc0 2023-06-09T04:37:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd087fff700 1 -- 172.21.15.149:0/2109070155 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c00b9d0 con 0x7fd0900b1dc0 2023-06-09T04:37:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd087fff700 1 -- 172.21.15.149:0/2109070155 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00bd60 con 0x7fd0900b1dc0 2023-06-09T04:37:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 -- 172.21.15.149:0/2109070155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0900b1dc0 msgr2=0x7fd0900cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 --2- 172.21.15.149:0/2109070155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0900b1dc0 0x7fd0900cd220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd090066830 tx=0x7fd08c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 -- 172.21.15.149:0/2109070155 shutdown_connections 2023-06-09T04:37:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 --2- 172.21.15.149:0/2109070155 >> v2:172.21.15.184:3300/0 conn(0x7fd090159380 0x7fd0900716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.647 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 --2- 172.21.15.149:0/2109070155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0900b1dc0 0x7fd0900cd220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 -- 172.21.15.149:0/2109070155 >> 172.21.15.149:0/2109070155 conn(0x7fd09006aec0 msgr2=0x7fd09006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 -- 172.21.15.149:0/2109070155 shutdown_connections 2023-06-09T04:37:05.648 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.643+0000 7fd0974a7700 1 -- 172.21.15.149:0/2109070155 wait complete. 2023-06-09T04:37:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 Processor -- start 2023-06-09T04:37:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 -- start start 2023-06-09T04:37:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd090071d50 0x7fd0900c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0900b1dc0 0x7fd090147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.650 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd090159380 0x7fd0900c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c7130 con 0x7fd090071d50 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090148bb0 con 0x7fd0900b1dc0 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd0974a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c7340 con 0x7fd090159380 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd095243700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd090071d50 0x7fd0900c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd095243700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd090071d50 0x7fd0900c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36242/0 (socket says 172.21.15.149:36242) 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.645+0000 7fd095243700 1 -- 172.21.15.149:0/3054213870 learned_addr learned my addr 172.21.15.149:0/3054213870 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd094a42700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0900b1dc0 0x7fd090147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.651 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095a44700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd090159380 0x7fd0900c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095243700 1 -- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd090159380 msgr2=0x7fd0900c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095243700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd090159380 0x7fd0900c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095243700 1 -- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0900b1dc0 msgr2=0x7fd090147a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095243700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0900b1dc0 0x7fd090147a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095243700 1 -- 172.21.15.149:0/3054213870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c009550 con 0x7fd090071d50 2023-06-09T04:37:05.652 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095a44700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd090159380 0x7fd0900c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd095243700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd090071d50 0x7fd0900c6ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd08000e810 tx=0x7fd08000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd085ffb700 1 -- 172.21.15.149:0/3054213870 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080013610 con 0x7fd090071d50 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd085ffb700 1 -- 172.21.15.149:0/3054213870 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080013770 con 0x7fd090071d50 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0900c7620 con 0x7fd090071d50 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd085ffb700 1 -- 172.21.15.149:0/3054213870 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080013b20 con 0x7fd090071d50 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.646+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0900c9350 con 0x7fd090071d50 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.647+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd090148ee0 con 0x7fd090071d50 2023-06-09T04:37:05.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.648+0000 7fd085ffb700 1 -- 172.21.15.149:0/3054213870 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd080013c80 con 0x7fd090071d50 2023-06-09T04:37:05.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.648+0000 7fd085ffb700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd07406ace0 0x7fd07406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.648+0000 7fd085ffb700 1 -- 172.21.15.149:0/3054213870 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd080089360 con 0x7fd090071d50 2023-06-09T04:37:05.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.648+0000 7fd094a42700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd07406ace0 0x7fd07406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.648+0000 7fd094a42700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd07406ace0 0x7fd07406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd08c000c00 tx=0x7fd08c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.653+0000 7fd085ffb700 1 -- 172.21.15.149:0/3054213870 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd080057bc0 con 0x7fd090071d50 2023-06-09T04:37:05.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.839+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0900c9540 con 0x7fd090071d50 2023-06-09T04:37:05.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.839+0000 7fd085ffb700 1 -- 172.21.15.149:0/3054213870 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd080057750 con 0x7fd090071d50 2023-06-09T04:37:05.841 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:05.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd07406ace0 msgr2=0x7fd07406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd07406ace0 0x7fd07406d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd08c000c00 tx=0x7fd08c008030 comp rx=0 tx=0).stop 2023-06-09T04:37:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd090071d50 msgr2=0x7fd0900c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd090071d50 0x7fd0900c6ae0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd08000e810 tx=0x7fd08000eb20 comp rx=0 tx=0).stop 2023-06-09T04:37:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 shutdown_connections 2023-06-09T04:37:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd07406ace0 0x7fd07406d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd090159380 0x7fd0900c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd090071d50 0x7fd0900c6ae0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 --2- 172.21.15.149:0/3054213870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0900b1dc0 0x7fd090147a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 >> 172.21.15.149:0/3054213870 conn(0x7fd09006aec0 msgr2=0x7fd09014d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:05.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 shutdown_connections 2023-06-09T04:37:05.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.842+0000 7fd0974a7700 1 -- 172.21.15.149:0/3054213870 wait complete. 2023-06-09T04:37:05.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:05.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.977+0000 7f78d2e31700 1 Processor -- start 2023-06-09T04:37:05.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.977+0000 7f78d2e31700 1 -- start start 2023-06-09T04:37:05.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f78cc071770 0x7f78cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f78cc15c6f0 0x7f78cc06a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78cc071290 con 0x7f78cc15c320 2023-06-09T04:37:05.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc0b2050 con 0x7f78cc071770 2023-06-09T04:37:05.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc0cd2c0 con 0x7f78cc15c6f0 2023-06-09T04:37:05.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f78cc071770 0x7f78cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f78cc071770 0x7f78cc069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36252/0 (socket says 172.21.15.149:36252) 2023-06-09T04:37:05.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 -- 172.21.15.149:0/1577279522 learned_addr learned my addr 172.21.15.149:0/1577279522 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:05.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d0bcd700 1 --1- 172.21.15.149:0/1577279522 >> v1:172.21.15.149:6789/0 conn(0x7f78cc15c320 0x7f78cc0cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60114/0 (socket says 172.21.15.149:60114) 2023-06-09T04:37:05.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d13ce700 1 --2- 172.21.15.149:0/1577279522 >> v2:172.21.15.184:3300/0 conn(0x7f78cc15c6f0 0x7f78cc06a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 -- 172.21.15.149:0/1577279522 >> v2:172.21.15.184:3300/0 conn(0x7f78cc15c6f0 msgr2=0x7f78cc06a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:05.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 --2- 172.21.15.149:0/1577279522 >> v2:172.21.15.184:3300/0 conn(0x7f78cc15c6f0 0x7f78cc06a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 -- 172.21.15.149:0/1577279522 >> v1:172.21.15.149:6789/0 conn(0x7f78cc15c320 legacy=0x7f78cc0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cb7fe700 1 -- 172.21.15.149:0/1577279522 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077845481 0 0) 0x7f78cc071290 con 0x7f78cc15c320 2023-06-09T04:37:05.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 -- 172.21.15.149:0/1577279522 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0cd5a0 con 0x7f78cc071770 2023-06-09T04:37:05.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cbfff700 1 --2- 172.21.15.149:0/1577279522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc071770 0x7f78cc069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0c9c30 tx=0x7f78b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b462cf2ab4b7000 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cb7fe700 1 -- 172.21.15.149:0/1577279522 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800b870 con 0x7f78cc071770 2023-06-09T04:37:05.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cb7fe700 1 -- 172.21.15.149:0/1577279522 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800b9d0 con 0x7f78cc071770 2023-06-09T04:37:05.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78cb7fe700 1 -- 172.21.15.149:0/1577279522 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800bd60 con 0x7f78cc071770 2023-06-09T04:37:05.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- 172.21.15.149:0/1577279522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc071770 msgr2=0x7f78cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 --2- 172.21.15.149:0/1577279522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc071770 0x7f78cc069db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78cc0c9c30 tx=0x7f78b8009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- 172.21.15.149:0/1577279522 shutdown_connections 2023-06-09T04:37:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 --2- 172.21.15.149:0/1577279522 >> v2:172.21.15.184:3300/0 conn(0x7f78cc15c6f0 0x7f78cc06a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 --2- 172.21.15.149:0/1577279522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc071770 0x7f78cc069db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- 172.21.15.149:0/1577279522 >> 172.21.15.149:0/1577279522 conn(0x7f78cc06aec0 msgr2=0x7f78cc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- 172.21.15.149:0/1577279522 shutdown_connections 2023-06-09T04:37:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.979+0000 7f78d2e31700 1 -- 172.21.15.149:0/1577279522 wait complete. 2023-06-09T04:37:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.980+0000 7f78d2e31700 1 Processor -- start 2023-06-09T04:37:05.985 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.980+0000 7f78d2e31700 1 -- start start 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78d2e31700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78cc071770 0x7f78cc14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78d2e31700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc15c320 0x7f78cc15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78d2e31700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78cc15c6f0 0x7f78cc15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78d2e31700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15d370 con 0x7f78cc15c320 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78d2e31700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15d650 con 0x7f78cc071770 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78d2e31700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15d930 con 0x7f78cc15c6f0 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78cbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc15c320 0x7f78cc15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78cbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc15c320 0x7f78cc15e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36258/0 (socket says 172.21.15.149:36258) 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.981+0000 7f78cbfff700 1 -- 172.21.15.149:0/786243939 learned_addr learned my addr 172.21.15.149:0/786243939 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78cbfff700 1 -- 172.21.15.149:0/786243939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78cc15c6f0 msgr2=0x7f78cc15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78d0bcd700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78cc071770 0x7f78cc14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78cbfff700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78cc15c6f0 0x7f78cc15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78cbfff700 1 -- 172.21.15.149:0/786243939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78cc071770 msgr2=0x7f78cc14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78cbfff700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78cc071770 0x7f78cc14fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78cbfff700 1 -- 172.21.15.149:0/786243939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b8009550 con 0x7f78cc15c320 2023-06-09T04:37:05.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78cbfff700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc15c320 0x7f78cc15e410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009c10 tx=0x7f78b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78c97fa700 1 -- 172.21.15.149:0/786243939 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8004250 con 0x7f78cc15c320 2023-06-09T04:37:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78c97fa700 1 -- 172.21.15.149:0/786243939 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b801f070 con 0x7f78cc15c320 2023-06-09T04:37:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc15dc10 con 0x7f78cc15c320 2023-06-09T04:37:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78c97fa700 1 -- 172.21.15.149:0/786243939 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80045d0 con 0x7f78cc15c320 2023-06-09T04:37:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.982+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc15d060 con 0x7f78cc15c320 2023-06-09T04:37:05.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.983+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc15e130 con 0x7f78cc15c320 2023-06-09T04:37:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.983+0000 7f78c97fa700 1 -- 172.21.15.149:0/786243939 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78b8021030 con 0x7f78cc15c320 2023-06-09T04:37:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.984+0000 7f78c97fa700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f78b006ace0 0x7f78b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.984+0000 7f78c97fa700 1 -- 172.21.15.149:0/786243939 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f78b808aaf0 con 0x7f78cc15c320 2023-06-09T04:37:05.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.984+0000 7f78d0bcd700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f78b006ace0 0x7f78b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.984+0000 7f78d0bcd700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f78b006ace0 0x7f78b006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78c0000f60 tx=0x7f78c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:05.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:05.989+0000 7f78c97fa700 1 -- 172.21.15.149:0/786243939 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78cc15e130 con 0x7f78cc15c320 2023-06-09T04:37:06.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.176+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78cc15e130 con 0x7f78cc15c320 2023-06-09T04:37:06.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.176+0000 7f78c97fa700 1 -- 172.21.15.149:0/786243939 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78cc15e130 con 0x7f78cc15c320 2023-06-09T04:37:06.177 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:06.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f78b006ace0 msgr2=0x7f78b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f78b006ace0 0x7f78b006d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78c0000f60 tx=0x7f78c0009040 comp rx=0 tx=0).stop 2023-06-09T04:37:06.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc15c320 msgr2=0x7f78cc15e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc15c320 0x7f78cc15e410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009c10 tx=0x7f78b8004750 comp rx=0 tx=0).stop 2023-06-09T04:37:06.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 shutdown_connections 2023-06-09T04:37:06.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f78b006ace0 0x7f78b006d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f78cc15c6f0 0x7f78cc15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f78cc071770 0x7f78cc14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 --2- 172.21.15.149:0/786243939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f78cc15c320 0x7f78cc15e410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 >> 172.21.15.149:0/786243939 conn(0x7f78cc06aec0 msgr2=0x7f78cc0af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:06.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 shutdown_connections 2023-06-09T04:37:06.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.178+0000 7f78d2e31700 1 -- 172.21.15.149:0/786243939 wait complete. 2023-06-09T04:37:06.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:06.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.313+0000 7f38653d5700 1 Processor -- start 2023-06-09T04:37:06.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.313+0000 7f38653d5700 1 -- start start 2023-06-09T04:37:06.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.314+0000 7f38653d5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f386015c520 0x7f3860071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.314+0000 7f38653d5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 0x7f38600b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.314+0000 7f38653d5700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386015c8f0 con 0x7f38600cee20 2023-06-09T04:37:06.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.314+0000 7f38653d5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600cd940 con 0x7f386015c520 2023-06-09T04:37:06.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.314+0000 7f38653d5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600b20f0 con 0x7f386006a4c0 2023-06-09T04:37:06.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.314+0000 7f385e7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f38600cee20 0x7f3860069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60130/0 (socket says 172.21.15.149:60130) 2023-06-09T04:37:06.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.314+0000 7f385e7fc700 1 -- 172.21.15.149:0/1692459335 learned_addr learned my addr 172.21.15.149:0/1692459335 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:06.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385effd700 1 --2- 172.21.15.149:0/1692459335 >> v2:172.21.15.184:3300/0 conn(0x7f386015c520 0x7f3860071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 0x7f38600b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518704828 0 0) 0x7f3854001110 con 0x7f38600cee20 2023-06-09T04:37:06.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38480035b0 con 0x7f38600cee20 2023-06-09T04:37:06.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620076314 0 0) 0x7f38480035b0 con 0x7f38600cee20 2023-06-09T04:37:06.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 msgr2=0x7f38600b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:06.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 0x7f38600b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 >> v2:172.21.15.184:3300/0 conn(0x7f386015c520 msgr2=0x7f3860071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 --2- 172.21.15.149:0/1692459335 >> v2:172.21.15.184:3300/0 conn(0x7f386015c520 0x7f3860071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600cd3c0 con 0x7f38600cee20 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f3854001800 con 0x7f38600cee20 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 >> v1:172.21.15.149:6789/0 conn(0x7f38600cee20 legacy=0x7f3860069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 0x7f3848003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848003fb0 0x7f3848004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3848004d90 0x7f3848005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600cd940 con 0x7f3848004d90 2023-06-09T04:37:06.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600b20f0 con 0x7f3848003fb0 2023-06-09T04:37:06.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384800ba60 con 0x7f386006a4c0 2023-06-09T04:37:06.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3848004d90 0x7f3848005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385e7fc700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848003fb0 0x7f3848004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385effd700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 0x7f3848003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 -- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 msgr2=0x7f3848003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f386006a4c0 0x7f3848003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 -- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848003fb0 msgr2=0x7f3848004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848003fb0 0x7f3848004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 -- 172.21.15.149:0/1692459335 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38480035b0 con 0x7f3848004d90 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.315+0000 7f385f7fe700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3848004d90 0x7f3848005200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3858009f90 tx=0x7f3848005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b0feef6fa209c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385800ec30 con 0x7f3848004d90 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385800f040 con 0x7f3848004d90 2023-06-09T04:37:06.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f385dffb700 1 -- 172.21.15.149:0/1692459335 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858014480 con 0x7f3848004d90 2023-06-09T04:37:06.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f38653d5700 1 -- 172.21.15.149:0/1692459335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3848004d90 msgr2=0x7f3848005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f38653d5700 1 --2- 172.21.15.149:0/1692459335 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3848004d90 0x7f3848005200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3858009f90 tx=0x7f3848005880 comp rx=0 tx=0).stop 2023-06-09T04:37:06.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f385f7fe700 1 -- 172.21.15.149:0/1692459335 reap_dead start 2023-06-09T04:37:06.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f38653d5700 1 -- 172.21.15.149:0/1692459335 shutdown_connections 2023-06-09T04:37:06.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f38653d5700 1 -- 172.21.15.149:0/1692459335 >> 172.21.15.149:0/1692459335 conn(0x7f386006aec0 msgr2=0x7f386006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:06.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f38653d5700 1 -- 172.21.15.149:0/1692459335 shutdown_connections 2023-06-09T04:37:06.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.316+0000 7f38653d5700 1 -- 172.21.15.149:0/1692459335 wait complete. 2023-06-09T04:37:06.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.318+0000 7f38653d5700 1 Processor -- start 2023-06-09T04:37:06.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.318+0000 7f38653d5700 1 -- start start 2023-06-09T04:37:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f38653d5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848004d90 0x7f38600c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f38653d5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3860153ba0 0x7f38600c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f38653d5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600c4f50 0x7f386015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f38653d5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600c53f0 con 0x7f3860153ba0 2023-06-09T04:37:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f38653d5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600c42d0 con 0x7f3848004d90 2023-06-09T04:37:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f38653d5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38600c3900 con 0x7f38600c4f50 2023-06-09T04:37:06.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3860153ba0 0x7f38600c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3860153ba0 0x7f38600c4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36276/0 (socket says 172.21.15.149:36276) 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 -- 172.21.15.149:0/3320422401 learned_addr learned my addr 172.21.15.149:0/3320422401 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385f7fe700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600c4f50 0x7f386015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385effd700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848004d90 0x7f38600c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 -- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600c4f50 msgr2=0x7f386015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600c4f50 0x7f386015ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 -- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848004d90 msgr2=0x7f38600c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848004d90 0x7f38600c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 -- 172.21.15.149:0/3320422401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600c8e20 con 0x7f3860153ba0 2023-06-09T04:37:06.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.319+0000 7f385e7fc700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3860153ba0 0x7f38600c4a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f38540072c0 tx=0x7f38540075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.320+0000 7f38477fe700 1 -- 172.21.15.149:0/3320422401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385400f640 con 0x7f3860153ba0 2023-06-09T04:37:06.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.320+0000 7f38477fe700 1 -- 172.21.15.149:0/3320422401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385400f7a0 con 0x7f3860153ba0 2023-06-09T04:37:06.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.320+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38600c55f0 con 0x7f3860153ba0 2023-06-09T04:37:06.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.320+0000 7f38477fe700 1 -- 172.21.15.149:0/3320422401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385400fb50 con 0x7f3860153ba0 2023-06-09T04:37:06.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.320+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38600c3590 con 0x7f3860153ba0 2023-06-09T04:37:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.321+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3860073fa0 con 0x7f3860153ba0 2023-06-09T04:37:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.321+0000 7f38477fe700 1 -- 172.21.15.149:0/3320422401 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f385400fcb0 con 0x7f3860153ba0 2023-06-09T04:37:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.321+0000 7f38477fe700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f384c06ace0 0x7f384c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.322+0000 7f38477fe700 1 -- 172.21.15.149:0/3320422401 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3854088eb0 con 0x7f3860153ba0 2023-06-09T04:37:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.322+0000 7f385effd700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f384c06ace0 0x7f384c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.322+0000 7f385effd700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f384c06ace0 0x7f384c06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3850009ce0 tx=0x7f3850009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.326+0000 7f38477fe700 1 -- 172.21.15.149:0/3320422401 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3854053d00 con 0x7f3860153ba0 2023-06-09T04:37:06.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.516+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38600c3a40 con 0x7f3860153ba0 2023-06-09T04:37:06.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.516+0000 7f38477fe700 1 -- 172.21.15.149:0/3320422401 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f385401a0a0 con 0x7f3860153ba0 2023-06-09T04:37:06.517 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:06.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f384c06ace0 msgr2=0x7f384c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f384c06ace0 0x7f384c06d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3850009ce0 tx=0x7f3850009210 comp rx=0 tx=0).stop 2023-06-09T04:37:06.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3860153ba0 msgr2=0x7f38600c4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3860153ba0 0x7f38600c4a10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f38540072c0 tx=0x7f38540075d0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 shutdown_connections 2023-06-09T04:37:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f384c06ace0 0x7f384c06d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38600c4f50 0x7f386015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3848004d90 0x7f38600c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 --2- 172.21.15.149:0/3320422401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3860153ba0 0x7f38600c4a10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 >> 172.21.15.149:0/3320422401 conn(0x7f386006aec0 msgr2=0x7f3860157890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 shutdown_connections 2023-06-09T04:37:06.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.519+0000 7f38653d5700 1 -- 172.21.15.149:0/3320422401 wait complete. 2023-06-09T04:37:06.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:06.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.654+0000 7f757ae90700 1 Processor -- start 2023-06-09T04:37:06.654 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.654+0000 7f757ae90700 1 -- start start 2023-06-09T04:37:06.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.654+0000 7f757ae90700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f757415c300 0x7f7574071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757ae90700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7574069db0 0x7f757406a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757ae90700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75740cf4c0 con 0x7f757415c6d0 2023-06-09T04:37:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757ae90700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740b2090 con 0x7f7574069db0 2023-06-09T04:37:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757ae90700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757406a730 con 0x7f757415c300 2023-06-09T04:37:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7574069db0 0x7f757406a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7574069db0 0x7f757406a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36288/0 (socket says 172.21.15.149:36288) 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f7573fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f757415c6d0 0x7f75740cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60150/0 (socket says 172.21.15.149:60150) 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 -- 172.21.15.149:0/1221020745 learned_addr learned my addr 172.21.15.149:0/1221020745 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f7578c2c700 1 --2- 172.21.15.149:0/1221020745 >> v2:172.21.15.184:3300/0 conn(0x7f757415c300 0x7f7574071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 -- 172.21.15.149:0/1221020745 >> v2:172.21.15.184:3300/0 conn(0x7f757415c300 msgr2=0x7f7574071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 --2- 172.21.15.149:0/1221020745 >> v2:172.21.15.184:3300/0 conn(0x7f757415c300 0x7f7574071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 -- 172.21.15.149:0/1221020745 >> v1:172.21.15.149:6789/0 conn(0x7f757415c6d0 legacy=0x7f75740cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 -- 172.21.15.149:0/1221020745 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740cd910 con 0x7f7574069db0 2023-06-09T04:37:06.657 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f75737fe700 1 -- 172.21.15.149:0/1221020745 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318645249 0 0) 0x7f75740cf4c0 con 0x7f757415c6d0 2023-06-09T04:37:06.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f757942d700 1 --2- 172.21.15.149:0/1221020745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f757406a1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f75740b1340 tx=0x7f756c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32962be57818011 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f75737fe700 1 -- 172.21.15.149:0/1221020745 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00e070 con 0x7f7574069db0 2023-06-09T04:37:06.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f75737fe700 1 -- 172.21.15.149:0/1221020745 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00b9c0 con 0x7f7574069db0 2023-06-09T04:37:06.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.655+0000 7f75737fe700 1 -- 172.21.15.149:0/1221020745 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00bd70 con 0x7f7574069db0 2023-06-09T04:37:06.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 -- 172.21.15.149:0/1221020745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 msgr2=0x7f757406a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 --2- 172.21.15.149:0/1221020745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f757406a1f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f75740b1340 tx=0x7f756c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:06.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 -- 172.21.15.149:0/1221020745 shutdown_connections 2023-06-09T04:37:06.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 --2- 172.21.15.149:0/1221020745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f757406a1f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 --2- 172.21.15.149:0/1221020745 >> v2:172.21.15.184:3300/0 conn(0x7f757415c300 0x7f7574071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 -- 172.21.15.149:0/1221020745 >> 172.21.15.149:0/1221020745 conn(0x7f757406aec0 msgr2=0x7f757406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:06.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 -- 172.21.15.149:0/1221020745 shutdown_connections 2023-06-09T04:37:06.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.656+0000 7f757ae90700 1 -- 172.21.15.149:0/1221020745 wait complete. 2023-06-09T04:37:06.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.657+0000 7f757ae90700 1 Processor -- start 2023-06-09T04:37:06.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.657+0000 7f757ae90700 1 -- start start 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757ae90700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f75740b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757ae90700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f757415c300 0x7f75740b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757ae90700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f757415c6d0 0x7f7574153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757ae90700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75740c3180 con 0x7f7574069db0 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757ae90700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75740b3630 con 0x7f757415c6d0 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757ae90700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75740aca40 con 0x7f757415c300 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f75740b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f75740b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36290/0 (socket says 172.21.15.149:36290) 2023-06-09T04:37:06.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 -- 172.21.15.149:0/1978549416 learned_addr learned my addr 172.21.15.149:0/1978549416 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:06.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7573fff700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f757415c300 0x7f75740b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757942d700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f757415c6d0 0x7f7574153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 -- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f757415c300 msgr2=0x7f75740b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f757415c300 0x7f75740b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 -- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f757415c6d0 msgr2=0x7f7574153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f757415c6d0 0x7f7574153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7578c2c700 1 -- 172.21.15.149:0/1978549416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009b30 con 0x7f7574069db0 2023-06-09T04:37:06.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f7573fff700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f757415c300 0x7f75740b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:06.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.658+0000 7f757942d700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f757415c6d0 0x7f7574153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:06.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.659+0000 7f7578c2c700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f75740b4e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f756800e810 tx=0x7f756800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.659+0000 7f75717fa700 1 -- 172.21.15.149:0/1978549416 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568013610 con 0x7f7574069db0 2023-06-09T04:37:06.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.659+0000 7f75717fa700 1 -- 172.21.15.149:0/1978549416 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568013770 con 0x7f7574069db0 2023-06-09T04:37:06.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.659+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75740acd20 con 0x7f7574069db0 2023-06-09T04:37:06.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.659+0000 7f75717fa700 1 -- 172.21.15.149:0/1978549416 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568013b20 con 0x7f7574069db0 2023-06-09T04:37:06.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.659+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75740b5380 con 0x7f7574069db0 2023-06-09T04:37:06.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.660+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75740ae6a0 con 0x7f7574069db0 2023-06-09T04:37:06.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.660+0000 7f75717fa700 1 -- 172.21.15.149:0/1978549416 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7568013c80 con 0x7f7574069db0 2023-06-09T04:37:06.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.660+0000 7f75717fa700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f755806ace0 0x7f755806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.661+0000 7f75717fa700 1 -- 172.21.15.149:0/1978549416 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7568089420 con 0x7f7574069db0 2023-06-09T04:37:06.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.661+0000 7f7573fff700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f755806ace0 0x7f755806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.661+0000 7f7573fff700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f755806ace0 0x7f755806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7560007fd0 tx=0x7f7560009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.665+0000 7f75717fa700 1 -- 172.21.15.149:0/1978549416 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7568057c80 con 0x7f7574069db0 2023-06-09T04:37:06.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.850+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f757406b7c0 con 0x7f7574069db0 2023-06-09T04:37:06.851 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.851+0000 7f75717fa700 1 -- 172.21.15.149:0/1978549416 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7568057810 con 0x7f7574069db0 2023-06-09T04:37:06.851 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:06.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f755806ace0 msgr2=0x7f755806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f755806ace0 0x7f755806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7560007fd0 tx=0x7f7560009040 comp rx=0 tx=0).stop 2023-06-09T04:37:06.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 msgr2=0x7f75740b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f75740b4e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f756800e810 tx=0x7f756800ebd0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 shutdown_connections 2023-06-09T04:37:06.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f755806ace0 0x7f755806d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f757415c6d0 0x7f7574153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7574069db0 0x7f75740b4e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 --2- 172.21.15.149:0/1978549416 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f757415c300 0x7f75740b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 >> 172.21.15.149:0/1978549416 conn(0x7f757406aec0 msgr2=0x7f7574155b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:06.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 shutdown_connections 2023-06-09T04:37:06.854 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.853+0000 7f757ae90700 1 -- 172.21.15.149:0/1978549416 wait complete. 2023-06-09T04:37:06.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:37:06.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.985+0000 7f438f4bc700 1 Processor -- start 2023-06-09T04:37:06.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.986+0000 7f438f4bc700 1 -- start start 2023-06-09T04:37:06.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.986+0000 7f438f4bc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f438806b430 0x7f43880cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.986+0000 7f438f4bc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880ca1e0 con 0x7f4388070900 2023-06-09T04:37:06.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.986+0000 7f438f4bc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880ae480 con 0x7f438806aee0 2023-06-09T04:37:06.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.986+0000 7f438f4bc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438815e580 con 0x7f438806b430 2023-06-09T04:37:06.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f438d258700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4388070900 0x7f4388070cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60162/0 (socket says 172.21.15.149:60162) 2023-06-09T04:37:06.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f438d258700 1 -- 172.21.15.149:0/1841866397 learned_addr learned my addr 172.21.15.149:0/1841866397 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:06.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f438da59700 1 --2- 172.21.15.149:0/1841866397 >> v2:172.21.15.184:3300/0 conn(0x7f438806b430 0x7f43880cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f437ffff700 1 -- 172.21.15.149:0/1841866397 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748014005 0 0) 0x7f43880ca1e0 con 0x7f4388070900 2023-06-09T04:37:06.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f437ffff700 1 -- 172.21.15.149:0/1841866397 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43740035b0 con 0x7f4388070900 2023-06-09T04:37:06.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f438da59700 1 -- 172.21.15.149:0/1841866397 >> v1:172.21.15.184:6789/0 conn(0x7f438806aee0 legacy=0x7f43880caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f438da59700 1 -- 172.21.15.149:0/1841866397 >> v1:172.21.15.149:6789/0 conn(0x7f4388070900 legacy=0x7f4388070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f438da59700 1 -- 172.21.15.149:0/1841866397 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438815eab0 con 0x7f438806b430 2023-06-09T04:37:06.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f438da59700 1 --2- 172.21.15.149:0/1841866397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806b430 0x7f43880cca00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4380009d90 tx=0x7f438000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd262ab154e48ebb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f437ffff700 1 -- 172.21.15.149:0/1841866397 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000e070 con 0x7f438806b430 2023-06-09T04:37:06.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f437ffff700 1 -- 172.21.15.149:0/1841866397 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000bb20 con 0x7f438806b430 2023-06-09T04:37:06.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.987+0000 7f437ffff700 1 -- 172.21.15.149:0/1841866397 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4380012430 con 0x7f438806b430 2023-06-09T04:37:06.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.988+0000 7f438f4bc700 1 -- 172.21.15.149:0/1841866397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806b430 msgr2=0x7f43880cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.988+0000 7f438f4bc700 1 --2- 172.21.15.149:0/1841866397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806b430 0x7f43880cca00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4380009d90 tx=0x7f438000b330 comp rx=0 tx=0).stop 2023-06-09T04:37:06.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.988+0000 7f438f4bc700 1 -- 172.21.15.149:0/1841866397 shutdown_connections 2023-06-09T04:37:06.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.988+0000 7f438f4bc700 1 --2- 172.21.15.149:0/1841866397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806b430 0x7f43880cca00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.988+0000 7f438f4bc700 1 -- 172.21.15.149:0/1841866397 >> 172.21.15.149:0/1841866397 conn(0x7f43880cee30 msgr2=0x7f43880cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:06.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.988+0000 7f438f4bc700 1 -- 172.21.15.149:0/1841866397 shutdown_connections 2023-06-09T04:37:06.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.988+0000 7f438f4bc700 1 -- 172.21.15.149:0/1841866397 wait complete. 2023-06-09T04:37:06.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.989+0000 7f438f4bc700 1 Processor -- start 2023-06-09T04:37:06.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.989+0000 7f438f4bc700 1 -- start start 2023-06-09T04:37:06.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438f4bc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806aee0 0x7f4388156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438f4bc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f438806b430 0x7f43880b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438f4bc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4388070900 0x7f43880c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438f4bc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43880c6f50 con 0x7f438806b430 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438f4bc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43881573a0 con 0x7f438806aee0 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438f4bc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43880b0710 con 0x7f4388070900 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f438806b430 0x7f43880b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f438806b430 0x7f43880b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36306/0 (socket says 172.21.15.149:36306) 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 -- 172.21.15.149:0/2316220069 learned_addr learned my addr 172.21.15.149:0/2316220069 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438da59700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4388070900 0x7f43880c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438d258700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806aee0 0x7f4388156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 -- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4388070900 msgr2=0x7f43880c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4388070900 0x7f43880c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 -- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806aee0 msgr2=0x7f4388156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806aee0 0x7f4388156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.990+0000 7f438ca57700 1 -- 172.21.15.149:0/2316220069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4380009a70 con 0x7f438806b430 2023-06-09T04:37:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.991+0000 7f438ca57700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f438806b430 0x7f43880b01d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f437800c4e0 tx=0x7f437800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.991+0000 7f437dffb700 1 -- 172.21.15.149:0/2316220069 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780052d0 con 0x7f438806b430 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.991+0000 7f437dffb700 1 -- 172.21.15.149:0/2316220069 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378005430 con 0x7f438806b430 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.991+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43880c71a0 con 0x7f438806b430 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.991+0000 7f437dffb700 1 -- 172.21.15.149:0/2316220069 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780038c0 con 0x7f438806b430 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.991+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43880c7760 con 0x7f438806b430 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.992+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4388073fa0 con 0x7f438806b430 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.992+0000 7f437dffb700 1 -- 172.21.15.149:0/2316220069 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4378003a20 con 0x7f438806b430 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.993+0000 7f437dffb700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f436c06ace0 0x7f436c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.993+0000 7f437dffb700 1 -- 172.21.15.149:0/2316220069 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4378088af0 con 0x7f438806b430 2023-06-09T04:37:06.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.993+0000 7f438d258700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f436c06ace0 0x7f436c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:06.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.993+0000 7f438d258700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f436c06ace0 0x7f436c06d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43840011e0 tx=0x7f4384009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:06.997 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:06.997+0000 7f437dffb700 1 -- 172.21.15.149:0/2316220069 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43780538a0 con 0x7f438806b430 2023-06-09T04:37:07.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.198+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f43880ae480 con 0x7f438806b430 2023-06-09T04:37:07.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.199+0000 7f437dffb700 1 -- 172.21.15.149:0/2316220069 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f43880ae480 con 0x7f438806b430 2023-06-09T04:37:07.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f436c06ace0 msgr2=0x7f436c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:07.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f436c06ace0 0x7f436c06d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43840011e0 tx=0x7f4384009040 comp rx=0 tx=0).stop 2023-06-09T04:37:07.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f438806b430 msgr2=0x7f43880b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:07.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f438806b430 0x7f43880b01d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f437800c4e0 tx=0x7f437800c8a0 comp rx=0 tx=0).stop 2023-06-09T04:37:07.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 shutdown_connections 2023-06-09T04:37:07.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f436c06ace0 0x7f436c06d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:07.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4388070900 0x7f43880c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:07.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f438806aee0 0x7f4388156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:07.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 --2- 172.21.15.149:0/2316220069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f438806b430 0x7f43880b01d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:07.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 >> 172.21.15.149:0/2316220069 conn(0x7f43880cee30 msgr2=0x7f4388158090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:07.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 shutdown_connections 2023-06-09T04:37:07.203 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:07.201+0000 7f438f4bc700 1 -- 172.21.15.149:0/2316220069 wait complete. 2023-06-09T04:37:07.203 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-06-09T04:37:07.213 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi149.front.sepia.ceph.com... 2023-06-09T04:37:07.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:07.214 DEBUG:teuthology.orchestra.run.smithi149:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:37:07.258 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi149.stderr:ceph-fuse[107848]: fuse finished with error 0 and tester_r 0 2023-06-09T04:37:07.259 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:37:13.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:37:13.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:13.361 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-09T04:37:13.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:13.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.558+0000 7ff16a64d700 1 Processor -- start 2023-06-09T04:37:13.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.558+0000 7ff16a64d700 1 -- start start 2023-06-09T04:37:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.558+0000 7ff16a64d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff16406a4c0 0x7ff164071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.558+0000 7ff16a64d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1640cf4c0 con 0x7ff16415c6d0 2023-06-09T04:37:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.558+0000 7ff16a64d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1640b2090 con 0x7ff16415c300 2023-06-09T04:37:13.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.558+0000 7ff16a64d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1640cd910 con 0x7ff16406a4c0 2023-06-09T04:37:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.558+0000 7ff168bea700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff16406a4c0 0x7ff164071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff1637fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff16415c6d0 0x7ff164069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60176/0 (socket says 172.21.15.149:60176) 2023-06-09T04:37:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff1637fe700 1 -- 172.21.15.149:0/1357629847 learned_addr learned my addr 172.21.15.149:0/1357629847 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff168bea700 1 -- 172.21.15.149:0/1357629847 >> v1:172.21.15.184:6789/0 conn(0x7ff16415c300 legacy=0x7ff1640cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff168bea700 1 -- 172.21.15.149:0/1357629847 >> v1:172.21.15.149:6789/0 conn(0x7ff16415c6d0 legacy=0x7ff164069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff168bea700 1 -- 172.21.15.149:0/1357629847 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1640b1db0 con 0x7ff16406a4c0 2023-06-09T04:37:13.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff162ffd700 1 -- 172.21.15.149:0/1357629847 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544451733 0 0) 0x7ff1640cf4c0 con 0x7ff16415c6d0 2023-06-09T04:37:13.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff168bea700 1 --2- 172.21.15.149:0/1357629847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16406a4c0 0x7ff164071fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009d90 tx=0x7ff15c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618595e78c5477b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:13.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff162ffd700 1 -- 172.21.15.149:0/1357629847 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c00e070 con 0x7ff16406a4c0 2023-06-09T04:37:13.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff162ffd700 1 -- 172.21.15.149:0/1357629847 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c00bb90 con 0x7ff16406a4c0 2023-06-09T04:37:13.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.559+0000 7ff162ffd700 1 -- 172.21.15.149:0/1357629847 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c003a20 con 0x7ff16406a4c0 2023-06-09T04:37:13.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.560+0000 7ff16a64d700 1 -- 172.21.15.149:0/1357629847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16406a4c0 msgr2=0x7ff164071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.560+0000 7ff16a64d700 1 --2- 172.21.15.149:0/1357629847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16406a4c0 0x7ff164071fc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009d90 tx=0x7ff15c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:13.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.560+0000 7ff16a64d700 1 -- 172.21.15.149:0/1357629847 shutdown_connections 2023-06-09T04:37:13.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.560+0000 7ff16a64d700 1 --2- 172.21.15.149:0/1357629847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16406a4c0 0x7ff164071fc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.560+0000 7ff16a64d700 1 -- 172.21.15.149:0/1357629847 >> 172.21.15.149:0/1357629847 conn(0x7ff16406aec0 msgr2=0x7ff16406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.560+0000 7ff16a64d700 1 -- 172.21.15.149:0/1357629847 shutdown_connections 2023-06-09T04:37:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.560+0000 7ff16a64d700 1 -- 172.21.15.149:0/1357629847 wait complete. 2023-06-09T04:37:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.561+0000 7ff16a64d700 1 Processor -- start 2023-06-09T04:37:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.561+0000 7ff16a64d700 1 -- start start 2023-06-09T04:37:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff16a64d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff16406a4c0 0x7ff1641f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff16a64d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff16415c300 0x7ff1640c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff16a64d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16415c6d0 0x7ff1640c51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff16a64d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640b2480 con 0x7ff16415c6d0 2023-06-09T04:37:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff16a64d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640c5bd0 con 0x7ff16406a4c0 2023-06-09T04:37:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff16a64d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640ae600 con 0x7ff16415c300 2023-06-09T04:37:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16415c6d0 0x7ff1640c51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16415c6d0 0x7ff1640c51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36322/0 (socket says 172.21.15.149:36322) 2023-06-09T04:37:13.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 -- 172.21.15.149:0/2900519822 learned_addr learned my addr 172.21.15.149:0/2900519822 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff1637fe700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff16415c300 0x7ff1640c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff163fff700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff16406a4c0 0x7ff1641f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 -- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff16415c300 msgr2=0x7ff1640c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff16415c300 0x7ff1640c4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 -- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff16406a4c0 msgr2=0x7ff1641f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff16406a4c0 0x7ff1641f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 -- 172.21.15.149:0/2900519822 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c009a70 con 0x7ff16415c6d0 2023-06-09T04:37:13.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.562+0000 7ff168bea700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16415c6d0 0x7ff1640c51c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00b730 tx=0x7ff15c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:13.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.563+0000 7ff160ff9700 1 -- 172.21.15.149:0/2900519822 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c012630 con 0x7ff16415c6d0 2023-06-09T04:37:13.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.563+0000 7ff160ff9700 1 -- 172.21.15.149:0/2900519822 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c012790 con 0x7ff16415c6d0 2023-06-09T04:37:13.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.563+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1640b2690 con 0x7ff16415c6d0 2023-06-09T04:37:13.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.563+0000 7ff160ff9700 1 -- 172.21.15.149:0/2900519822 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c012b40 con 0x7ff16415c6d0 2023-06-09T04:37:13.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.563+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1640b2c50 con 0x7ff16415c6d0 2023-06-09T04:37:13.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.563+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff164073fa0 con 0x7ff16415c6d0 2023-06-09T04:37:13.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.564+0000 7ff160ff9700 1 -- 172.21.15.149:0/2900519822 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff15c012ca0 con 0x7ff16415c6d0 2023-06-09T04:37:13.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.564+0000 7ff160ff9700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff15006ace0 0x7ff15006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.564+0000 7ff160ff9700 1 -- 172.21.15.149:0/2900519822 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff15c08bad0 con 0x7ff16415c6d0 2023-06-09T04:37:13.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.564+0000 7ff163fff700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff15006ace0 0x7ff15006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.565+0000 7ff163fff700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff15006ace0 0x7ff15006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff158007fd0 tx=0x7ff158007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:13.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.569+0000 7ff160ff9700 1 -- 172.21.15.149:0/2900519822 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff15c056920 con 0x7ff16415c6d0 2023-06-09T04:37:13.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.758+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1640b55d0 con 0x7ff16415c6d0 2023-06-09T04:37:13.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.759+0000 7ff160ff9700 1 -- 172.21.15.149:0/2900519822 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7ff15c059f40 con 0x7ff16415c6d0 2023-06-09T04:37:13.760 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:13.760 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:13.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff15006ace0 msgr2=0x7ff15006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff15006ace0 0x7ff15006d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff158007fd0 tx=0x7ff158007ec0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16415c6d0 msgr2=0x7ff1640c51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16415c6d0 0x7ff1640c51c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00b730 tx=0x7ff15c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 shutdown_connections 2023-06-09T04:37:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff15006ace0 0x7ff15006d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff16415c6d0 0x7ff1640c51c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff16406a4c0 0x7ff1641f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 --2- 172.21.15.149:0/2900519822 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff16415c300 0x7ff1640c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 >> 172.21.15.149:0/2900519822 conn(0x7ff16406aec0 msgr2=0x7ff16415a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.761+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 shutdown_connections 2023-06-09T04:37:13.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.762+0000 7ff16a64d700 1 -- 172.21.15.149:0/2900519822 wait complete. 2023-06-09T04:37:13.774 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:13.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.894+0000 7fb05ed44700 1 Processor -- start 2023-06-09T04:37:13.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.895+0000 7fb05ed44700 1 -- start start 2023-06-09T04:37:13.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.895+0000 7fb05ed44700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb05806a4c0 0x7fb0580af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.895+0000 7fb05ed44700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0580ccfa0 con 0x7fb05815c590 2023-06-09T04:37:13.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.895+0000 7fb05ed44700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0580af050 con 0x7fb0580ccba0 2023-06-09T04:37:13.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.895+0000 7fb05ed44700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0580afae0 con 0x7fb05806a4c0 2023-06-09T04:37:13.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.895+0000 7fb057fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb05806a4c0 0x7fb0580af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb057fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb05806a4c0 0x7fb0580af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36328/0 (socket says 172.21.15.149:36328) 2023-06-09T04:37:13.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb057fff700 1 -- 172.21.15.149:0/2390165398 learned_addr learned my addr 172.21.15.149:0/2390165398 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:13.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb05cae0700 1 --1- 172.21.15.149:0/2390165398 >> v1:172.21.15.149:6789/0 conn(0x7fb05815c590 0x7fb058069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60190/0 (socket says 172.21.15.149:60190) 2023-06-09T04:37:13.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb057fff700 1 -- 172.21.15.149:0/2390165398 >> v1:172.21.15.184:6789/0 conn(0x7fb0580ccba0 legacy=0x7fb0580ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb057fff700 1 -- 172.21.15.149:0/2390165398 >> v1:172.21.15.149:6789/0 conn(0x7fb05815c590 legacy=0x7fb058069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb057fff700 1 -- 172.21.15.149:0/2390165398 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0580af800 con 0x7fb05806a4c0 2023-06-09T04:37:13.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb0577fe700 1 -- 172.21.15.149:0/2390165398 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757325318 0 0) 0x7fb0580ccfa0 con 0x7fb05815c590 2023-06-09T04:37:13.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb057fff700 1 --2- 172.21.15.149:0/2390165398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05806a4c0 0x7fb0580af220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0440098f0 tx=0x7fb044009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7ed035d7363ca7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:13.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb0577fe700 1 -- 172.21.15.149:0/2390165398 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400b8a0 con 0x7fb05806a4c0 2023-06-09T04:37:13.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb0577fe700 1 -- 172.21.15.149:0/2390165398 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04400ba00 con 0x7fb05806a4c0 2023-06-09T04:37:13.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.896+0000 7fb0577fe700 1 -- 172.21.15.149:0/2390165398 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400bd90 con 0x7fb05806a4c0 2023-06-09T04:37:13.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.897+0000 7fb05ed44700 1 -- 172.21.15.149:0/2390165398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05806a4c0 msgr2=0x7fb0580af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.897+0000 7fb05ed44700 1 --2- 172.21.15.149:0/2390165398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05806a4c0 0x7fb0580af220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0440098f0 tx=0x7fb044009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:13.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.897+0000 7fb05ed44700 1 -- 172.21.15.149:0/2390165398 shutdown_connections 2023-06-09T04:37:13.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.897+0000 7fb05ed44700 1 --2- 172.21.15.149:0/2390165398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb05806a4c0 0x7fb0580af220 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.897+0000 7fb05ed44700 1 -- 172.21.15.149:0/2390165398 >> 172.21.15.149:0/2390165398 conn(0x7fb05806b7e0 msgr2=0x7fb0580cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:13.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.897+0000 7fb05ed44700 1 -- 172.21.15.149:0/2390165398 shutdown_connections 2023-06-09T04:37:13.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.897+0000 7fb05ed44700 1 -- 172.21.15.149:0/2390165398 wait complete. 2023-06-09T04:37:13.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.898+0000 7fb05ed44700 1 Processor -- start 2023-06-09T04:37:13.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.898+0000 7fb05ed44700 1 -- start start 2023-06-09T04:37:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05ed44700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0580ccba0 0x7fb05815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05ed44700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb05815c590 0x7fb0581f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05ed44700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0580c4050 0x7fb0580b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05ed44700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0580c4ee0 con 0x7fb0580ccba0 2023-06-09T04:37:13.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05ed44700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0581f2a80 con 0x7fb05815c590 2023-06-09T04:37:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05ed44700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0580b3a60 con 0x7fb0580c4050 2023-06-09T04:37:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0580ccba0 0x7fb05815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0580ccba0 0x7fb05815ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36332/0 (socket says 172.21.15.149:36332) 2023-06-09T04:37:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 -- 172.21.15.149:0/1310753698 learned_addr learned my addr 172.21.15.149:0/1310753698 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb057fff700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb05815c590 0x7fb0581f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05d2e1700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0580c4050 0x7fb0580b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 -- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0580c4050 msgr2=0x7fb0580b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0580c4050 0x7fb0580b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 -- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb05815c590 msgr2=0x7fb0581f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb05815c590 0x7fb0581f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 -- 172.21.15.149:0/1310753698 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb044009550 con 0x7fb0580ccba0 2023-06-09T04:37:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.899+0000 7fb05cae0700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0580ccba0 0x7fb05815ac60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c450 tx=0x7fb04c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.900+0000 7fb0557fa700 1 -- 172.21.15.149:0/1310753698 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0074e0 con 0x7fb0580ccba0 2023-06-09T04:37:13.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.900+0000 7fb0557fa700 1 -- 172.21.15.149:0/1310753698 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c007660 con 0x7fb0580ccba0 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.900+0000 7fb0557fa700 1 -- 172.21.15.149:0/1310753698 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c005a70 con 0x7fb0580ccba0 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.900+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0580c95c0 con 0x7fb0580ccba0 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.900+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0580c4820 con 0x7fb0580ccba0 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.901+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb058073fa0 con 0x7fb0580ccba0 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.901+0000 7fb0557fa700 1 -- 172.21.15.149:0/1310753698 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb04c005bd0 con 0x7fb0580ccba0 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.901+0000 7fb0557fa700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb03c06ace0 0x7fb03c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.901+0000 7fb0557fa700 1 -- 172.21.15.149:0/1310753698 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb04c088a90 con 0x7fb0580ccba0 2023-06-09T04:37:13.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.901+0000 7fb057fff700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb03c06ace0 0x7fb03c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:13.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.902+0000 7fb057fff700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb03c06ace0 0x7fb03c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb058072390 tx=0x7fb044008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:13.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:13.906+0000 7fb0557fa700 1 -- 172.21.15.149:0/1310753698 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb04c0538e0 con 0x7fb0580ccba0 2023-06-09T04:37:14.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.094+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb058071dc0 con 0x7fb0580ccba0 2023-06-09T04:37:14.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.095+0000 7fb0557fa700 1 -- 172.21.15.149:0/1310753698 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7fb04c00ce60 con 0x7fb0580ccba0 2023-06-09T04:37:14.096 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:14.096 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:14.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.097+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb03c06ace0 msgr2=0x7fb03c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.097+0000 7fb05ed44700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb03c06ace0 0x7fb03c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb058072390 tx=0x7fb044008030 comp rx=0 tx=0).stop 2023-06-09T04:37:14.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.097+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0580ccba0 msgr2=0x7fb05815ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.097+0000 7fb05ed44700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0580ccba0 0x7fb05815ac60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c450 tx=0x7fb04c00c760 comp rx=0 tx=0).stop 2023-06-09T04:37:14.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 shutdown_connections 2023-06-09T04:37:14.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb03c06ace0 0x7fb03c06d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb0580c4050 0x7fb0580b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb0580ccba0 0x7fb05815ac60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 --2- 172.21.15.149:0/1310753698 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb05815c590 0x7fb0581f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 >> 172.21.15.149:0/1310753698 conn(0x7fb05806b7e0 msgr2=0x7fb05806e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:14.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 shutdown_connections 2023-06-09T04:37:14.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.098+0000 7fb05ed44700 1 -- 172.21.15.149:0/1310753698 wait complete. 2023-06-09T04:37:14.110 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:37:14.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.233+0000 7f7b95d9f700 1 Processor -- start 2023-06-09T04:37:14.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.233+0000 7f7b95d9f700 1 -- start start 2023-06-09T04:37:14.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.233+0000 7f7b95d9f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 0x7f7b90069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.233+0000 7f7b95d9f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7b9006a2f0 0x7f7b900b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.233+0000 7f7b95d9f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9015c8f0 con 0x7f7b9015c520 2023-06-09T04:37:14.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.233+0000 7f7b95d9f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b900cd940 con 0x7f7b9006a2f0 2023-06-09T04:37:14.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.233+0000 7f7b95d9f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9006a770 con 0x7f7b90071560 2023-06-09T04:37:14.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7b9015c520 0x7f7b900cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60204/0 (socket says 172.21.15.149:60204) 2023-06-09T04:37:14.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8f7fe700 1 -- 172.21.15.149:0/4199553223 learned_addr learned my addr 172.21.15.149:0/4199553223 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:14.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574622940 0 0) 0x7f7b84001110 con 0x7f7b9015c520 2023-06-09T04:37:14.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8effd700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 0x7f7b90069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8ffff700 1 --2- 172.21.15.149:0/4199553223 >> v2:172.21.15.184:3300/0 conn(0x7f7b9006a2f0 0x7f7b900b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b780035b0 con 0x7f7b9015c520 2023-06-09T04:37:14.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477529689 0 0) 0x7f7b780035b0 con 0x7f7b9015c520 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 msgr2=0x7f7b90069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 0x7f7b90069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 >> v2:172.21.15.184:3300/0 conn(0x7f7b9006a2f0 msgr2=0x7f7b900b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 --2- 172.21.15.149:0/4199553223 >> v2:172.21.15.184:3300/0 conn(0x7f7b9006a2f0 0x7f7b900b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900719b0 con 0x7f7b9015c520 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f7b84001800 con 0x7f7b9015c520 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 >> v1:172.21.15.149:6789/0 conn(0x7f7b9015c520 legacy=0x7f7b900cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 0x7f7b78003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b78003f80 0x7f7b78004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b78004d90 0x7f7b78005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900cd940 con 0x7f7b78003f80 2023-06-09T04:37:14.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9006a770 con 0x7f7b78004d90 2023-06-09T04:37:14.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7800ba40 con 0x7f7b90071560 2023-06-09T04:37:14.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8effd700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b78003f80 0x7f7b78004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8f7fe700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 0x7f7b78003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.234+0000 7f7b8ffff700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b78004d90 0x7f7b78005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8effd700 1 -- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 msgr2=0x7f7b78003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8effd700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b90071560 0x7f7b78003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8effd700 1 -- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b78004d90 msgr2=0x7f7b78005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8effd700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b78004d90 0x7f7b78005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8effd700 1 -- 172.21.15.149:0/4199553223 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780035b0 con 0x7f7b78003f80 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8effd700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b78003f80 0x7f7b78004850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009b60 tx=0x7f7b78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3b8be58bcf9fb9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:14.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000e660 con 0x7f7b78003f80 2023-06-09T04:37:14.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8000e7c0 con 0x7f7b78003f80 2023-06-09T04:37:14.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8e7fc700 1 -- 172.21.15.149:0/4199553223 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000eb30 con 0x7f7b78003f80 2023-06-09T04:37:14.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b95d9f700 1 -- 172.21.15.149:0/4199553223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b78003f80 msgr2=0x7f7b78004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b95d9f700 1 --2- 172.21.15.149:0/4199553223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b78003f80 0x7f7b78004850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7b80009b60 tx=0x7f7b78005880 comp rx=0 tx=0).stop 2023-06-09T04:37:14.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b8ffff700 1 -- 172.21.15.149:0/4199553223 reap_dead start 2023-06-09T04:37:14.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b95d9f700 1 -- 172.21.15.149:0/4199553223 shutdown_connections 2023-06-09T04:37:14.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b95d9f700 1 -- 172.21.15.149:0/4199553223 >> 172.21.15.149:0/4199553223 conn(0x7f7b9006aec0 msgr2=0x7f7b9006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:14.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b95d9f700 1 -- 172.21.15.149:0/4199553223 shutdown_connections 2023-06-09T04:37:14.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.235+0000 7f7b95d9f700 1 -- 172.21.15.149:0/4199553223 wait complete. 2023-06-09T04:37:14.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.237+0000 7f7b95d9f700 1 Processor -- start 2023-06-09T04:37:14.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.237+0000 7f7b95d9f700 1 -- start start 2023-06-09T04:37:14.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b95d9f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b78003f80 0x7f7b90156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b95d9f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b900c3b00 0x7f7b900b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b95d9f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b90157410 0x7f7b900b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b95d9f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900c4070 con 0x7f7b90157410 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b95d9f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900b3100 con 0x7f7b900c3b00 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b95d9f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b900b33e0 con 0x7f7b78003f80 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b8ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b90157410 0x7f7b900b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b8ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b90157410 0x7f7b900b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36356/0 (socket says 172.21.15.149:36356) 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b8ffff700 1 -- 172.21.15.149:0/1875374401 learned_addr learned my addr 172.21.15.149:0/1875374401 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b8f7fe700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b78003f80 0x7f7b90156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b8effd700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b900c3b00 0x7f7b900b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.238+0000 7f7b8ffff700 1 -- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b78003f80 msgr2=0x7f7b90156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b8ffff700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b78003f80 0x7f7b90156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b8ffff700 1 -- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b900c3b00 msgr2=0x7f7b900b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b8ffff700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b900c3b00 0x7f7b900b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b8ffff700 1 -- 172.21.15.149:0/1875374401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b900b36c0 con 0x7f7b90157410 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b8ffff700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b90157410 0x7f7b900b4400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b9015fef0 tx=0x7f7b88011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b77fff700 1 -- 172.21.15.149:0/1875374401 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8800e040 con 0x7f7b90157410 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b77fff700 1 -- 172.21.15.149:0/1875374401 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8800f040 con 0x7f7b90157410 2023-06-09T04:37:14.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b77fff700 1 -- 172.21.15.149:0/1875374401 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8800fc40 con 0x7f7b90157410 2023-06-09T04:37:14.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b900b39a0 con 0x7f7b90157410 2023-06-09T04:37:14.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.239+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b90157b20 con 0x7f7b90157410 2023-06-09T04:37:14.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.240+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b900b3b90 con 0x7f7b90157410 2023-06-09T04:37:14.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.240+0000 7f7b77fff700 1 -- 172.21.15.149:0/1875374401 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b88022460 con 0x7f7b90157410 2023-06-09T04:37:14.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.241+0000 7f7b77fff700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7c06ace0 0x7f7b7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.241+0000 7f7b77fff700 1 -- 172.21.15.149:0/1875374401 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7b88089bd0 con 0x7f7b90157410 2023-06-09T04:37:14.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.241+0000 7f7b8f7fe700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7c06ace0 0x7f7b7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.241+0000 7f7b8f7fe700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7c06ace0 0x7f7b7c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000c00 tx=0x7f7b84007b00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:14.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.245+0000 7f7b77fff700 1 -- 172.21.15.149:0/1875374401 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b88058420 con 0x7f7b90157410 2023-06-09T04:37:14.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.477+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7b90073fa0 con 0x7f7b90157410 2023-06-09T04:37:14.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.517+0000 7f7b77fff700 1 -- 172.21.15.149:0/1875374401 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b88057fb0 con 0x7f7b90157410 2023-06-09T04:37:14.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7c06ace0 msgr2=0x7f7b7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7c06ace0 0x7f7b7c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000c00 tx=0x7f7b84007b00 comp rx=0 tx=0).stop 2023-06-09T04:37:14.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b90157410 msgr2=0x7f7b900b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b90157410 0x7f7b900b4400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7b9015fef0 tx=0x7f7b88011ed0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 shutdown_connections 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7c06ace0 0x7f7b7c06d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b78003f80 0x7f7b90156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b90157410 0x7f7b900b4400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 --2- 172.21.15.149:0/1875374401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b900c3b00 0x7f7b900b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 >> 172.21.15.149:0/1875374401 conn(0x7f7b9006aec0 msgr2=0x7f7b900b0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 shutdown_connections 2023-06-09T04:37:14.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.520+0000 7f7b95d9f700 1 -- 172.21.15.149:0/1875374401 wait complete. 2023-06-09T04:37:14.532 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-09T04:37:14.532 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:37:14.655 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.655+0000 7f38d5d2a700 1 Processor -- start 2023-06-09T04:37:14.656 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.655+0000 7f38d5d2a700 1 -- start start 2023-06-09T04:37:14.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.656+0000 7f38d5d2a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 0x7f38d00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.656+0000 7f38d5d2a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00720f0 con 0x7f38d0069db0 2023-06-09T04:37:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.656+0000 7f38d5d2a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00cb960 con 0x7f38d015a400 2023-06-09T04:37:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.656+0000 7f38d5d2a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00cbc40 con 0x7f38d00ccc00 2023-06-09T04:37:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.656+0000 7f38cf7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f38d0069db0 0x7f38d00c9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60224/0 (socket says 172.21.15.149:60224) 2023-06-09T04:37:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.656+0000 7f38cf7fe700 1 -- 172.21.15.149:0/2062745346 learned_addr learned my addr 172.21.15.149:0/2062745346 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cffff700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 0x7f38d00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195229133 0 0) 0x7f38d00720f0 con 0x7f38d0069db0 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b80035b0 con 0x7f38d0069db0 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824746414 0 0) 0x7f38d00cb960 con 0x7f38d015a400 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d00720f0 con 0x7f38d015a400 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 628599347 0 0) 0x7f38b80035b0 con 0x7f38d0069db0 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 msgr2=0x7f38d00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 0x7f38d00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 >> v1:172.21.15.184:6789/0 conn(0x7f38d015a400 legacy=0x7f38d006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0071d80 con 0x7f38d0069db0 2023-06-09T04:37:14.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f38c4001670 con 0x7f38d0069db0 2023-06-09T04:37:14.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 >> v1:172.21.15.149:6789/0 conn(0x7f38d0069db0 legacy=0x7f38d00c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38b8003bc0 0x7f38b8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 0x7f38b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b8004d90 0x7f38b8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00cbc40 con 0x7f38b8003bc0 2023-06-09T04:37:14.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b800bac0 con 0x7f38b8004d90 2023-06-09T04:37:14.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b800bc50 con 0x7f38d00ccc00 2023-06-09T04:37:14.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38b8003bc0 0x7f38b8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38ceffd700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 0x7f38b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cffff700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b8004d90 0x7f38b8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cf7fe700 1 -- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 msgr2=0x7f38b8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:14.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38d00ccc00 0x7f38b8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cf7fe700 1 -- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b8004d90 msgr2=0x7f38b8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:14.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38b8004d90 0x7f38b8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.657+0000 7f38cf7fe700 1 -- 172.21.15.149:0/2062745346 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b80035b0 con 0x7f38b8003bc0 2023-06-09T04:37:14.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38b8003bc0 0x7f38b8003f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005130 tx=0x7f38b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562dacbfc89b8e7f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:14.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4005b60 con 0x7f38b8003bc0 2023-06-09T04:37:14.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4005cc0 con 0x7f38b8003bc0 2023-06-09T04:37:14.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38ce7fc700 1 -- 172.21.15.149:0/2062745346 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4008320 con 0x7f38b8003bc0 2023-06-09T04:37:14.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38d5d2a700 1 -- 172.21.15.149:0/2062745346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38b8003bc0 msgr2=0x7f38b8003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38d5d2a700 1 --2- 172.21.15.149:0/2062745346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38b8003bc0 0x7f38b8003f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005130 tx=0x7f38b8005880 comp rx=0 tx=0).stop 2023-06-09T04:37:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38cffff700 1 -- 172.21.15.149:0/2062745346 reap_dead start 2023-06-09T04:37:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38d5d2a700 1 -- 172.21.15.149:0/2062745346 shutdown_connections 2023-06-09T04:37:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38d5d2a700 1 -- 172.21.15.149:0/2062745346 >> 172.21.15.149:0/2062745346 conn(0x7f38d006aec0 msgr2=0x7f38d006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38d5d2a700 1 -- 172.21.15.149:0/2062745346 shutdown_connections 2023-06-09T04:37:14.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.658+0000 7f38d5d2a700 1 -- 172.21.15.149:0/2062745346 wait complete. 2023-06-09T04:37:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.660+0000 7f38d5d2a700 1 Processor -- start 2023-06-09T04:37:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.660+0000 7f38d5d2a700 1 -- start start 2023-06-09T04:37:14.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38d5d2a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38b8003bc0 0x7f38d00b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38d5d2a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d00cef30 0x7f38d0071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38d5d2a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38d01f4800 0x7f38d01f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38d5d2a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00b3dd0 con 0x7f38d01f4800 2023-06-09T04:37:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38d5d2a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01f51e0 con 0x7f38d00cef30 2023-06-09T04:37:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38d5d2a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d00b3250 con 0x7f38b8003bc0 2023-06-09T04:37:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38d01f4800 0x7f38d01f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38d01f4800 0x7f38d01f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36376/0 (socket says 172.21.15.149:36376) 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 -- 172.21.15.149:0/3181278070 learned_addr learned my addr 172.21.15.149:0/3181278070 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38b8003bc0 0x7f38d00b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38ceffd700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d00cef30 0x7f38d0071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 -- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38b8003bc0 msgr2=0x7f38d00b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38b8003bc0 0x7f38d00b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 -- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d00cef30 msgr2=0x7f38d0071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d00cef30 0x7f38d0071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:14.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cffff700 1 -- 172.21.15.149:0/3181278070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00b3530 con 0x7f38d01f4800 2023-06-09T04:37:14.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38b8003bc0 0x7f38d00b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:14.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.661+0000 7f38ceffd700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d00cef30 0x7f38d0071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:14.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.662+0000 7f38cffff700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38d01f4800 0x7f38d01f4ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38d00ae6e0 tx=0x7f38c8011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:14.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.662+0000 7f38b7fff700 1 -- 172.21.15.149:0/3181278070 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800e040 con 0x7f38d01f4800 2023-06-09T04:37:14.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.662+0000 7f38b7fff700 1 -- 172.21.15.149:0/3181278070 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c800f040 con 0x7f38d01f4800 2023-06-09T04:37:14.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.662+0000 7f38b7fff700 1 -- 172.21.15.149:0/3181278070 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c800fd50 con 0x7f38d01f4800 2023-06-09T04:37:14.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.662+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d00b3810 con 0x7f38d01f4800 2023-06-09T04:37:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.662+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d00b2ed0 con 0x7f38d01f4800 2023-06-09T04:37:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.663+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d0073fa0 con 0x7f38d01f4800 2023-06-09T04:37:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.663+0000 7f38b7fff700 1 -- 172.21.15.149:0/3181278070 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f38c8015430 con 0x7f38d01f4800 2023-06-09T04:37:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.663+0000 7f38b7fff700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f38bc06ace0 0x7f38bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.664+0000 7f38b7fff700 1 -- 172.21.15.149:0/3181278070 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38c8089cf0 con 0x7f38d01f4800 2023-06-09T04:37:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.664+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f38bc06ace0 0x7f38bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:14.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.664+0000 7f38cf7fe700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f38bc06ace0 0x7f38bc06d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005130 tx=0x7f38c400a070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:14.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.668+0000 7f38b7fff700 1 -- 172.21.15.149:0/3181278070 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f38c808e070 con 0x7f38d01f4800 2023-06-09T04:37:14.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:14.899+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f38d00b54e0 con 0x7f38d01f4800 2023-06-09T04:37:15.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.524+0000 7f38b7fff700 1 -- 172.21.15.149:0/3181278070 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f38c8054b40 con 0x7f38d01f4800 2023-06-09T04:37:15.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f38bc06ace0 msgr2=0x7f38bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f38bc06ace0 0x7f38bc06d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005130 tx=0x7f38c400a070 comp rx=0 tx=0).stop 2023-06-09T04:37:15.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38d01f4800 msgr2=0x7f38d01f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38d01f4800 0x7f38d01f4ca0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38d00ae6e0 tx=0x7f38c8011f80 comp rx=0 tx=0).stop 2023-06-09T04:37:15.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 shutdown_connections 2023-06-09T04:37:15.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f38bc06ace0 0x7f38bc06d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f38b8003bc0 0x7f38d00b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38d01f4800 0x7f38d01f4ca0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 --2- 172.21.15.149:0/3181278070 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38d00cef30 0x7f38d0071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 >> 172.21.15.149:0/3181278070 conn(0x7f38d006aec0 msgr2=0x7f38d0158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:15.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 shutdown_connections 2023-06-09T04:37:15.529 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.527+0000 7f38d5d2a700 1 -- 172.21.15.149:0/3181278070 wait complete. 2023-06-09T04:37:15.541 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:37:15.541 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:37:15.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.663+0000 7f2abec76700 1 Processor -- start 2023-06-09T04:37:15.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.663+0000 7f2abec76700 1 -- start start 2023-06-09T04:37:15.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.663+0000 7f2abec76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80d0380 0x7f2ab80ad070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abec76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2ab80ae580 0x7f2ab80ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abec76700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ab80acbe0 con 0x7f2ab8069db0 2023-06-09T04:37:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abec76700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ab80ac2d0 con 0x7f2ab80ae580 2023-06-09T04:37:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abec76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80b0860 con 0x7f2ab80d0380 2023-06-09T04:37:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abd213700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2ab80ae580 0x7f2ab80ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:15.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abca12700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2ab8069db0 0x7f2ab806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60244/0 (socket says 172.21.15.149:60244) 2023-06-09T04:37:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abca12700 1 -- 172.21.15.149:0/1458580269 learned_addr learned my addr 172.21.15.149:0/1458580269 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2ab7fff700 1 --2- 172.21.15.149:0/1458580269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80d0380 0x7f2ab80ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abd213700 1 -- 172.21.15.149:0/1458580269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80d0380 msgr2=0x7f2ab80ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abd213700 1 --2- 172.21.15.149:0/1458580269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80d0380 0x7f2ab80ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abd213700 1 -- 172.21.15.149:0/1458580269 >> v1:172.21.15.149:6789/0 conn(0x7f2ab8069db0 legacy=0x7f2ab806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abd213700 1 -- 172.21.15.149:0/1458580269 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80ac590 con 0x7f2ab80ae580 2023-06-09T04:37:15.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2ab77fe700 1 -- 172.21.15.149:0/1458580269 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191979595 0 0) 0x7f2ab80acbe0 con 0x7f2ab8069db0 2023-06-09T04:37:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2ab7fff700 1 --2- 172.21.15.149:0/1458580269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80d0380 0x7f2ab80ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2abd213700 1 --2- 172.21.15.149:0/1458580269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab80ae580 0x7f2ab80ad5b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009d90 tx=0x7f2ab000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8707ce4c084457 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2ab77fe700 1 -- 172.21.15.149:0/1458580269 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab000e070 con 0x7f2ab80ae580 2023-06-09T04:37:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2ab77fe700 1 -- 172.21.15.149:0/1458580269 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab000bbd0 con 0x7f2ab80ae580 2023-06-09T04:37:15.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.664+0000 7f2ab77fe700 1 -- 172.21.15.149:0/1458580269 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0012430 con 0x7f2ab80ae580 2023-06-09T04:37:15.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 -- 172.21.15.149:0/1458580269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab80ae580 msgr2=0x7f2ab80ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 --2- 172.21.15.149:0/1458580269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab80ae580 0x7f2ab80ad5b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009d90 tx=0x7f2ab000b330 comp rx=0 tx=0).stop 2023-06-09T04:37:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 -- 172.21.15.149:0/1458580269 shutdown_connections 2023-06-09T04:37:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 --2- 172.21.15.149:0/1458580269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab80ae580 0x7f2ab80ad5b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 --2- 172.21.15.149:0/1458580269 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80d0380 0x7f2ab80ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 -- 172.21.15.149:0/1458580269 >> 172.21.15.149:0/1458580269 conn(0x7f2ab806b7e0 msgr2=0x7f2ab80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 -- 172.21.15.149:0/1458580269 shutdown_connections 2023-06-09T04:37:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.665+0000 7f2abec76700 1 -- 172.21.15.149:0/1458580269 wait complete. 2023-06-09T04:37:15.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.666+0000 7f2abec76700 1 Processor -- start 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.667+0000 7f2abec76700 1 -- start start 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.667+0000 7f2abec76700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8069db0 0x7f2ab809bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abec76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80ae580 0x7f2ab809a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abec76700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab80d0380 0x7f2ab809a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abec76700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8158bb0 con 0x7f2ab8069db0 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abec76700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab80c98d0 con 0x7f2ab80d0380 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abec76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab809aec0 con 0x7f2ab80ae580 2023-06-09T04:37:15.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8069db0 0x7f2ab809bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:15.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8069db0 0x7f2ab809bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36386/0 (socket says 172.21.15.149:36386) 2023-06-09T04:37:15.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 -- 172.21.15.149:0/3803157903 learned_addr learned my addr 172.21.15.149:0/3803157903 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:15.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abd213700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab80d0380 0x7f2ab809a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:15.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2ab7fff700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80ae580 0x7f2ab809a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:15.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 -- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80ae580 msgr2=0x7f2ab809a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80ae580 0x7f2ab809a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 -- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab80d0380 msgr2=0x7f2ab809a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab80d0380 0x7f2ab809a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 -- 172.21.15.149:0/3803157903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0009a70 con 0x7f2ab8069db0 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2ab7fff700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80ae580 0x7f2ab809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abca12700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8069db0 0x7f2ab809bf60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c4a0 tx=0x7f2aac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2ab57fa700 1 -- 172.21.15.149:0/3803157903 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac0074e0 con 0x7f2ab8069db0 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2ab57fa700 1 -- 172.21.15.149:0/3803157903 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac007640 con 0x7f2ab8069db0 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab809b1a0 con 0x7f2ab8069db0 2023-06-09T04:37:15.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2ab57fa700 1 -- 172.21.15.149:0/3803157903 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac005a70 con 0x7f2ab8069db0 2023-06-09T04:37:15.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.668+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab809b760 con 0x7f2ab8069db0 2023-06-09T04:37:15.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.669+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab8073fa0 con 0x7f2ab8069db0 2023-06-09T04:37:15.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.670+0000 7f2ab57fa700 1 -- 172.21.15.149:0/3803157903 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2aac005bd0 con 0x7f2ab8069db0 2023-06-09T04:37:15.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.670+0000 7f2ab57fa700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2a9c06ace0 0x7f2a9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.670+0000 7f2ab57fa700 1 -- 172.21.15.149:0/3803157903 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2aac088cc0 con 0x7f2ab8069db0 2023-06-09T04:37:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.670+0000 7f2ab7fff700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2a9c06ace0 0x7f2a9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.671+0000 7f2ab7fff700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2a9c06ace0 0x7f2a9c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40089b0 tx=0x7f2aa4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:15.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.675+0000 7f2ab57fa700 1 -- 172.21.15.149:0/3803157903 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2aac053a70 con 0x7f2ab8069db0 2023-06-09T04:37:15.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.903+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ab80b5500 con 0x7f2ab8069db0 2023-06-09T04:37:15.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.903+0000 7f2ab57fa700 1 -- 172.21.15.149:0/3803157903 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f2aac017090 con 0x7f2ab8069db0 2023-06-09T04:37:15.904 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:15.904 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:37:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2a9c06ace0 msgr2=0x7f2a9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2a9c06ace0 0x7f2a9c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40089b0 tx=0x7f2aa4008040 comp rx=0 tx=0).stop 2023-06-09T04:37:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8069db0 msgr2=0x7f2ab809bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:15.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8069db0 0x7f2ab809bf60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2aac00c4a0 tx=0x7f2aac00c860 comp rx=0 tx=0).stop 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 shutdown_connections 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2a9c06ace0 0x7f2a9c06d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab80d0380 0x7f2ab809a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8069db0 0x7f2ab809bf60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 --2- 172.21.15.149:0/3803157903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ab80ae580 0x7f2ab809a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 >> 172.21.15.149:0/3803157903 conn(0x7f2ab806b7e0 msgr2=0x7f2ab80cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 shutdown_connections 2023-06-09T04:37:15.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:15.906+0000 7f2abec76700 1 -- 172.21.15.149:0/3803157903 wait complete. 2023-06-09T04:37:15.908 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:37:15.918 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:16.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.038+0000 7f06efa74700 1 Processor -- start 2023-06-09T04:37:16.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.038+0000 7f06efa74700 1 -- start start 2023-06-09T04:37:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06efa74700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f06e806a4c0 0x7f06e80af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06efa74700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06e80ccba0 0x7f06e80b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06efa74700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e80ccfa0 con 0x7f06e815c590 2023-06-09T04:37:16.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06efa74700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e80afae0 con 0x7f06e80ccba0 2023-06-09T04:37:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06efa74700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e80af050 con 0x7f06e806a4c0 2023-06-09T04:37:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06ee011700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06e80ccba0 0x7f06e80b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06ed810700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f06e815c590 0x7f06e8069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60258/0 (socket says 172.21.15.149:60258) 2023-06-09T04:37:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.039+0000 7f06ed810700 1 -- 172.21.15.149:0/409573574 learned_addr learned my addr 172.21.15.149:0/409573574 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ed00f700 1 --2- 172.21.15.149:0/409573574 >> v2:172.21.15.184:3300/0 conn(0x7f06e806a4c0 0x7f06e80af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ee011700 1 -- 172.21.15.149:0/409573574 >> v2:172.21.15.184:3300/0 conn(0x7f06e806a4c0 msgr2=0x7f06e80af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:16.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ee011700 1 --2- 172.21.15.149:0/409573574 >> v2:172.21.15.184:3300/0 conn(0x7f06e806a4c0 0x7f06e80af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ee011700 1 -- 172.21.15.149:0/409573574 >> v1:172.21.15.149:6789/0 conn(0x7f06e815c590 legacy=0x7f06e8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ee011700 1 -- 172.21.15.149:0/409573574 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e80af800 con 0x7f06e80ccba0 2023-06-09T04:37:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ec80e700 1 -- 172.21.15.149:0/409573574 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271959798 0 0) 0x7f06e80ccfa0 con 0x7f06e815c590 2023-06-09T04:37:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ee011700 1 --2- 172.21.15.149:0/409573574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e80b06d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06e80b21e0 tx=0x7f06e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347d3d04426da9f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ec80e700 1 -- 172.21.15.149:0/409573574 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e000e070 con 0x7f06e80ccba0 2023-06-09T04:37:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ec80e700 1 -- 172.21.15.149:0/409573574 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e000bb20 con 0x7f06e80ccba0 2023-06-09T04:37:16.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.040+0000 7f06ec80e700 1 -- 172.21.15.149:0/409573574 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0012430 con 0x7f06e80ccba0 2023-06-09T04:37:16.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 -- 172.21.15.149:0/409573574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 msgr2=0x7f06e80b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 --2- 172.21.15.149:0/409573574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e80b06d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f06e80b21e0 tx=0x7f06e000b330 comp rx=0 tx=0).stop 2023-06-09T04:37:16.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 -- 172.21.15.149:0/409573574 shutdown_connections 2023-06-09T04:37:16.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 --2- 172.21.15.149:0/409573574 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e80b06d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 --2- 172.21.15.149:0/409573574 >> v2:172.21.15.184:3300/0 conn(0x7f06e806a4c0 0x7f06e80af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 -- 172.21.15.149:0/409573574 >> 172.21.15.149:0/409573574 conn(0x7f06e806b7e0 msgr2=0x7f06e80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:16.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 -- 172.21.15.149:0/409573574 shutdown_connections 2023-06-09T04:37:16.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.041+0000 7f06efa74700 1 -- 172.21.15.149:0/409573574 wait complete. 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.042+0000 7f06efa74700 1 Processor -- start 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.042+0000 7f06efa74700 1 -- start start 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06efa74700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e806a4c0 0x7f06e80c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06efa74700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e81f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06efa74700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e815c590 0x7f06e80b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06efa74700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e815f250 con 0x7f06e80ccba0 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06efa74700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e80c79e0 con 0x7f06e806a4c0 2023-06-09T04:37:16.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06efa74700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e815f740 con 0x7f06e815c590 2023-06-09T04:37:16.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06ed00f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e81f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06ed00f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e81f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36400/0 (socket says 172.21.15.149:36400) 2023-06-09T04:37:16.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06ed00f700 1 -- 172.21.15.149:0/683238549 learned_addr learned my addr 172.21.15.149:0/683238549 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:16.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06ed810700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e806a4c0 0x7f06e80c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.043+0000 7f06ee011700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e815c590 0x7f06e80b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06ed00f700 1 -- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e815c590 msgr2=0x7f06e80b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06ed00f700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e815c590 0x7f06e80b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06ed00f700 1 -- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e806a4c0 msgr2=0x7f06e80c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06ed00f700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e806a4c0 0x7f06e80c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06ed00f700 1 -- 172.21.15.149:0/683238549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e0009a70 con 0x7f06e80ccba0 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06ed810700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e806a4c0 0x7f06e80c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06ed00f700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e81f1520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06e400e9b0 tx=0x7f06e400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06de7fc700 1 -- 172.21.15.149:0/683238549 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e4009710 con 0x7f06e80ccba0 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06de7fc700 1 -- 172.21.15.149:0/683238549 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e400c850 con 0x7f06e80ccba0 2023-06-09T04:37:16.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e81f5e50 con 0x7f06e80ccba0 2023-06-09T04:37:16.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06de7fc700 1 -- 172.21.15.149:0/683238549 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400cbc0 con 0x7f06e80ccba0 2023-06-09T04:37:16.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.044+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e81f5ae0 con 0x7f06e80ccba0 2023-06-09T04:37:16.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.045+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e80c77b0 con 0x7f06e80ccba0 2023-06-09T04:37:16.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.045+0000 7f06de7fc700 1 -- 172.21.15.149:0/683238549 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06e400cd20 con 0x7f06e80ccba0 2023-06-09T04:37:16.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.046+0000 7f06de7fc700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f06cc06ace0 0x7f06cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.046+0000 7f06ed810700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f06cc06ace0 0x7f06cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.046+0000 7f06de7fc700 1 -- 172.21.15.149:0/683238549 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06e4089920 con 0x7f06e80ccba0 2023-06-09T04:37:16.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.046+0000 7f06ed810700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f06cc06ace0 0x7f06cc06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06d80010e0 tx=0x7f06d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.050+0000 7f06de7fc700 1 -- 172.21.15.149:0/683238549 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06e80c77b0 con 0x7f06e80ccba0 2023-06-09T04:37:16.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.238+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06e80c7b90 con 0x7f06e80ccba0 2023-06-09T04:37:16.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.240+0000 7f06de7fc700 1 -- 172.21.15.149:0/683238549 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f06e80c7b90 con 0x7f06e80ccba0 2023-06-09T04:37:16.240 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:16.240 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:16.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f06cc06ace0 msgr2=0x7f06cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f06cc06ace0 0x7f06cc06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06d80010e0 tx=0x7f06d8009040 comp rx=0 tx=0).stop 2023-06-09T04:37:16.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 msgr2=0x7f06e81f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e81f1520 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f06e400e9b0 tx=0x7f06e400ed70 comp rx=0 tx=0).stop 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 shutdown_connections 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f06cc06ace0 0x7f06cc06d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06e815c590 0x7f06e80b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06e806a4c0 0x7f06e80c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 --2- 172.21.15.149:0/683238549 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06e80ccba0 0x7f06e81f1520 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 >> 172.21.15.149:0/683238549 conn(0x7f06e806b7e0 msgr2=0x7f06e815bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 shutdown_connections 2023-06-09T04:37:16.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.242+0000 7f06efa74700 1 -- 172.21.15.149:0/683238549 wait complete. 2023-06-09T04:37:16.254 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:37:16.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:37:16.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.376+0000 7f87e1a90700 1 Processor -- start 2023-06-09T04:37:16.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.376+0000 7f87e1a90700 1 -- start start 2023-06-09T04:37:16.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87e1a90700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87e1a90700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87dc0b0c40 0x7f87dc0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87e1a90700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87dc0b01a0 con 0x7f87dc0cf140 2023-06-09T04:37:16.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87e1a90700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87dc0b06f0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87e1a90700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0b0900 con 0x7f87dc0afa30 2023-06-09T04:37:16.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87dbfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f87dc0cf140 0x7f87dc0cafa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60274/0 (socket says 172.21.15.149:60274) 2023-06-09T04:37:16.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87dbfff700 1 -- 172.21.15.149:0/3905359581 learned_addr learned my addr 172.21.15.149:0/3905359581 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:16.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87daffd700 1 --2- 172.21.15.149:0/3905359581 >> v2:172.21.15.184:3300/0 conn(0x7f87dc0b0c40 0x7f87dc0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87db7fe700 1 --2- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87da7fc700 1 -- 172.21.15.149:0/3905359581 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686845257 0 0) 0x7f87dc0b01a0 con 0x7f87dc0cf140 2023-06-09T04:37:16.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87da7fc700 1 -- 172.21.15.149:0/3905359581 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87c40035b0 con 0x7f87dc0cf140 2023-06-09T04:37:16.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87daffd700 1 -- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 msgr2=0x7f87dc0b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87da7fc700 1 -- 172.21.15.149:0/3905359581 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565636645 0 0) 0x7f87c40035b0 con 0x7f87dc0cf140 2023-06-09T04:37:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87daffd700 1 --2- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87daffd700 1 -- 172.21.15.149:0/3905359581 >> v1:172.21.15.149:6789/0 conn(0x7f87dc0cf140 legacy=0x7f87dc0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.377+0000 7f87daffd700 1 -- 172.21.15.149:0/3905359581 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0ca7a0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87daffd700 1 --2- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0cd270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009840 tx=0x7f87cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=622a22666fc9d06b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87da7fc700 1 -- 172.21.15.149:0/3905359581 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d40019f0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87da7fc700 1 -- 172.21.15.149:0/3905359581 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc004030 con 0x7f87dc0b0c40 2023-06-09T04:37:16.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87da7fc700 1 -- 172.21.15.149:0/3905359581 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc0043c0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 -- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0b0c40 msgr2=0x7f87dc0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 --2- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0cd270 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009840 tx=0x7f87cc009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 -- 172.21.15.149:0/3905359581 shutdown_connections 2023-06-09T04:37:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 --2- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 --2- 172.21.15.149:0/3905359581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0cd270 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 -- 172.21.15.149:0/3905359581 >> 172.21.15.149:0/3905359581 conn(0x7f87dc06b7e0 msgr2=0x7f87dc0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 -- 172.21.15.149:0/3905359581 shutdown_connections 2023-06-09T04:37:16.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.378+0000 7f87e1a90700 1 -- 172.21.15.149:0/3905359581 wait complete. 2023-06-09T04:37:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.380+0000 7f87e1a90700 1 Processor -- start 2023-06-09T04:37:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.380+0000 7f87e1a90700 1 -- start start 2023-06-09T04:37:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.380+0000 7f87e1a90700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.380+0000 7f87e1a90700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87e1a90700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0cf140 0x7f87dc0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87e1a90700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0ad0b0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87e1a90700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0acd80 con 0x7f87dc0cf140 2023-06-09T04:37:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87e1a90700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc0ad540 con 0x7f87dc0afa30 2023-06-09T04:37:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36416/0 (socket says 172.21.15.149:36416) 2023-06-09T04:37:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 -- 172.21.15.149:0/428911991 learned_addr learned my addr 172.21.15.149:0/428911991 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87dbfff700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0cf140 0x7f87dc0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87db7fe700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 -- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 msgr2=0x7f87dc0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 -- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0cf140 msgr2=0x7f87dc0c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0cf140 0x7f87dc0c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 -- 172.21.15.149:0/428911991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc0094a0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87dbfff700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0cf140 0x7f87dc0c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87daffd700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0c5090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00a010 tx=0x7f87cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87c3fff700 1 -- 172.21.15.149:0/428911991 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc003e10 con 0x7f87dc0b0c40 2023-06-09T04:37:16.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87c3fff700 1 -- 172.21.15.149:0/428911991 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc01f070 con 0x7f87dc0b0c40 2023-06-09T04:37:16.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87dc0aee10 con 0x7f87dc0b0c40 2023-06-09T04:37:16.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87c3fff700 1 -- 172.21.15.149:0/428911991 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc011870 con 0x7f87dc0b0c40 2023-06-09T04:37:16.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.381+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87dc0aeac0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.382+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc0ad260 con 0x7f87dc0b0c40 2023-06-09T04:37:16.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.383+0000 7f87c3fff700 1 -- 172.21.15.149:0/428911991 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87cc0119d0 con 0x7f87dc0b0c40 2023-06-09T04:37:16.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.383+0000 7f87c3fff700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f87c806ace0 0x7f87c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.383+0000 7f87c3fff700 1 -- 172.21.15.149:0/428911991 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87cc021070 con 0x7f87dc0b0c40 2023-06-09T04:37:16.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.383+0000 7f87db7fe700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f87c806ace0 0x7f87c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.383+0000 7f87db7fe700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f87c806ace0 0x7f87c806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0c9c50 tx=0x7f87d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.387+0000 7f87c3fff700 1 -- 172.21.15.149:0/428911991 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87dc0ad260 con 0x7f87dc0b0c40 2023-06-09T04:37:16.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.576+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 --> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87dc0b0460 con 0x7f87c806ace0 2023-06-09T04:37:16.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.586+0000 7f87c3fff700 1 -- 172.21.15.149:0/428911991 <== mgr.4101 v2:172.21.15.149:6832/2920572545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367576 (secure 0 0 0) 0x7f87d0009700 con 0x7f87c806ace0 2023-06-09T04:37:16.590 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:16.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f87c806ace0 msgr2=0x7f87c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f87c806ace0 0x7f87c806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0c9c50 tx=0x7f87d0008040 comp rx=0 tx=0).stop 2023-06-09T04:37:16.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87dc0b0c40 msgr2=0x7f87dc0c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0c5090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00a010 tx=0x7f87cc004750 comp rx=0 tx=0).stop 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 shutdown_connections 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f87c806ace0 0x7f87c806d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87dc0afa30 0x7f87dc0cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87dc0cf140 0x7f87dc0c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 --2- 172.21.15.149:0/428911991 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87dc0b0c40 0x7f87dc0c5090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.590+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 >> 172.21.15.149:0/428911991 conn(0x7f87dc06b7e0 msgr2=0x7f87dc06eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:16.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.591+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 shutdown_connections 2023-06-09T04:37:16.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.591+0000 7f87e1a90700 1 -- 172.21.15.149:0/428911991 wait complete. 2023-06-09T04:37:16.594 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-06-09T04:37:16.603 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-06-09T04:37:16.396479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218948,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":3411968,"data_stored":2079591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003126"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518193+0000","last_change":"2023-06-09T04:36:53.082985+0000","last_active":"2023-06-09T04:36:57.518193+0000","last_peered":"2023-06-09T04:36:57.518193+0000","last_clean":"2023-06-09T04:36:57.518193+0000","last_became_active":"2023-06-09T04:36:53.082762+0000","last_became_peered":"2023-06-09T04:36:53.082762+0000","last_unstale":"2023-06-09T04:36:57.518193+0000","last_undegraded":"2023-06-09T04:36:57.518193+0000","last_fullsized":"2023-06-09T04:36:57.518193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:52.981825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501460+0000","last_change":"2023-06-09T04:36:53.092173+0000","last_active":"2023-06-09T04:36:57.501460+0000","last_peered":"2023-06-09T04:36:57.501460+0000","last_clean":"2023-06-09T04:36:57.501460+0000","last_became_active":"2023-06-09T04:36:53.091883+0000","last_became_peered":"2023-06-09T04:36:53.091883+0000","last_unstale":"2023-06-09T04:36:57.501460+0000","last_undegraded":"2023-06-09T04:36:57.501460+0000","last_fullsized":"2023-06-09T04:36:57.501460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502629+0000","last_change":"2023-06-09T04:36:53.082161+0000","last_active":"2023-06-09T04:36:57.502629+0000","last_peered":"2023-06-09T04:36:57.502629+0000","last_clean":"2023-06-09T04:36:57.502629+0000","last_became_active":"2023-06-09T04:36:53.081730+0000","last_became_peered":"2023-06-09T04:36:53.081730+0000","last_unstale":"2023-06-09T04:36:57.502629+0000","last_undegraded":"2023-06-09T04:36:57.502629+0000","last_fullsized":"2023-06-09T04:36:57.502629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:27:35.361250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516551+0000","last_change":"2023-06-09T04:36:53.091571+0000","last_active":"2023-06-09T04:36:57.516551+0000","last_peered":"2023-06-09T04:36:57.516551+0000","last_clean":"2023-06-09T04:36:57.516551+0000","last_became_active":"2023-06-09T04:36:53.091231+0000","last_became_peered":"2023-06-09T04:36:53.091231+0000","last_unstale":"2023-06-09T04:36:57.516551+0000","last_undegraded":"2023-06-09T04:36:57.516551+0000","last_fullsized":"2023-06-09T04:36:57.516551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:59:04.716639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500415+0000","last_change":"2023-06-09T04:36:53.080466+0000","last_active":"2023-06-09T04:36:57.500415+0000","last_peered":"2023-06-09T04:36:57.500415+0000","last_clean":"2023-06-09T04:36:57.500415+0000","last_became_active":"2023-06-09T04:36:53.080202+0000","last_became_peered":"2023-06-09T04:36:53.080202+0000","last_unstale":"2023-06-09T04:36:57.500415+0000","last_undegraded":"2023-06-09T04:36:57.500415+0000","last_fullsized":"2023-06-09T04:36:57.500415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:46.590852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502000+0000","last_change":"2023-06-09T04:36:53.085316+0000","last_active":"2023-06-09T04:36:57.502000+0000","last_peered":"2023-06-09T04:36:57.502000+0000","last_clean":"2023-06-09T04:36:57.502000+0000","last_became_active":"2023-06-09T04:36:53.085026+0000","last_became_peered":"2023-06-09T04:36:53.085026+0000","last_unstale":"2023-06-09T04:36:57.502000+0000","last_undegraded":"2023-06-09T04:36:57.502000+0000","last_fullsized":"2023-06-09T04:36:57.502000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:31.842402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516514+0000","last_change":"2023-06-09T04:36:53.095876+0000","last_active":"2023-06-09T04:36:57.516514+0000","last_peered":"2023-06-09T04:36:57.516514+0000","last_clean":"2023-06-09T04:36:57.516514+0000","last_became_active":"2023-06-09T04:36:53.095604+0000","last_became_peered":"2023-06-09T04:36:53.095604+0000","last_unstale":"2023-06-09T04:36:57.516514+0000","last_undegraded":"2023-06-09T04:36:57.516514+0000","last_fullsized":"2023-06-09T04:36:57.516514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:00.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500546+0000","last_change":"2023-06-09T04:36:53.089342+0000","last_active":"2023-06-09T04:36:57.500546+0000","last_peered":"2023-06-09T04:36:57.500546+0000","last_clean":"2023-06-09T04:36:57.500546+0000","last_became_active":"2023-06-09T04:36:53.089039+0000","last_became_peered":"2023-06-09T04:36:53.089039+0000","last_unstale":"2023-06-09T04:36:57.500546+0000","last_undegraded":"2023-06-09T04:36:57.500546+0000","last_fullsized":"2023-06-09T04:36:57.500546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:19.525415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500861+0000","last_change":"2023-06-09T04:36:53.087617+0000","last_active":"2023-06-09T04:36:57.500861+0000","last_peered":"2023-06-09T04:36:57.500861+0000","last_clean":"2023-06-09T04:36:57.500861+0000","last_became_active":"2023-06-09T04:36:53.086962+0000","last_became_peered":"2023-06-09T04:36:53.086962+0000","last_unstale":"2023-06-09T04:36:57.500861+0000","last_undegraded":"2023-06-09T04:36:57.500861+0000","last_fullsized":"2023-06-09T04:36:57.500861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502145+0000","last_change":"2023-06-09T04:36:53.086101+0000","last_active":"2023-06-09T04:36:57.502145+0000","last_peered":"2023-06-09T04:36:57.502145+0000","last_clean":"2023-06-09T04:36:57.502145+0000","last_became_active":"2023-06-09T04:36:53.085845+0000","last_became_peered":"2023-06-09T04:36:53.085845+0000","last_unstale":"2023-06-09T04:36:57.502145+0000","last_undegraded":"2023-06-09T04:36:57.502145+0000","last_fullsized":"2023-06-09T04:36:57.502145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502428+0000","last_change":"2023-06-09T04:36:53.081983+0000","last_active":"2023-06-09T04:36:57.502428+0000","last_peered":"2023-06-09T04:36:57.502428+0000","last_clean":"2023-06-09T04:36:57.502428+0000","last_became_active":"2023-06-09T04:36:53.081436+0000","last_became_peered":"2023-06-09T04:36:53.081436+0000","last_unstale":"2023-06-09T04:36:57.502428+0000","last_undegraded":"2023-06-09T04:36:57.502428+0000","last_fullsized":"2023-06-09T04:36:57.502428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:21:57.284108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517008+0000","last_change":"2023-06-09T04:36:53.091581+0000","last_active":"2023-06-09T04:36:57.517008+0000","last_peered":"2023-06-09T04:36:57.517008+0000","last_clean":"2023-06-09T04:36:57.517008+0000","last_became_active":"2023-06-09T04:36:53.091344+0000","last_became_peered":"2023-06-09T04:36:53.091344+0000","last_unstale":"2023-06-09T04:36:57.517008+0000","last_undegraded":"2023-06-09T04:36:57.517008+0000","last_fullsized":"2023-06-09T04:36:57.517008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:58.932374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516760+0000","last_change":"2023-06-09T04:36:53.079790+0000","last_active":"2023-06-09T04:36:57.516760+0000","last_peered":"2023-06-09T04:36:57.516760+0000","last_clean":"2023-06-09T04:36:57.516760+0000","last_became_active":"2023-06-09T04:36:53.079521+0000","last_became_peered":"2023-06-09T04:36:53.079521+0000","last_unstale":"2023-06-09T04:36:57.516760+0000","last_undegraded":"2023-06-09T04:36:57.516760+0000","last_fullsized":"2023-06-09T04:36:57.516760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:42:47.447288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501345+0000","last_change":"2023-06-09T04:36:53.085801+0000","last_active":"2023-06-09T04:36:57.501345+0000","last_peered":"2023-06-09T04:36:57.501345+0000","last_clean":"2023-06-09T04:36:57.501345+0000","last_became_active":"2023-06-09T04:36:53.085510+0000","last_became_peered":"2023-06-09T04:36:53.085510+0000","last_unstale":"2023-06-09T04:36:57.501345+0000","last_undegraded":"2023-06-09T04:36:57.501345+0000","last_fullsized":"2023-06-09T04:36:57.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516281+0000","last_change":"2023-06-09T04:36:53.095858+0000","last_active":"2023-06-09T04:36:57.516281+0000","last_peered":"2023-06-09T04:36:57.516281+0000","last_clean":"2023-06-09T04:36:57.516281+0000","last_became_active":"2023-06-09T04:36:53.095564+0000","last_became_peered":"2023-06-09T04:36:53.095564+0000","last_unstale":"2023-06-09T04:36:57.516281+0000","last_undegraded":"2023-06-09T04:36:57.516281+0000","last_fullsized":"2023-06-09T04:36:57.516281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502192+0000","last_change":"2023-06-09T04:36:53.087327+0000","last_active":"2023-06-09T04:36:57.502192+0000","last_peered":"2023-06-09T04:36:57.502192+0000","last_clean":"2023-06-09T04:36:57.502192+0000","last_became_active":"2023-06-09T04:36:53.087056+0000","last_became_peered":"2023-06-09T04:36:53.087056+0000","last_unstale":"2023-06-09T04:36:57.502192+0000","last_undegraded":"2023-06-09T04:36:57.502192+0000","last_fullsized":"2023-06-09T04:36:57.502192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:14.334505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500728+0000","last_change":"2023-06-09T04:36:53.087787+0000","last_active":"2023-06-09T04:36:57.500728+0000","last_peered":"2023-06-09T04:36:57.500728+0000","last_clean":"2023-06-09T04:36:57.500728+0000","last_became_active":"2023-06-09T04:36:53.087324+0000","last_became_peered":"2023-06-09T04:36:53.087324+0000","last_unstale":"2023-06-09T04:36:57.500728+0000","last_undegraded":"2023-06-09T04:36:57.500728+0000","last_fullsized":"2023-06-09T04:36:57.500728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502659+0000","last_change":"2023-06-09T04:36:53.087244+0000","last_active":"2023-06-09T04:36:57.502659+0000","last_peered":"2023-06-09T04:36:57.502659+0000","last_clean":"2023-06-09T04:36:57.502659+0000","last_became_active":"2023-06-09T04:36:53.086960+0000","last_became_peered":"2023-06-09T04:36:53.086960+0000","last_unstale":"2023-06-09T04:36:57.502659+0000","last_undegraded":"2023-06-09T04:36:57.502659+0000","last_fullsized":"2023-06-09T04:36:57.502659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:55.924392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517576+0000","last_change":"2023-06-09T04:36:53.093961+0000","last_active":"2023-06-09T04:36:57.517576+0000","last_peered":"2023-06-09T04:36:57.517576+0000","last_clean":"2023-06-09T04:36:57.517576+0000","last_became_active":"2023-06-09T04:36:53.093752+0000","last_became_peered":"2023-06-09T04:36:53.093752+0000","last_unstale":"2023-06-09T04:36:57.517576+0000","last_undegraded":"2023-06-09T04:36:57.517576+0000","last_fullsized":"2023-06-09T04:36:57.517576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:45.981753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501974+0000","last_change":"2023-06-09T04:36:53.080631+0000","last_active":"2023-06-09T04:36:57.501974+0000","last_peered":"2023-06-09T04:36:57.501974+0000","last_clean":"2023-06-09T04:36:57.501974+0000","last_became_active":"2023-06-09T04:36:53.080361+0000","last_became_peered":"2023-06-09T04:36:53.080361+0000","last_unstale":"2023-06-09T04:36:57.501974+0000","last_undegraded":"2023-06-09T04:36:57.501974+0000","last_fullsized":"2023-06-09T04:36:57.501974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:18.986311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516459+0000","last_change":"2023-06-09T04:36:53.093919+0000","last_active":"2023-06-09T04:36:57.516459+0000","last_peered":"2023-06-09T04:36:57.516459+0000","last_clean":"2023-06-09T04:36:57.516459+0000","last_became_active":"2023-06-09T04:36:53.093661+0000","last_became_peered":"2023-06-09T04:36:53.093661+0000","last_unstale":"2023-06-09T04:36:57.516459+0000","last_undegraded":"2023-06-09T04:36:57.516459+0000","last_fullsized":"2023-06-09T04:36:57.516459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500031+0000","last_change":"2023-06-09T04:36:53.088748+0000","last_active":"2023-06-09T04:36:57.500031+0000","last_peered":"2023-06-09T04:36:57.500031+0000","last_clean":"2023-06-09T04:36:57.500031+0000","last_became_active":"2023-06-09T04:36:53.088502+0000","last_became_peered":"2023-06-09T04:36:53.088502+0000","last_unstale":"2023-06-09T04:36:57.500031+0000","last_undegraded":"2023-06-09T04:36:57.500031+0000","last_fullsized":"2023-06-09T04:36:57.500031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517058+0000","last_change":"2023-06-09T04:36:53.083847+0000","last_active":"2023-06-09T04:36:57.517058+0000","last_peered":"2023-06-09T04:36:57.517058+0000","last_clean":"2023-06-09T04:36:57.517058+0000","last_became_active":"2023-06-09T04:36:53.083583+0000","last_became_peered":"2023-06-09T04:36:53.083583+0000","last_unstale":"2023-06-09T04:36:57.517058+0000","last_undegraded":"2023-06-09T04:36:57.517058+0000","last_fullsized":"2023-06-09T04:36:57.517058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:03.284187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516893+0000","last_change":"2023-06-09T04:36:53.095654+0000","last_active":"2023-06-09T04:36:57.516893+0000","last_peered":"2023-06-09T04:36:57.516893+0000","last_clean":"2023-06-09T04:36:57.516893+0000","last_became_active":"2023-06-09T04:36:53.095185+0000","last_became_peered":"2023-06-09T04:36:53.095185+0000","last_unstale":"2023-06-09T04:36:57.516893+0000","last_undegraded":"2023-06-09T04:36:57.516893+0000","last_fullsized":"2023-06-09T04:36:57.516893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:55:22.307750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517490+0000","last_change":"2023-06-09T04:36:53.097881+0000","last_active":"2023-06-09T04:36:57.517490+0000","last_peered":"2023-06-09T04:36:57.517490+0000","last_clean":"2023-06-09T04:36:57.517490+0000","last_became_active":"2023-06-09T04:36:53.097547+0000","last_became_peered":"2023-06-09T04:36:53.097547+0000","last_unstale":"2023-06-09T04:36:57.517490+0000","last_undegraded":"2023-06-09T04:36:57.517490+0000","last_fullsized":"2023-06-09T04:36:57.517490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:04.707925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517800+0000","last_change":"2023-06-09T04:36:53.086120+0000","last_active":"2023-06-09T04:36:57.517800+0000","last_peered":"2023-06-09T04:36:57.517800+0000","last_clean":"2023-06-09T04:36:57.517800+0000","last_became_active":"2023-06-09T04:36:53.084767+0000","last_became_peered":"2023-06-09T04:36:53.084767+0000","last_unstale":"2023-06-09T04:36:57.517800+0000","last_undegraded":"2023-06-09T04:36:57.517800+0000","last_fullsized":"2023-06-09T04:36:57.517800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:21.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501176+0000","last_change":"2023-06-09T04:36:53.097702+0000","last_active":"2023-06-09T04:36:57.501176+0000","last_peered":"2023-06-09T04:36:57.501176+0000","last_clean":"2023-06-09T04:36:57.501176+0000","last_became_active":"2023-06-09T04:36:53.097430+0000","last_became_peered":"2023-06-09T04:36:53.097430+0000","last_unstale":"2023-06-09T04:36:57.501176+0000","last_undegraded":"2023-06-09T04:36:57.501176+0000","last_fullsized":"2023-06-09T04:36:57.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:53.656092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502448+0000","last_change":"2023-06-09T04:36:57.111577+0000","last_active":"2023-06-09T04:36:57.502448+0000","last_peered":"2023-06-09T04:36:57.502448+0000","last_clean":"2023-06-09T04:36:57.502448+0000","last_became_active":"2023-06-09T04:36:57.111245+0000","last_became_peered":"2023-06-09T04:36:57.111245+0000","last_unstale":"2023-06-09T04:36:57.502448+0000","last_undegraded":"2023-06-09T04:36:57.502448+0000","last_fullsized":"2023-06-09T04:36:57.502448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:23:59.825454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501854+0000","last_change":"2023-06-09T04:36:52.689588+0000","last_active":"2023-06-09T04:36:57.501854+0000","last_peered":"2023-06-09T04:36:57.501854+0000","last_clean":"2023-06-09T04:36:57.501854+0000","last_became_active":"2023-06-09T04:36:52.689361+0000","last_became_peered":"2023-06-09T04:36:52.689361+0000","last_unstale":"2023-06-09T04:36:57.501854+0000","last_undegraded":"2023-06-09T04:36:57.501854+0000","last_fullsized":"2023-06-09T04:36:57.501854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:58.398325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518173+0000","last_change":"2023-06-09T04:36:53.091208+0000","last_active":"2023-06-09T04:36:57.518173+0000","last_peered":"2023-06-09T04:36:57.518173+0000","last_clean":"2023-06-09T04:36:57.518173+0000","last_became_active":"2023-06-09T04:36:53.090968+0000","last_became_peered":"2023-06-09T04:36:53.090968+0000","last_unstale":"2023-06-09T04:36:57.518173+0000","last_undegraded":"2023-06-09T04:36:57.518173+0000","last_fullsized":"2023-06-09T04:36:57.518173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:13.600595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517253+0000","last_change":"2023-06-09T04:36:57.119505+0000","last_active":"2023-06-09T04:36:57.517253+0000","last_peered":"2023-06-09T04:36:57.517253+0000","last_clean":"2023-06-09T04:36:57.517253+0000","last_became_active":"2023-06-09T04:36:57.119057+0000","last_became_peered":"2023-06-09T04:36:57.119057+0000","last_unstale":"2023-06-09T04:36:57.517253+0000","last_undegraded":"2023-06-09T04:36:57.517253+0000","last_fullsized":"2023-06-09T04:36:57.517253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:49:47.898866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515849+0000","last_change":"2023-06-09T04:36:52.689176+0000","last_active":"2023-06-09T04:36:57.515849+0000","last_peered":"2023-06-09T04:36:57.515849+0000","last_clean":"2023-06-09T04:36:57.515849+0000","last_became_active":"2023-06-09T04:36:52.688832+0000","last_became_peered":"2023-06-09T04:36:52.688832+0000","last_unstale":"2023-06-09T04:36:57.515849+0000","last_undegraded":"2023-06-09T04:36:57.515849+0000","last_fullsized":"2023-06-09T04:36:57.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:30.392902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500719+0000","last_change":"2023-06-09T04:36:53.084730+0000","last_active":"2023-06-09T04:36:57.500719+0000","last_peered":"2023-06-09T04:36:57.500719+0000","last_clean":"2023-06-09T04:36:57.500719+0000","last_became_active":"2023-06-09T04:36:53.084457+0000","last_became_peered":"2023-06-09T04:36:53.084457+0000","last_unstale":"2023-06-09T04:36:57.500719+0000","last_undegraded":"2023-06-09T04:36:57.500719+0000","last_fullsized":"2023-06-09T04:36:57.500719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:46.230118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500777+0000","last_change":"2023-06-09T04:36:57.115570+0000","last_active":"2023-06-09T04:36:57.500777+0000","last_peered":"2023-06-09T04:36:57.500777+0000","last_clean":"2023-06-09T04:36:57.500777+0000","last_became_active":"2023-06-09T04:36:57.115189+0000","last_became_peered":"2023-06-09T04:36:57.115189+0000","last_unstale":"2023-06-09T04:36:57.500777+0000","last_undegraded":"2023-06-09T04:36:57.500777+0000","last_fullsized":"2023-06-09T04:36:57.500777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:03.834311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516808+0000","last_change":"2023-06-09T04:36:52.687655+0000","last_active":"2023-06-09T04:36:57.516808+0000","last_peered":"2023-06-09T04:36:57.516808+0000","last_clean":"2023-06-09T04:36:57.516808+0000","last_became_active":"2023-06-09T04:36:52.687400+0000","last_became_peered":"2023-06-09T04:36:52.687400+0000","last_unstale":"2023-06-09T04:36:57.516808+0000","last_undegraded":"2023-06-09T04:36:57.516808+0000","last_fullsized":"2023-06-09T04:36:57.516808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:27:37.159215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517354+0000","last_change":"2023-06-09T04:36:53.092476+0000","last_active":"2023-06-09T04:36:57.517354+0000","last_peered":"2023-06-09T04:36:57.517354+0000","last_clean":"2023-06-09T04:36:57.517354+0000","last_became_active":"2023-06-09T04:36:53.091216+0000","last_became_peered":"2023-06-09T04:36:53.091216+0000","last_unstale":"2023-06-09T04:36:57.517354+0000","last_undegraded":"2023-06-09T04:36:57.517354+0000","last_fullsized":"2023-06-09T04:36:57.517354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:18:25.432988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515945+0000","last_change":"2023-06-09T04:36:57.117686+0000","last_active":"2023-06-09T04:36:57.515945+0000","last_peered":"2023-06-09T04:36:57.515945+0000","last_clean":"2023-06-09T04:36:57.515945+0000","last_became_active":"2023-06-09T04:36:57.117316+0000","last_became_peered":"2023-06-09T04:36:57.117316+0000","last_unstale":"2023-06-09T04:36:57.515945+0000","last_undegraded":"2023-06-09T04:36:57.515945+0000","last_fullsized":"2023-06-09T04:36:57.515945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:39:59.205133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500858+0000","last_change":"2023-06-09T04:36:52.680452+0000","last_active":"2023-06-09T04:36:57.500858+0000","last_peered":"2023-06-09T04:36:57.500858+0000","last_clean":"2023-06-09T04:36:57.500858+0000","last_became_active":"2023-06-09T04:36:52.680163+0000","last_became_peered":"2023-06-09T04:36:52.680163+0000","last_unstale":"2023-06-09T04:36:57.500858+0000","last_undegraded":"2023-06-09T04:36:57.500858+0000","last_fullsized":"2023-06-09T04:36:57.500858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516765+0000","last_change":"2023-06-09T04:36:53.082234+0000","last_active":"2023-06-09T04:36:57.516765+0000","last_peered":"2023-06-09T04:36:57.516765+0000","last_clean":"2023-06-09T04:36:57.516765+0000","last_became_active":"2023-06-09T04:36:53.081968+0000","last_became_peered":"2023-06-09T04:36:53.081968+0000","last_unstale":"2023-06-09T04:36:57.516765+0000","last_undegraded":"2023-06-09T04:36:57.516765+0000","last_fullsized":"2023-06-09T04:36:57.516765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:56.517310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515939+0000","last_change":"2023-06-09T04:36:57.124201+0000","last_active":"2023-06-09T04:36:57.515939+0000","last_peered":"2023-06-09T04:36:57.515939+0000","last_clean":"2023-06-09T04:36:57.515939+0000","last_became_active":"2023-06-09T04:36:57.123897+0000","last_became_peered":"2023-06-09T04:36:57.123897+0000","last_unstale":"2023-06-09T04:36:57.515939+0000","last_undegraded":"2023-06-09T04:36:57.515939+0000","last_fullsized":"2023-06-09T04:36:57.515939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:57.073264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501691+0000","last_change":"2023-06-09T04:36:52.685020+0000","last_active":"2023-06-09T04:36:57.501691+0000","last_peered":"2023-06-09T04:36:57.501691+0000","last_clean":"2023-06-09T04:36:57.501691+0000","last_became_active":"2023-06-09T04:36:52.684745+0000","last_became_peered":"2023-06-09T04:36:52.684745+0000","last_unstale":"2023-06-09T04:36:57.501691+0000","last_undegraded":"2023-06-09T04:36:57.501691+0000","last_fullsized":"2023-06-09T04:36:57.501691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:59.409669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516410+0000","last_change":"2023-06-09T04:36:53.087590+0000","last_active":"2023-06-09T04:36:57.516410+0000","last_peered":"2023-06-09T04:36:57.516410+0000","last_clean":"2023-06-09T04:36:57.516410+0000","last_became_active":"2023-06-09T04:36:53.087288+0000","last_became_peered":"2023-06-09T04:36:53.087288+0000","last_unstale":"2023-06-09T04:36:57.516410+0000","last_undegraded":"2023-06-09T04:36:57.516410+0000","last_fullsized":"2023-06-09T04:36:57.516410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:08.176626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517477+0000","last_change":"2023-06-09T04:36:57.117163+0000","last_active":"2023-06-09T04:36:57.517477+0000","last_peered":"2023-06-09T04:36:57.517477+0000","last_clean":"2023-06-09T04:36:57.517477+0000","last_became_active":"2023-06-09T04:36:57.116767+0000","last_became_peered":"2023-06-09T04:36:57.116767+0000","last_unstale":"2023-06-09T04:36:57.517477+0000","last_undegraded":"2023-06-09T04:36:57.517477+0000","last_fullsized":"2023-06-09T04:36:57.517477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:19.081920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516877+0000","last_change":"2023-06-09T04:36:52.688067+0000","last_active":"2023-06-09T04:36:57.516877+0000","last_peered":"2023-06-09T04:36:57.516877+0000","last_clean":"2023-06-09T04:36:57.516877+0000","last_became_active":"2023-06-09T04:36:52.687767+0000","last_became_peered":"2023-06-09T04:36:52.687767+0000","last_unstale":"2023-06-09T04:36:57.516877+0000","last_undegraded":"2023-06-09T04:36:57.516877+0000","last_fullsized":"2023-06-09T04:36:57.516877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516575+0000","last_change":"2023-06-09T04:36:53.094793+0000","last_active":"2023-06-09T04:36:57.516575+0000","last_peered":"2023-06-09T04:36:57.516575+0000","last_clean":"2023-06-09T04:36:57.516575+0000","last_became_active":"2023-06-09T04:36:53.094544+0000","last_became_peered":"2023-06-09T04:36:53.094544+0000","last_unstale":"2023-06-09T04:36:57.516575+0000","last_undegraded":"2023-06-09T04:36:57.516575+0000","last_fullsized":"2023-06-09T04:36:57.516575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:23.171635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516588+0000","last_change":"2023-06-09T04:36:57.115780+0000","last_active":"2023-06-09T04:36:57.516588+0000","last_peered":"2023-06-09T04:36:57.516588+0000","last_clean":"2023-06-09T04:36:57.516588+0000","last_became_active":"2023-06-09T04:36:57.115404+0000","last_became_peered":"2023-06-09T04:36:57.115404+0000","last_unstale":"2023-06-09T04:36:57.516588+0000","last_undegraded":"2023-06-09T04:36:57.516588+0000","last_fullsized":"2023-06-09T04:36:57.516588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:51:48.980218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:37:02.349143+0000","last_change":"2023-06-09T04:36:52.692095+0000","last_active":"2023-06-09T04:37:02.349143+0000","last_peered":"2023-06-09T04:37:02.349143+0000","last_clean":"2023-06-09T04:37:02.349143+0000","last_became_active":"2023-06-09T04:36:52.691784+0000","last_became_peered":"2023-06-09T04:36:52.691784+0000","last_unstale":"2023-06-09T04:37:02.349143+0000","last_undegraded":"2023-06-09T04:37:02.349143+0000","last_fullsized":"2023-06-09T04:37:02.349143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:15.356816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502053+0000","last_change":"2023-06-09T04:36:53.090930+0000","last_active":"2023-06-09T04:36:57.502053+0000","last_peered":"2023-06-09T04:36:57.502053+0000","last_clean":"2023-06-09T04:36:57.502053+0000","last_became_active":"2023-06-09T04:36:53.090657+0000","last_became_peered":"2023-06-09T04:36:53.090657+0000","last_unstale":"2023-06-09T04:36:57.502053+0000","last_undegraded":"2023-06-09T04:36:57.502053+0000","last_fullsized":"2023-06-09T04:36:57.502053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:51.015748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501544+0000","last_change":"2023-06-09T04:36:57.117459+0000","last_active":"2023-06-09T04:36:57.501544+0000","last_peered":"2023-06-09T04:36:57.501544+0000","last_clean":"2023-06-09T04:36:57.501544+0000","last_became_active":"2023-06-09T04:36:57.116484+0000","last_became_peered":"2023-06-09T04:36:57.116484+0000","last_unstale":"2023-06-09T04:36:57.501544+0000","last_undegraded":"2023-06-09T04:36:57.501544+0000","last_fullsized":"2023-06-09T04:36:57.501544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:49.647290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516290+0000","last_change":"2023-06-09T04:36:52.695139+0000","last_active":"2023-06-09T04:36:57.516290+0000","last_peered":"2023-06-09T04:36:57.516290+0000","last_clean":"2023-06-09T04:36:57.516290+0000","last_became_active":"2023-06-09T04:36:52.694827+0000","last_became_peered":"2023-06-09T04:36:52.694827+0000","last_unstale":"2023-06-09T04:36:57.516290+0000","last_undegraded":"2023-06-09T04:36:57.516290+0000","last_fullsized":"2023-06-09T04:36:57.516290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517671+0000","last_change":"2023-06-09T04:36:53.095157+0000","last_active":"2023-06-09T04:36:57.517671+0000","last_peered":"2023-06-09T04:36:57.517671+0000","last_clean":"2023-06-09T04:36:57.517671+0000","last_became_active":"2023-06-09T04:36:53.094875+0000","last_became_peered":"2023-06-09T04:36:53.094875+0000","last_unstale":"2023-06-09T04:36:57.517671+0000","last_undegraded":"2023-06-09T04:36:57.517671+0000","last_fullsized":"2023-06-09T04:36:57.517671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.901417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517856+0000","last_change":"2023-06-09T04:36:57.121242+0000","last_active":"2023-06-09T04:36:57.517856+0000","last_peered":"2023-06-09T04:36:57.517856+0000","last_clean":"2023-06-09T04:36:57.517856+0000","last_became_active":"2023-06-09T04:36:57.120828+0000","last_became_peered":"2023-06-09T04:36:57.120828+0000","last_unstale":"2023-06-09T04:36:57.517856+0000","last_undegraded":"2023-06-09T04:36:57.517856+0000","last_fullsized":"2023-06-09T04:36:57.517856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:34.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500201+0000","last_change":"2023-06-09T04:36:52.685837+0000","last_active":"2023-06-09T04:36:57.500201+0000","last_peered":"2023-06-09T04:36:57.500201+0000","last_clean":"2023-06-09T04:36:57.500201+0000","last_became_active":"2023-06-09T04:36:52.685574+0000","last_became_peered":"2023-06-09T04:36:52.685574+0000","last_unstale":"2023-06-09T04:36:57.500201+0000","last_undegraded":"2023-06-09T04:36:57.500201+0000","last_fullsized":"2023-06-09T04:36:57.500201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:30.615879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501059+0000","last_change":"2023-06-09T04:36:53.097686+0000","last_active":"2023-06-09T04:36:57.501059+0000","last_peered":"2023-06-09T04:36:57.501059+0000","last_clean":"2023-06-09T04:36:57.501059+0000","last_became_active":"2023-06-09T04:36:53.097408+0000","last_became_peered":"2023-06-09T04:36:53.097408+0000","last_unstale":"2023-06-09T04:36:57.501059+0000","last_undegraded":"2023-06-09T04:36:57.501059+0000","last_fullsized":"2023-06-09T04:36:57.501059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517413+0000","last_change":"2023-06-09T04:36:57.121670+0000","last_active":"2023-06-09T04:36:57.517413+0000","last_peered":"2023-06-09T04:36:57.517413+0000","last_clean":"2023-06-09T04:36:57.517413+0000","last_became_active":"2023-06-09T04:36:57.121104+0000","last_became_peered":"2023-06-09T04:36:57.121104+0000","last_unstale":"2023-06-09T04:36:57.517413+0000","last_undegraded":"2023-06-09T04:36:57.517413+0000","last_fullsized":"2023-06-09T04:36:57.517413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:16:39.554269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516432+0000","last_change":"2023-06-09T04:36:52.694081+0000","last_active":"2023-06-09T04:36:57.516432+0000","last_peered":"2023-06-09T04:36:57.516432+0000","last_clean":"2023-06-09T04:36:57.516432+0000","last_became_active":"2023-06-09T04:36:52.693752+0000","last_became_peered":"2023-06-09T04:36:52.693752+0000","last_unstale":"2023-06-09T04:36:57.516432+0000","last_undegraded":"2023-06-09T04:36:57.516432+0000","last_fullsized":"2023-06-09T04:36:57.516432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:45.222648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500883+0000","last_change":"2023-06-09T04:36:53.080447+0000","last_active":"2023-06-09T04:36:57.500883+0000","last_peered":"2023-06-09T04:36:57.500883+0000","last_clean":"2023-06-09T04:36:57.500883+0000","last_became_active":"2023-06-09T04:36:53.080171+0000","last_became_peered":"2023-06-09T04:36:53.080171+0000","last_unstale":"2023-06-09T04:36:57.500883+0000","last_undegraded":"2023-06-09T04:36:57.500883+0000","last_fullsized":"2023-06-09T04:36:57.500883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:42.879671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501651+0000","last_change":"2023-06-09T04:36:57.117032+0000","last_active":"2023-06-09T04:36:57.501651+0000","last_peered":"2023-06-09T04:36:57.501651+0000","last_clean":"2023-06-09T04:36:57.501651+0000","last_became_active":"2023-06-09T04:36:57.116612+0000","last_became_peered":"2023-06-09T04:36:57.116612+0000","last_unstale":"2023-06-09T04:36:57.501651+0000","last_undegraded":"2023-06-09T04:36:57.501651+0000","last_fullsized":"2023-06-09T04:36:57.501651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:28.517085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515881+0000","last_change":"2023-06-09T04:36:52.694818+0000","last_active":"2023-06-09T04:36:57.515881+0000","last_peered":"2023-06-09T04:36:57.515881+0000","last_clean":"2023-06-09T04:36:57.515881+0000","last_became_active":"2023-06-09T04:36:52.694511+0000","last_became_peered":"2023-06-09T04:36:52.694511+0000","last_unstale":"2023-06-09T04:36:57.515881+0000","last_undegraded":"2023-06-09T04:36:57.515881+0000","last_fullsized":"2023-06-09T04:36:57.515881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:03:02.382793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517854+0000","last_change":"2023-06-09T04:36:53.093019+0000","last_active":"2023-06-09T04:36:57.517854+0000","last_peered":"2023-06-09T04:36:57.517854+0000","last_clean":"2023-06-09T04:36:57.517854+0000","last_became_active":"2023-06-09T04:36:53.092732+0000","last_became_peered":"2023-06-09T04:36:53.092732+0000","last_unstale":"2023-06-09T04:36:57.517854+0000","last_undegraded":"2023-06-09T04:36:57.517854+0000","last_fullsized":"2023-06-09T04:36:57.517854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:55.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516764+0000","last_change":"2023-06-09T04:36:57.121228+0000","last_active":"2023-06-09T04:36:57.516764+0000","last_peered":"2023-06-09T04:36:57.516764+0000","last_clean":"2023-06-09T04:36:57.516764+0000","last_became_active":"2023-06-09T04:36:57.120064+0000","last_became_peered":"2023-06-09T04:36:57.120064+0000","last_unstale":"2023-06-09T04:36:57.516764+0000","last_undegraded":"2023-06-09T04:36:57.516764+0000","last_fullsized":"2023-06-09T04:36:57.516764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:46.296844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516944+0000","last_change":"2023-06-09T04:36:52.692512+0000","last_active":"2023-06-09T04:36:57.516944+0000","last_peered":"2023-06-09T04:36:57.516944+0000","last_clean":"2023-06-09T04:36:57.516944+0000","last_became_active":"2023-06-09T04:36:52.692141+0000","last_became_peered":"2023-06-09T04:36:52.692141+0000","last_unstale":"2023-06-09T04:36:57.516944+0000","last_undegraded":"2023-06-09T04:36:57.516944+0000","last_fullsized":"2023-06-09T04:36:57.516944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:53:31.420451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500425+0000","last_change":"2023-06-09T04:36:53.091220+0000","last_active":"2023-06-09T04:36:57.500425+0000","last_peered":"2023-06-09T04:36:57.500425+0000","last_clean":"2023-06-09T04:36:57.500425+0000","last_became_active":"2023-06-09T04:36:53.090754+0000","last_became_peered":"2023-06-09T04:36:53.090754+0000","last_unstale":"2023-06-09T04:36:57.500425+0000","last_undegraded":"2023-06-09T04:36:57.500425+0000","last_fullsized":"2023-06-09T04:36:57.500425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:06.194724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516278+0000","last_change":"2023-06-09T04:36:57.113964+0000","last_active":"2023-06-09T04:36:57.516278+0000","last_peered":"2023-06-09T04:36:57.516278+0000","last_clean":"2023-06-09T04:36:57.516278+0000","last_became_active":"2023-06-09T04:36:57.113569+0000","last_became_peered":"2023-06-09T04:36:57.113569+0000","last_unstale":"2023-06-09T04:36:57.516278+0000","last_undegraded":"2023-06-09T04:36:57.516278+0000","last_fullsized":"2023-06-09T04:36:57.516278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:36.118778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516531+0000","last_change":"2023-06-09T04:36:52.692397+0000","last_active":"2023-06-09T04:36:57.516531+0000","last_peered":"2023-06-09T04:36:57.516531+0000","last_clean":"2023-06-09T04:36:57.516531+0000","last_became_active":"2023-06-09T04:36:52.692131+0000","last_became_peered":"2023-06-09T04:36:52.692131+0000","last_unstale":"2023-06-09T04:36:57.516531+0000","last_undegraded":"2023-06-09T04:36:57.516531+0000","last_fullsized":"2023-06-09T04:36:57.516531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:53.328867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501708+0000","last_change":"2023-06-09T04:36:53.091347+0000","last_active":"2023-06-09T04:36:57.501708+0000","last_peered":"2023-06-09T04:36:57.501708+0000","last_clean":"2023-06-09T04:36:57.501708+0000","last_became_active":"2023-06-09T04:36:53.091096+0000","last_became_peered":"2023-06-09T04:36:53.091096+0000","last_unstale":"2023-06-09T04:36:57.501708+0000","last_undegraded":"2023-06-09T04:36:57.501708+0000","last_fullsized":"2023-06-09T04:36:57.501708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:49:02.631814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516638+0000","last_change":"2023-06-09T04:36:57.119015+0000","last_active":"2023-06-09T04:36:57.516638+0000","last_peered":"2023-06-09T04:36:57.516638+0000","last_clean":"2023-06-09T04:36:57.516638+0000","last_became_active":"2023-06-09T04:36:57.118718+0000","last_became_peered":"2023-06-09T04:36:57.118718+0000","last_unstale":"2023-06-09T04:36:57.516638+0000","last_undegraded":"2023-06-09T04:36:57.516638+0000","last_fullsized":"2023-06-09T04:36:57.516638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:37.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516611+0000","last_change":"2023-06-09T04:36:52.687979+0000","last_active":"2023-06-09T04:36:57.516611+0000","last_peered":"2023-06-09T04:36:57.516611+0000","last_clean":"2023-06-09T04:36:57.516611+0000","last_became_active":"2023-06-09T04:36:52.687674+0000","last_became_peered":"2023-06-09T04:36:52.687674+0000","last_unstale":"2023-06-09T04:36:57.516611+0000","last_undegraded":"2023-06-09T04:36:57.516611+0000","last_fullsized":"2023-06-09T04:36:57.516611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515933+0000","last_change":"2023-06-09T04:36:53.092231+0000","last_active":"2023-06-09T04:36:57.515933+0000","last_peered":"2023-06-09T04:36:57.515933+0000","last_clean":"2023-06-09T04:36:57.515933+0000","last_became_active":"2023-06-09T04:36:53.091964+0000","last_became_peered":"2023-06-09T04:36:53.091964+0000","last_unstale":"2023-06-09T04:36:57.515933+0000","last_undegraded":"2023-06-09T04:36:57.515933+0000","last_fullsized":"2023-06-09T04:36:57.515933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:52.833274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516701+0000","last_change":"2023-06-09T04:36:57.112419+0000","last_active":"2023-06-09T04:36:57.516701+0000","last_peered":"2023-06-09T04:36:57.516701+0000","last_clean":"2023-06-09T04:36:57.516701+0000","last_became_active":"2023-06-09T04:36:57.112077+0000","last_became_peered":"2023-06-09T04:36:57.112077+0000","last_unstale":"2023-06-09T04:36:57.516701+0000","last_undegraded":"2023-06-09T04:36:57.516701+0000","last_fullsized":"2023-06-09T04:36:57.516701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:05.009136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501097+0000","last_change":"2023-06-09T04:36:52.688267+0000","last_active":"2023-06-09T04:36:57.501097+0000","last_peered":"2023-06-09T04:36:57.501097+0000","last_clean":"2023-06-09T04:36:57.501097+0000","last_became_active":"2023-06-09T04:36:52.687992+0000","last_became_peered":"2023-06-09T04:36:52.687992+0000","last_unstale":"2023-06-09T04:36:57.501097+0000","last_undegraded":"2023-06-09T04:36:57.501097+0000","last_fullsized":"2023-06-09T04:36:57.501097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:24.458188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500688+0000","last_change":"2023-06-09T04:36:53.090432+0000","last_active":"2023-06-09T04:36:57.500688+0000","last_peered":"2023-06-09T04:36:57.500688+0000","last_clean":"2023-06-09T04:36:57.500688+0000","last_became_active":"2023-06-09T04:36:53.090048+0000","last_became_peered":"2023-06-09T04:36:53.090048+0000","last_unstale":"2023-06-09T04:36:57.500688+0000","last_undegraded":"2023-06-09T04:36:57.500688+0000","last_fullsized":"2023-06-09T04:36:57.500688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516962+0000","last_change":"2023-06-09T04:36:57.119128+0000","last_active":"2023-06-09T04:36:57.516962+0000","last_peered":"2023-06-09T04:36:57.516962+0000","last_clean":"2023-06-09T04:36:57.516962+0000","last_became_active":"2023-06-09T04:36:57.118804+0000","last_became_peered":"2023-06-09T04:36:57.118804+0000","last_unstale":"2023-06-09T04:36:57.516962+0000","last_undegraded":"2023-06-09T04:36:57.516962+0000","last_fullsized":"2023-06-09T04:36:57.516962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:45:01.621362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517322+0000","last_change":"2023-06-09T04:36:52.687200+0000","last_active":"2023-06-09T04:36:57.517322+0000","last_peered":"2023-06-09T04:36:57.517322+0000","last_clean":"2023-06-09T04:36:57.517322+0000","last_became_active":"2023-06-09T04:36:52.686926+0000","last_became_peered":"2023-06-09T04:36:52.686926+0000","last_unstale":"2023-06-09T04:36:57.517322+0000","last_undegraded":"2023-06-09T04:36:57.517322+0000","last_fullsized":"2023-06-09T04:36:57.517322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:55.176458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501823+0000","last_change":"2023-06-09T04:36:53.087793+0000","last_active":"2023-06-09T04:36:57.501823+0000","last_peered":"2023-06-09T04:36:57.501823+0000","last_clean":"2023-06-09T04:36:57.501823+0000","last_became_active":"2023-06-09T04:36:53.087526+0000","last_became_peered":"2023-06-09T04:36:53.087526+0000","last_unstale":"2023-06-09T04:36:57.501823+0000","last_undegraded":"2023-06-09T04:36:57.501823+0000","last_fullsized":"2023-06-09T04:36:57.501823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:08:25.419479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516970+0000","last_change":"2023-06-09T04:36:57.109316+0000","last_active":"2023-06-09T04:36:57.516970+0000","last_peered":"2023-06-09T04:36:57.516970+0000","last_clean":"2023-06-09T04:36:57.516970+0000","last_became_active":"2023-06-09T04:36:57.108933+0000","last_became_peered":"2023-06-09T04:36:57.108933+0000","last_unstale":"2023-06-09T04:36:57.516970+0000","last_undegraded":"2023-06-09T04:36:57.516970+0000","last_fullsized":"2023-06-09T04:36:57.516970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:37:23.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516752+0000","last_change":"2023-06-09T04:36:52.693014+0000","last_active":"2023-06-09T04:36:57.516752+0000","last_peered":"2023-06-09T04:36:57.516752+0000","last_clean":"2023-06-09T04:36:57.516752+0000","last_became_active":"2023-06-09T04:36:52.692786+0000","last_became_peered":"2023-06-09T04:36:52.692786+0000","last_unstale":"2023-06-09T04:36:57.516752+0000","last_undegraded":"2023-06-09T04:36:57.516752+0000","last_fullsized":"2023-06-09T04:36:57.516752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:37.205136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502190+0000","last_change":"2023-06-09T04:36:53.087658+0000","last_active":"2023-06-09T04:36:57.502190+0000","last_peered":"2023-06-09T04:36:57.502190+0000","last_clean":"2023-06-09T04:36:57.502190+0000","last_became_active":"2023-06-09T04:36:53.087414+0000","last_became_peered":"2023-06-09T04:36:53.087414+0000","last_unstale":"2023-06-09T04:36:57.502190+0000","last_undegraded":"2023-06-09T04:36:57.502190+0000","last_fullsized":"2023-06-09T04:36:57.502190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:43.763282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501165+0000","last_change":"2023-06-09T04:36:57.118582+0000","last_active":"2023-06-09T04:36:57.501165+0000","last_peered":"2023-06-09T04:36:57.501165+0000","last_clean":"2023-06-09T04:36:57.501165+0000","last_became_active":"2023-06-09T04:36:57.118128+0000","last_became_peered":"2023-06-09T04:36:57.118128+0000","last_unstale":"2023-06-09T04:36:57.501165+0000","last_undegraded":"2023-06-09T04:36:57.501165+0000","last_fullsized":"2023-06-09T04:36:57.501165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:35.040521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501455+0000","last_change":"2023-06-09T04:36:52.695510+0000","last_active":"2023-06-09T04:36:57.501455+0000","last_peered":"2023-06-09T04:36:57.501455+0000","last_clean":"2023-06-09T04:36:57.501455+0000","last_became_active":"2023-06-09T04:36:52.695256+0000","last_became_peered":"2023-06-09T04:36:52.695256+0000","last_unstale":"2023-06-09T04:36:57.501455+0000","last_undegraded":"2023-06-09T04:36:57.501455+0000","last_fullsized":"2023-06-09T04:36:57.501455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:35.772477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502738+0000","last_change":"2023-06-09T04:36:53.094151+0000","last_active":"2023-06-09T04:36:57.502738+0000","last_peered":"2023-06-09T04:36:57.502738+0000","last_clean":"2023-06-09T04:36:57.502738+0000","last_became_active":"2023-06-09T04:36:53.093875+0000","last_became_peered":"2023-06-09T04:36:53.093875+0000","last_unstale":"2023-06-09T04:36:57.502738+0000","last_undegraded":"2023-06-09T04:36:57.502738+0000","last_fullsized":"2023-06-09T04:36:57.502738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:31.886725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502450+0000","last_change":"2023-06-09T04:36:57.115949+0000","last_active":"2023-06-09T04:36:57.502450+0000","last_peered":"2023-06-09T04:36:57.502450+0000","last_clean":"2023-06-09T04:36:57.502450+0000","last_became_active":"2023-06-09T04:36:57.115534+0000","last_became_peered":"2023-06-09T04:36:57.115534+0000","last_unstale":"2023-06-09T04:36:57.502450+0000","last_undegraded":"2023-06-09T04:36:57.502450+0000","last_fullsized":"2023-06-09T04:36:57.502450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:19:23.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516691+0000","last_change":"2023-06-09T04:36:52.690632+0000","last_active":"2023-06-09T04:36:57.516691+0000","last_peered":"2023-06-09T04:36:57.516691+0000","last_clean":"2023-06-09T04:36:57.516691+0000","last_became_active":"2023-06-09T04:36:52.690338+0000","last_became_peered":"2023-06-09T04:36:52.690338+0000","last_unstale":"2023-06-09T04:36:57.516691+0000","last_undegraded":"2023-06-09T04:36:57.516691+0000","last_fullsized":"2023-06-09T04:36:57.516691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:15:03.415789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517712+0000","last_change":"2023-06-09T04:36:53.095130+0000","last_active":"2023-06-09T04:36:57.517712+0000","last_peered":"2023-06-09T04:36:57.517712+0000","last_clean":"2023-06-09T04:36:57.517712+0000","last_became_active":"2023-06-09T04:36:53.094805+0000","last_became_peered":"2023-06-09T04:36:53.094805+0000","last_unstale":"2023-06-09T04:36:57.517712+0000","last_undegraded":"2023-06-09T04:36:57.517712+0000","last_fullsized":"2023-06-09T04:36:57.517712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:22.682476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501842+0000","last_change":"2023-06-09T04:36:57.115754+0000","last_active":"2023-06-09T04:36:57.501842+0000","last_peered":"2023-06-09T04:36:57.501842+0000","last_clean":"2023-06-09T04:36:57.501842+0000","last_became_active":"2023-06-09T04:36:57.115330+0000","last_became_peered":"2023-06-09T04:36:57.115330+0000","last_unstale":"2023-06-09T04:36:57.501842+0000","last_undegraded":"2023-06-09T04:36:57.501842+0000","last_fullsized":"2023-06-09T04:36:57.501842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:29.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517666+0000","last_change":"2023-06-09T04:36:52.693950+0000","last_active":"2023-06-09T04:36:57.517666+0000","last_peered":"2023-06-09T04:36:57.517666+0000","last_clean":"2023-06-09T04:36:57.517666+0000","last_became_active":"2023-06-09T04:36:52.691659+0000","last_became_peered":"2023-06-09T04:36:52.691659+0000","last_unstale":"2023-06-09T04:36:57.517666+0000","last_undegraded":"2023-06-09T04:36:57.517666+0000","last_fullsized":"2023-06-09T04:36:57.517666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:44.676469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502189+0000","last_change":"2023-06-09T04:36:47.621971+0000","last_active":"2023-06-09T04:36:57.502189+0000","last_peered":"2023-06-09T04:36:57.502189+0000","last_clean":"2023-06-09T04:36:57.502189+0000","last_became_active":"2023-06-09T04:36:47.621651+0000","last_became_peered":"2023-06-09T04:36:47.621651+0000","last_unstale":"2023-06-09T04:36:57.502189+0000","last_undegraded":"2023-06-09T04:36:57.502189+0000","last_fullsized":"2023-06-09T04:36:57.502189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:37:38.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516574+0000","last_change":"2023-06-09T04:36:53.087151+0000","last_active":"2023-06-09T04:36:57.516574+0000","last_peered":"2023-06-09T04:36:57.516574+0000","last_clean":"2023-06-09T04:36:57.516574+0000","last_became_active":"2023-06-09T04:36:53.086901+0000","last_became_peered":"2023-06-09T04:36:53.086901+0000","last_unstale":"2023-06-09T04:36:57.516574+0000","last_undegraded":"2023-06-09T04:36:57.516574+0000","last_fullsized":"2023-06-09T04:36:57.516574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:45.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516429+0000","last_change":"2023-06-09T04:36:57.124627+0000","last_active":"2023-06-09T04:36:57.516429+0000","last_peered":"2023-06-09T04:36:57.516429+0000","last_clean":"2023-06-09T04:36:57.516429+0000","last_became_active":"2023-06-09T04:36:57.124220+0000","last_became_peered":"2023-06-09T04:36:57.124220+0000","last_unstale":"2023-06-09T04:36:57.516429+0000","last_undegraded":"2023-06-09T04:36:57.516429+0000","last_fullsized":"2023-06-09T04:36:57.516429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:22:55.831089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517546+0000","last_change":"2023-06-09T04:36:47.613976+0000","last_active":"2023-06-09T04:36:57.517546+0000","last_peered":"2023-06-09T04:36:57.517546+0000","last_clean":"2023-06-09T04:36:57.517546+0000","last_became_active":"2023-06-09T04:36:47.613691+0000","last_became_peered":"2023-06-09T04:36:47.613691+0000","last_unstale":"2023-06-09T04:36:57.517546+0000","last_undegraded":"2023-06-09T04:36:57.517546+0000","last_fullsized":"2023-06-09T04:36:57.517546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:59.301853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500484+0000","last_change":"2023-06-09T04:36:52.686932+0000","last_active":"2023-06-09T04:36:57.500484+0000","last_peered":"2023-06-09T04:36:57.500484+0000","last_clean":"2023-06-09T04:36:57.500484+0000","last_became_active":"2023-06-09T04:36:52.686353+0000","last_became_peered":"2023-06-09T04:36:52.686353+0000","last_unstale":"2023-06-09T04:36:57.500484+0000","last_undegraded":"2023-06-09T04:36:57.500484+0000","last_fullsized":"2023-06-09T04:36:57.500484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:24.229634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501505+0000","last_change":"2023-06-09T04:36:53.086408+0000","last_active":"2023-06-09T04:36:57.501505+0000","last_peered":"2023-06-09T04:36:57.501505+0000","last_clean":"2023-06-09T04:36:57.501505+0000","last_became_active":"2023-06-09T04:36:53.086039+0000","last_became_peered":"2023-06-09T04:36:53.086039+0000","last_unstale":"2023-06-09T04:36:57.501505+0000","last_undegraded":"2023-06-09T04:36:57.501505+0000","last_fullsized":"2023-06-09T04:36:57.501505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:20:52.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500834+0000","last_change":"2023-06-09T04:36:57.119321+0000","last_active":"2023-06-09T04:36:57.500834+0000","last_peered":"2023-06-09T04:36:57.500834+0000","last_clean":"2023-06-09T04:36:57.500834+0000","last_became_active":"2023-06-09T04:36:57.118916+0000","last_became_peered":"2023-06-09T04:36:57.118916+0000","last_unstale":"2023-06-09T04:36:57.500834+0000","last_undegraded":"2023-06-09T04:36:57.500834+0000","last_fullsized":"2023-06-09T04:36:57.500834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:50.167224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516431+0000","last_change":"2023-06-09T04:36:47.626414+0000","last_active":"2023-06-09T04:36:57.516431+0000","last_peered":"2023-06-09T04:36:57.516431+0000","last_clean":"2023-06-09T04:36:57.516431+0000","last_became_active":"2023-06-09T04:36:47.626166+0000","last_became_peered":"2023-06-09T04:36:47.626166+0000","last_unstale":"2023-06-09T04:36:57.516431+0000","last_undegraded":"2023-06-09T04:36:57.516431+0000","last_fullsized":"2023-06-09T04:36:57.516431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:57.290510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516988+0000","last_change":"2023-06-09T04:36:47.627673+0000","last_active":"2023-06-09T04:36:57.516988+0000","last_peered":"2023-06-09T04:36:57.516988+0000","last_clean":"2023-06-09T04:36:57.516988+0000","last_became_active":"2023-06-09T04:36:47.626658+0000","last_became_peered":"2023-06-09T04:36:47.626658+0000","last_unstale":"2023-06-09T04:36:57.516988+0000","last_undegraded":"2023-06-09T04:36:57.516988+0000","last_fullsized":"2023-06-09T04:36:57.516988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:59.243942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500010+0000","last_change":"2023-06-09T04:36:52.690886+0000","last_active":"2023-06-09T04:36:57.500010+0000","last_peered":"2023-06-09T04:36:57.500010+0000","last_clean":"2023-06-09T04:36:57.500010+0000","last_became_active":"2023-06-09T04:36:52.690597+0000","last_became_peered":"2023-06-09T04:36:52.690597+0000","last_unstale":"2023-06-09T04:36:57.500010+0000","last_undegraded":"2023-06-09T04:36:57.500010+0000","last_fullsized":"2023-06-09T04:36:57.500010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500874+0000","last_change":"2023-06-09T04:36:53.090386+0000","last_active":"2023-06-09T04:36:57.500874+0000","last_peered":"2023-06-09T04:36:57.500874+0000","last_clean":"2023-06-09T04:36:57.500874+0000","last_became_active":"2023-06-09T04:36:53.081404+0000","last_became_peered":"2023-06-09T04:36:53.081404+0000","last_unstale":"2023-06-09T04:36:57.500874+0000","last_undegraded":"2023-06-09T04:36:57.500874+0000","last_fullsized":"2023-06-09T04:36:57.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:16.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518008+0000","last_change":"2023-06-09T04:36:57.120772+0000","last_active":"2023-06-09T04:36:57.518008+0000","last_peered":"2023-06-09T04:36:57.518008+0000","last_clean":"2023-06-09T04:36:57.518008+0000","last_became_active":"2023-06-09T04:36:57.120404+0000","last_became_peered":"2023-06-09T04:36:57.120404+0000","last_unstale":"2023-06-09T04:36:57.518008+0000","last_undegraded":"2023-06-09T04:36:57.518008+0000","last_fullsized":"2023-06-09T04:36:57.518008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:11.255903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516279+0000","last_change":"2023-06-09T04:36:47.618577+0000","last_active":"2023-06-09T04:36:57.516279+0000","last_peered":"2023-06-09T04:36:57.516279+0000","last_clean":"2023-06-09T04:36:57.516279+0000","last_became_active":"2023-06-09T04:36:47.618339+0000","last_became_peered":"2023-06-09T04:36:47.618339+0000","last_unstale":"2023-06-09T04:36:57.516279+0000","last_undegraded":"2023-06-09T04:36:57.516279+0000","last_fullsized":"2023-06-09T04:36:57.516279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:36.907071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515932+0000","last_change":"2023-06-09T04:36:52.696188+0000","last_active":"2023-06-09T04:36:57.515932+0000","last_peered":"2023-06-09T04:36:57.515932+0000","last_clean":"2023-06-09T04:36:57.515932+0000","last_became_active":"2023-06-09T04:36:52.695918+0000","last_became_peered":"2023-06-09T04:36:52.695918+0000","last_unstale":"2023-06-09T04:36:57.515932+0000","last_undegraded":"2023-06-09T04:36:57.515932+0000","last_fullsized":"2023-06-09T04:36:57.515932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:17:09.723017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517602+0000","last_change":"2023-06-09T04:36:53.096297+0000","last_active":"2023-06-09T04:36:57.517602+0000","last_peered":"2023-06-09T04:36:57.517602+0000","last_clean":"2023-06-09T04:36:57.517602+0000","last_became_active":"2023-06-09T04:36:53.096047+0000","last_became_peered":"2023-06-09T04:36:53.096047+0000","last_unstale":"2023-06-09T04:36:57.517602+0000","last_undegraded":"2023-06-09T04:36:57.517602+0000","last_fullsized":"2023-06-09T04:36:57.517602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:58.427626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516635+0000","last_change":"2023-06-09T04:36:57.120908+0000","last_active":"2023-06-09T04:36:57.516635+0000","last_peered":"2023-06-09T04:36:57.516635+0000","last_clean":"2023-06-09T04:36:57.516635+0000","last_became_active":"2023-06-09T04:36:57.120245+0000","last_became_peered":"2023-06-09T04:36:57.120245+0000","last_unstale":"2023-06-09T04:36:57.516635+0000","last_undegraded":"2023-06-09T04:36:57.516635+0000","last_fullsized":"2023-06-09T04:36:57.516635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:45.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516785+0000","last_change":"2023-06-09T04:36:47.618679+0000","last_active":"2023-06-09T04:36:57.516785+0000","last_peered":"2023-06-09T04:36:57.516785+0000","last_clean":"2023-06-09T04:36:57.516785+0000","last_became_active":"2023-06-09T04:36:47.618391+0000","last_became_peered":"2023-06-09T04:36:47.618391+0000","last_unstale":"2023-06-09T04:36:57.516785+0000","last_undegraded":"2023-06-09T04:36:57.516785+0000","last_fullsized":"2023-06-09T04:36:57.516785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:10.798839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517186+0000","last_change":"2023-06-09T04:36:52.687289+0000","last_active":"2023-06-09T04:36:57.517186+0000","last_peered":"2023-06-09T04:36:57.517186+0000","last_clean":"2023-06-09T04:36:57.517186+0000","last_became_active":"2023-06-09T04:36:52.686981+0000","last_became_peered":"2023-06-09T04:36:52.686981+0000","last_unstale":"2023-06-09T04:36:57.517186+0000","last_undegraded":"2023-06-09T04:36:57.517186+0000","last_fullsized":"2023-06-09T04:36:57.517186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:34.246906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516182+0000","last_change":"2023-06-09T04:36:53.090839+0000","last_active":"2023-06-09T04:36:57.516182+0000","last_peered":"2023-06-09T04:36:57.516182+0000","last_clean":"2023-06-09T04:36:57.516182+0000","last_became_active":"2023-06-09T04:36:53.090549+0000","last_became_peered":"2023-06-09T04:36:53.090549+0000","last_unstale":"2023-06-09T04:36:57.516182+0000","last_undegraded":"2023-06-09T04:36:57.516182+0000","last_fullsized":"2023-06-09T04:36:57.516182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:34.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500518+0000","last_change":"2023-06-09T04:36:57.115365+0000","last_active":"2023-06-09T04:36:57.500518+0000","last_peered":"2023-06-09T04:36:57.500518+0000","last_clean":"2023-06-09T04:36:57.500518+0000","last_became_active":"2023-06-09T04:36:57.114167+0000","last_became_peered":"2023-06-09T04:36:57.114167+0000","last_unstale":"2023-06-09T04:36:57.500518+0000","last_undegraded":"2023-06-09T04:36:57.500518+0000","last_fullsized":"2023-06-09T04:36:57.500518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:52.854459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500766+0000","last_change":"2023-06-09T04:36:47.616483+0000","last_active":"2023-06-09T04:36:57.500766+0000","last_peered":"2023-06-09T04:36:57.500766+0000","last_clean":"2023-06-09T04:36:57.500766+0000","last_became_active":"2023-06-09T04:36:47.616149+0000","last_became_peered":"2023-06-09T04:36:47.616149+0000","last_unstale":"2023-06-09T04:36:57.500766+0000","last_undegraded":"2023-06-09T04:36:57.500766+0000","last_fullsized":"2023-06-09T04:36:57.500766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:05.520144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502042+0000","last_change":"2023-06-09T04:36:52.692599+0000","last_active":"2023-06-09T04:36:57.502042+0000","last_peered":"2023-06-09T04:36:57.502042+0000","last_clean":"2023-06-09T04:36:57.502042+0000","last_became_active":"2023-06-09T04:36:52.692296+0000","last_became_peered":"2023-06-09T04:36:52.692296+0000","last_unstale":"2023-06-09T04:36:57.502042+0000","last_undegraded":"2023-06-09T04:36:57.502042+0000","last_fullsized":"2023-06-09T04:36:57.502042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:21:23.110649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516068+0000","last_change":"2023-06-09T04:36:53.086306+0000","last_active":"2023-06-09T04:36:57.516068+0000","last_peered":"2023-06-09T04:36:57.516068+0000","last_clean":"2023-06-09T04:36:57.516068+0000","last_became_active":"2023-06-09T04:36:53.081070+0000","last_became_peered":"2023-06-09T04:36:53.081070+0000","last_unstale":"2023-06-09T04:36:57.516068+0000","last_undegraded":"2023-06-09T04:36:57.516068+0000","last_fullsized":"2023-06-09T04:36:57.516068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:34.737443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516958+0000","last_change":"2023-06-09T04:36:57.116547+0000","last_active":"2023-06-09T04:36:57.516958+0000","last_peered":"2023-06-09T04:36:57.516958+0000","last_clean":"2023-06-09T04:36:57.516958+0000","last_became_active":"2023-06-09T04:36:57.116187+0000","last_became_peered":"2023-06-09T04:36:57.116187+0000","last_unstale":"2023-06-09T04:36:57.516958+0000","last_undegraded":"2023-06-09T04:36:57.516958+0000","last_fullsized":"2023-06-09T04:36:57.516958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:45:19.560682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517169+0000","last_change":"2023-06-09T04:36:47.616467+0000","last_active":"2023-06-09T04:36:57.517169+0000","last_peered":"2023-06-09T04:36:57.517169+0000","last_clean":"2023-06-09T04:36:57.517169+0000","last_became_active":"2023-06-09T04:36:47.616166+0000","last_became_peered":"2023-06-09T04:36:47.616166+0000","last_unstale":"2023-06-09T04:36:57.517169+0000","last_undegraded":"2023-06-09T04:36:57.517169+0000","last_fullsized":"2023-06-09T04:36:57.517169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:07:04.193240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516221+0000","last_change":"2023-06-09T04:36:52.695847+0000","last_active":"2023-06-09T04:36:57.516221+0000","last_peered":"2023-06-09T04:36:57.516221+0000","last_clean":"2023-06-09T04:36:57.516221+0000","last_became_active":"2023-06-09T04:36:52.695537+0000","last_became_peered":"2023-06-09T04:36:52.695537+0000","last_unstale":"2023-06-09T04:36:57.516221+0000","last_undegraded":"2023-06-09T04:36:57.516221+0000","last_fullsized":"2023-06-09T04:36:57.516221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:29:03.665158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500418+0000","last_change":"2023-06-09T04:36:53.092478+0000","last_active":"2023-06-09T04:36:57.500418+0000","last_peered":"2023-06-09T04:36:57.500418+0000","last_clean":"2023-06-09T04:36:57.500418+0000","last_became_active":"2023-06-09T04:36:53.092205+0000","last_became_peered":"2023-06-09T04:36:53.092205+0000","last_unstale":"2023-06-09T04:36:57.500418+0000","last_undegraded":"2023-06-09T04:36:57.500418+0000","last_fullsized":"2023-06-09T04:36:57.500418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:41.939536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500219+0000","last_change":"2023-06-09T04:36:57.117220+0000","last_active":"2023-06-09T04:36:57.500219+0000","last_peered":"2023-06-09T04:36:57.500219+0000","last_clean":"2023-06-09T04:36:57.500219+0000","last_became_active":"2023-06-09T04:36:57.116782+0000","last_became_peered":"2023-06-09T04:36:57.116782+0000","last_unstale":"2023-06-09T04:36:57.500219+0000","last_undegraded":"2023-06-09T04:36:57.500219+0000","last_fullsized":"2023-06-09T04:36:57.500219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:28.882830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517307+0000","last_change":"2023-06-09T04:36:47.613658+0000","last_active":"2023-06-09T04:36:57.517307+0000","last_peered":"2023-06-09T04:36:57.517307+0000","last_clean":"2023-06-09T04:36:57.517307+0000","last_became_active":"2023-06-09T04:36:47.613327+0000","last_became_peered":"2023-06-09T04:36:47.613327+0000","last_unstale":"2023-06-09T04:36:57.517307+0000","last_undegraded":"2023-06-09T04:36:57.517307+0000","last_fullsized":"2023-06-09T04:36:57.517307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:03.397674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500912+0000","last_change":"2023-06-09T04:36:52.688906+0000","last_active":"2023-06-09T04:36:57.500912+0000","last_peered":"2023-06-09T04:36:57.500912+0000","last_clean":"2023-06-09T04:36:57.500912+0000","last_became_active":"2023-06-09T04:36:52.688407+0000","last_became_peered":"2023-06-09T04:36:52.688407+0000","last_unstale":"2023-06-09T04:36:57.500912+0000","last_undegraded":"2023-06-09T04:36:57.500912+0000","last_fullsized":"2023-06-09T04:36:57.500912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515917+0000","last_change":"2023-06-09T04:36:53.088941+0000","last_active":"2023-06-09T04:36:57.515917+0000","last_peered":"2023-06-09T04:36:57.515917+0000","last_clean":"2023-06-09T04:36:57.515917+0000","last_became_active":"2023-06-09T04:36:53.088714+0000","last_became_peered":"2023-06-09T04:36:53.088714+0000","last_unstale":"2023-06-09T04:36:57.515917+0000","last_undegraded":"2023-06-09T04:36:57.515917+0000","last_fullsized":"2023-06-09T04:36:57.515917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:45:51.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517126+0000","last_change":"2023-06-09T04:36:57.107346+0000","last_active":"2023-06-09T04:36:57.517126+0000","last_peered":"2023-06-09T04:36:57.517126+0000","last_clean":"2023-06-09T04:36:57.517126+0000","last_became_active":"2023-06-09T04:36:57.106951+0000","last_became_peered":"2023-06-09T04:36:57.106951+0000","last_unstale":"2023-06-09T04:36:57.517126+0000","last_undegraded":"2023-06-09T04:36:57.517126+0000","last_fullsized":"2023-06-09T04:36:57.517126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:19:15.561278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500285+0000","last_change":"2023-06-09T04:36:52.690142+0000","last_active":"2023-06-09T04:36:57.500285+0000","last_peered":"2023-06-09T04:36:57.500285+0000","last_clean":"2023-06-09T04:36:57.500285+0000","last_became_active":"2023-06-09T04:36:52.689899+0000","last_became_peered":"2023-06-09T04:36:52.689899+0000","last_unstale":"2023-06-09T04:36:57.500285+0000","last_undegraded":"2023-06-09T04:36:57.500285+0000","last_fullsized":"2023-06-09T04:36:57.500285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:52.648622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516780+0000","last_change":"2023-06-09T04:36:53.090134+0000","last_active":"2023-06-09T04:36:57.516780+0000","last_peered":"2023-06-09T04:36:57.516780+0000","last_clean":"2023-06-09T04:36:57.516780+0000","last_became_active":"2023-06-09T04:36:53.089876+0000","last_became_peered":"2023-06-09T04:36:53.089876+0000","last_unstale":"2023-06-09T04:36:57.516780+0000","last_undegraded":"2023-06-09T04:36:57.516780+0000","last_fullsized":"2023-06-09T04:36:57.516780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:34.780805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516202+0000","last_change":"2023-06-09T04:36:57.119574+0000","last_active":"2023-06-09T04:36:57.516202+0000","last_peered":"2023-06-09T04:36:57.516202+0000","last_clean":"2023-06-09T04:36:57.516202+0000","last_became_active":"2023-06-09T04:36:57.119150+0000","last_became_peered":"2023-06-09T04:36:57.119150+0000","last_unstale":"2023-06-09T04:36:57.516202+0000","last_undegraded":"2023-06-09T04:36:57.516202+0000","last_fullsized":"2023-06-09T04:36:57.516202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500755+0000","last_change":"2023-06-09T04:36:52.690645+0000","last_active":"2023-06-09T04:36:57.500755+0000","last_peered":"2023-06-09T04:36:57.500755+0000","last_clean":"2023-06-09T04:36:57.500755+0000","last_became_active":"2023-06-09T04:36:52.690308+0000","last_became_peered":"2023-06-09T04:36:52.690308+0000","last_unstale":"2023-06-09T04:36:57.500755+0000","last_undegraded":"2023-06-09T04:36:57.500755+0000","last_fullsized":"2023-06-09T04:36:57.500755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:40.932066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502199+0000","last_change":"2023-06-09T04:36:53.081068+0000","last_active":"2023-06-09T04:36:57.502199+0000","last_peered":"2023-06-09T04:36:57.502199+0000","last_clean":"2023-06-09T04:36:57.502199+0000","last_became_active":"2023-06-09T04:36:53.080667+0000","last_became_peered":"2023-06-09T04:36:53.080667+0000","last_unstale":"2023-06-09T04:36:57.502199+0000","last_undegraded":"2023-06-09T04:36:57.502199+0000","last_fullsized":"2023-06-09T04:36:57.502199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:43.978989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501298+0000","last_change":"2023-06-09T04:36:57.122830+0000","last_active":"2023-06-09T04:36:57.501298+0000","last_peered":"2023-06-09T04:36:57.501298+0000","last_clean":"2023-06-09T04:36:57.501298+0000","last_became_active":"2023-06-09T04:36:57.122375+0000","last_became_peered":"2023-06-09T04:36:57.122375+0000","last_unstale":"2023-06-09T04:36:57.501298+0000","last_undegraded":"2023-06-09T04:36:57.501298+0000","last_fullsized":"2023-06-09T04:36:57.501298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501357+0000","last_change":"2023-06-09T04:36:52.690672+0000","last_active":"2023-06-09T04:36:57.501357+0000","last_peered":"2023-06-09T04:36:57.501357+0000","last_clean":"2023-06-09T04:36:57.501357+0000","last_became_active":"2023-06-09T04:36:52.690387+0000","last_became_peered":"2023-06-09T04:36:52.690387+0000","last_unstale":"2023-06-09T04:36:57.501357+0000","last_undegraded":"2023-06-09T04:36:57.501357+0000","last_fullsized":"2023-06-09T04:36:57.501357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501440+0000","last_change":"2023-06-09T04:36:53.087522+0000","last_active":"2023-06-09T04:36:57.501440+0000","last_peered":"2023-06-09T04:36:57.501440+0000","last_clean":"2023-06-09T04:36:57.501440+0000","last_became_active":"2023-06-09T04:36:53.087137+0000","last_became_peered":"2023-06-09T04:36:53.087137+0000","last_unstale":"2023-06-09T04:36:57.501440+0000","last_undegraded":"2023-06-09T04:36:57.501440+0000","last_fullsized":"2023-06-09T04:36:57.501440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:19:08.704227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501282+0000","last_change":"2023-06-09T04:36:57.122912+0000","last_active":"2023-06-09T04:36:57.501282+0000","last_peered":"2023-06-09T04:36:57.501282+0000","last_clean":"2023-06-09T04:36:57.501282+0000","last_became_active":"2023-06-09T04:36:57.122522+0000","last_became_peered":"2023-06-09T04:36:57.122522+0000","last_unstale":"2023-06-09T04:36:57.501282+0000","last_undegraded":"2023-06-09T04:36:57.501282+0000","last_fullsized":"2023-06-09T04:36:57.501282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:55.270027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517342+0000","last_change":"2023-06-09T04:36:52.692799+0000","last_active":"2023-06-09T04:36:57.517342+0000","last_peered":"2023-06-09T04:36:57.517342+0000","last_clean":"2023-06-09T04:36:57.517342+0000","last_became_active":"2023-06-09T04:36:52.692553+0000","last_became_peered":"2023-06-09T04:36:52.692553+0000","last_unstale":"2023-06-09T04:36:57.517342+0000","last_undegraded":"2023-06-09T04:36:57.517342+0000","last_fullsized":"2023-06-09T04:36:57.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:52.314087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516677+0000","last_change":"2023-06-09T04:36:53.080161+0000","last_active":"2023-06-09T04:36:57.516677+0000","last_peered":"2023-06-09T04:36:57.516677+0000","last_clean":"2023-06-09T04:36:57.516677+0000","last_became_active":"2023-06-09T04:36:53.079901+0000","last_became_peered":"2023-06-09T04:36:53.079901+0000","last_unstale":"2023-06-09T04:36:57.516677+0000","last_undegraded":"2023-06-09T04:36:57.516677+0000","last_fullsized":"2023-06-09T04:36:57.516677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:39:27.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516214+0000","last_change":"2023-06-09T04:36:57.115160+0000","last_active":"2023-06-09T04:36:57.516214+0000","last_peered":"2023-06-09T04:36:57.516214+0000","last_clean":"2023-06-09T04:36:57.516214+0000","last_became_active":"2023-06-09T04:36:57.114742+0000","last_became_peered":"2023-06-09T04:36:57.114742+0000","last_unstale":"2023-06-09T04:36:57.516214+0000","last_undegraded":"2023-06-09T04:36:57.516214+0000","last_fullsized":"2023-06-09T04:36:57.516214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:40:15.379010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500994+0000","last_change":"2023-06-09T04:36:52.680891+0000","last_active":"2023-06-09T04:36:57.500994+0000","last_peered":"2023-06-09T04:36:57.500994+0000","last_clean":"2023-06-09T04:36:57.500994+0000","last_became_active":"2023-06-09T04:36:52.680385+0000","last_became_peered":"2023-06-09T04:36:52.680385+0000","last_unstale":"2023-06-09T04:36:57.500994+0000","last_undegraded":"2023-06-09T04:36:57.500994+0000","last_fullsized":"2023-06-09T04:36:57.500994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502005+0000","last_change":"2023-06-09T04:36:53.096473+0000","last_active":"2023-06-09T04:36:57.502005+0000","last_peered":"2023-06-09T04:36:57.502005+0000","last_clean":"2023-06-09T04:36:57.502005+0000","last_became_active":"2023-06-09T04:36:53.096189+0000","last_became_peered":"2023-06-09T04:36:53.096189+0000","last_unstale":"2023-06-09T04:36:57.502005+0000","last_undegraded":"2023-06-09T04:36:57.502005+0000","last_fullsized":"2023-06-09T04:36:57.502005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:34:20.659382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515964+0000","last_change":"2023-06-09T04:36:53.097902+0000","last_active":"2023-06-09T04:36:57.515964+0000","last_peered":"2023-06-09T04:36:57.515964+0000","last_clean":"2023-06-09T04:36:57.515964+0000","last_became_active":"2023-06-09T04:36:53.097382+0000","last_became_peered":"2023-06-09T04:36:53.097382+0000","last_unstale":"2023-06-09T04:36:57.515964+0000","last_undegraded":"2023-06-09T04:36:57.515964+0000","last_fullsized":"2023-06-09T04:36:57.515964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:43.428603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517665+0000","last_change":"2023-06-09T04:36:53.082845+0000","last_active":"2023-06-09T04:36:57.517665+0000","last_peered":"2023-06-09T04:36:57.517665+0000","last_clean":"2023-06-09T04:36:57.517665+0000","last_became_active":"2023-06-09T04:36:53.082622+0000","last_became_peered":"2023-06-09T04:36:53.082622+0000","last_unstale":"2023-06-09T04:36:57.517665+0000","last_undegraded":"2023-06-09T04:36:57.517665+0000","last_fullsized":"2023-06-09T04:36:57.517665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:11:34.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502339+0000","last_change":"2023-06-09T04:36:53.094170+0000","last_active":"2023-06-09T04:36:57.502339+0000","last_peered":"2023-06-09T04:36:57.502339+0000","last_clean":"2023-06-09T04:36:57.502339+0000","last_became_active":"2023-06-09T04:36:53.093889+0000","last_became_peered":"2023-06-09T04:36:53.093889+0000","last_unstale":"2023-06-09T04:36:57.502339+0000","last_undegraded":"2023-06-09T04:36:57.502339+0000","last_fullsized":"2023-06-09T04:36:57.502339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:24.623854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517280+0000","last_change":"2023-06-09T04:36:53.090661+0000","last_active":"2023-06-09T04:36:57.517280+0000","last_peered":"2023-06-09T04:36:57.517280+0000","last_clean":"2023-06-09T04:36:57.517280+0000","last_became_active":"2023-06-09T04:36:53.090014+0000","last_became_peered":"2023-06-09T04:36:53.090014+0000","last_unstale":"2023-06-09T04:36:57.517280+0000","last_undegraded":"2023-06-09T04:36:57.517280+0000","last_fullsized":"2023-06-09T04:36:57.517280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:08.675015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516377+0000","last_change":"2023-06-09T04:36:53.087442+0000","last_active":"2023-06-09T04:36:57.516377+0000","last_peered":"2023-06-09T04:36:57.516377+0000","last_clean":"2023-06-09T04:36:57.516377+0000","last_became_active":"2023-06-09T04:36:53.086525+0000","last_became_peered":"2023-06-09T04:36:53.086525+0000","last_unstale":"2023-06-09T04:36:57.516377+0000","last_undegraded":"2023-06-09T04:36:57.516377+0000","last_fullsized":"2023-06-09T04:36:57.516377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:30:03.858670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":110193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":115204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":705732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":112006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":701722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":111354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:37:16.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:37:16.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.764+0000 7fd263add700 1 Processor -- start 2023-06-09T04:37:16.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd263add700 1 -- start start 2023-06-09T04:37:16.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd263add700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd25c0afa30 0x7fd25c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd263add700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd25c0b0c40 0x7fd25c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd263add700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0cf140 0x7fd25c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd263add700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0b06f0 con 0x7fd25c0b0c40 2023-06-09T04:37:16.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd263add700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c0b01a0 con 0x7fd25c0afa30 2023-06-09T04:37:16.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd263add700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0b0900 con 0x7fd25c0cf140 2023-06-09T04:37:16.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.765+0000 7fd261078700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd25c0b0c40 0x7fd25c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd25c0b0c40 0x7fd25c0cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36422/0 (socket says 172.21.15.149:36422) 2023-06-09T04:37:16.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 -- 172.21.15.149:0/1942956971 learned_addr learned my addr 172.21.15.149:0/1942956971 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:16.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261879700 1 --2- 172.21.15.149:0/1942956971 >> v2:172.21.15.184:3300/0 conn(0x7fd25c0afa30 0x7fd25c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd26207a700 1 --2- 172.21.15.149:0/1942956971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0cf140 0x7fd25c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 -- 172.21.15.149:0/1942956971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0cf140 msgr2=0x7fd25c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:16.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 --2- 172.21.15.149:0/1942956971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0cf140 0x7fd25c0cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 -- 172.21.15.149:0/1942956971 >> v2:172.21.15.184:3300/0 conn(0x7fd25c0afa30 msgr2=0x7fd25c0b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:16.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 --2- 172.21.15.149:0/1942956971 >> v2:172.21.15.184:3300/0 conn(0x7fd25c0afa30 0x7fd25c0b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 -- 172.21.15.149:0/1942956971 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c0ca7a0 con 0x7fd25c0b0c40 2023-06-09T04:37:16.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd26207a700 1 --2- 172.21.15.149:0/1942956971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0cf140 0x7fd25c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:16.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd261078700 1 --2- 172.21.15.149:0/1942956971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0b0c40 0x7fd25c0cd270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd25c071060 tx=0x7fd258009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89a25357d9c90a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd260877700 1 -- 172.21.15.149:0/1942956971 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800b870 con 0x7fd25c0b0c40 2023-06-09T04:37:16.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd260877700 1 -- 172.21.15.149:0/1942956971 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800b9d0 con 0x7fd25c0b0c40 2023-06-09T04:37:16.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.766+0000 7fd260877700 1 -- 172.21.15.149:0/1942956971 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800bd60 con 0x7fd25c0b0c40 2023-06-09T04:37:16.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 -- 172.21.15.149:0/1942956971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0b0c40 msgr2=0x7fd25c0cd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 --2- 172.21.15.149:0/1942956971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0b0c40 0x7fd25c0cd270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd25c071060 tx=0x7fd258009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 -- 172.21.15.149:0/1942956971 shutdown_connections 2023-06-09T04:37:16.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 --2- 172.21.15.149:0/1942956971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0cf140 0x7fd25c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 --2- 172.21.15.149:0/1942956971 >> v2:172.21.15.184:3300/0 conn(0x7fd25c0afa30 0x7fd25c0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 --2- 172.21.15.149:0/1942956971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0b0c40 0x7fd25c0cd270 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 -- 172.21.15.149:0/1942956971 >> 172.21.15.149:0/1942956971 conn(0x7fd25c06b7e0 msgr2=0x7fd25c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:16.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 -- 172.21.15.149:0/1942956971 shutdown_connections 2023-06-09T04:37:16.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.767+0000 7fd263add700 1 -- 172.21.15.149:0/1942956971 wait complete. 2023-06-09T04:37:16.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.768+0000 7fd263add700 1 Processor -- start 2023-06-09T04:37:16.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.768+0000 7fd263add700 1 -- start start 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd263add700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd25c0afa30 0x7fd25c0b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd263add700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0b0c40 0x7fd25c0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd263add700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0cf140 0x7fd25c1f38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd263add700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c1f3130 con 0x7fd25c0cf140 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd263add700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0b4c00 con 0x7fd25c0afa30 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd263add700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c0b4e50 con 0x7fd25c0b0c40 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd26207a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0cf140 0x7fd25c1f38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd26207a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0cf140 0x7fd25c1f38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36430/0 (socket says 172.21.15.149:36430) 2023-06-09T04:37:16.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.769+0000 7fd26207a700 1 -- 172.21.15.149:0/3805088241 learned_addr learned my addr 172.21.15.149:0/3805088241 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:16.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd261879700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd25c0afa30 0x7fd25c0b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd261078700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0b0c40 0x7fd25c0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd26207a700 1 -- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0b0c40 msgr2=0x7fd25c0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd26207a700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0b0c40 0x7fd25c0b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd26207a700 1 -- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd25c0afa30 msgr2=0x7fd25c0b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd26207a700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd25c0afa30 0x7fd25c0b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd26207a700 1 -- 172.21.15.149:0/3805088241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258009550 con 0x7fd25c0cf140 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd26207a700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0cf140 0x7fd25c1f38a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd25400cef0 tx=0x7fd25400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd24e7fc700 1 -- 172.21.15.149:0/3805088241 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400ae50 con 0x7fd25c0cf140 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd24e7fc700 1 -- 172.21.15.149:0/3805088241 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254015440 con 0x7fd25c0cf140 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd24e7fc700 1 -- 172.21.15.149:0/3805088241 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540157f0 con 0x7fd25c0cf140 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c0b5130 con 0x7fd25c0cf140 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.770+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c1f3380 con 0x7fd25c0cf140 2023-06-09T04:37:16.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.771+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c1f3570 con 0x7fd25c0cf140 2023-06-09T04:37:16.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.771+0000 7fd24e7fc700 1 -- 172.21.15.149:0/3805088241 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd25400d430 con 0x7fd25c0cf140 2023-06-09T04:37:16.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.772+0000 7fd24e7fc700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd24006ace0 0x7fd24006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:16.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.772+0000 7fd261879700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd24006ace0 0x7fd24006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:16.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.772+0000 7fd24e7fc700 1 -- 172.21.15.149:0/3805088241 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd254089d40 con 0x7fd25c0cf140 2023-06-09T04:37:16.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.772+0000 7fd261879700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd24006ace0 0x7fd24006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd250006fd0 tx=0x7fd250008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:16.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.776+0000 7fd24e7fc700 1 -- 172.21.15.149:0/3805088241 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd254054b90 con 0x7fd25c0cf140 2023-06-09T04:37:16.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.960+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 --> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd25c0b0460 con 0x7fd24006ace0 2023-06-09T04:37:16.970 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.970+0000 7fd24e7fc700 1 -- 172.21.15.149:0/3805088241 <== mgr.4101 v2:172.21.15.149:6832/2920572545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367576 (secure 0 0 0) 0x7fd25000b620 con 0x7fd24006ace0 2023-06-09T04:37:16.974 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:16.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd24006ace0 msgr2=0x7fd24006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd24006ace0 0x7fd24006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd250006fd0 tx=0x7fd250008040 comp rx=0 tx=0).stop 2023-06-09T04:37:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0cf140 msgr2=0x7fd25c1f38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0cf140 0x7fd25c1f38a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd25400cef0 tx=0x7fd25400a340 comp rx=0 tx=0).stop 2023-06-09T04:37:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 shutdown_connections 2023-06-09T04:37:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd24006ace0 0x7fd24006d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd25c0cf140 0x7fd25c1f38a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.973+0000 7fd263add700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd25c0afa30 0x7fd25c0b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.974+0000 7fd263add700 1 --2- 172.21.15.149:0/3805088241 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd25c0b0c40 0x7fd25c0b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.974+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 >> 172.21.15.149:0/3805088241 conn(0x7fd25c06b7e0 msgr2=0x7fd25c0c9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.974+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 shutdown_connections 2023-06-09T04:37:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:16.974+0000 7fd263add700 1 -- 172.21.15.149:0/3805088241 wait complete. 2023-06-09T04:37:16.977 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-06-09T04:37:16.986 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-06-09T04:37:16.396479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218948,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":3411968,"data_stored":2079591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003126"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518193+0000","last_change":"2023-06-09T04:36:53.082985+0000","last_active":"2023-06-09T04:36:57.518193+0000","last_peered":"2023-06-09T04:36:57.518193+0000","last_clean":"2023-06-09T04:36:57.518193+0000","last_became_active":"2023-06-09T04:36:53.082762+0000","last_became_peered":"2023-06-09T04:36:53.082762+0000","last_unstale":"2023-06-09T04:36:57.518193+0000","last_undegraded":"2023-06-09T04:36:57.518193+0000","last_fullsized":"2023-06-09T04:36:57.518193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:52.981825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501460+0000","last_change":"2023-06-09T04:36:53.092173+0000","last_active":"2023-06-09T04:36:57.501460+0000","last_peered":"2023-06-09T04:36:57.501460+0000","last_clean":"2023-06-09T04:36:57.501460+0000","last_became_active":"2023-06-09T04:36:53.091883+0000","last_became_peered":"2023-06-09T04:36:53.091883+0000","last_unstale":"2023-06-09T04:36:57.501460+0000","last_undegraded":"2023-06-09T04:36:57.501460+0000","last_fullsized":"2023-06-09T04:36:57.501460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502629+0000","last_change":"2023-06-09T04:36:53.082161+0000","last_active":"2023-06-09T04:36:57.502629+0000","last_peered":"2023-06-09T04:36:57.502629+0000","last_clean":"2023-06-09T04:36:57.502629+0000","last_became_active":"2023-06-09T04:36:53.081730+0000","last_became_peered":"2023-06-09T04:36:53.081730+0000","last_unstale":"2023-06-09T04:36:57.502629+0000","last_undegraded":"2023-06-09T04:36:57.502629+0000","last_fullsized":"2023-06-09T04:36:57.502629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:27:35.361250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516551+0000","last_change":"2023-06-09T04:36:53.091571+0000","last_active":"2023-06-09T04:36:57.516551+0000","last_peered":"2023-06-09T04:36:57.516551+0000","last_clean":"2023-06-09T04:36:57.516551+0000","last_became_active":"2023-06-09T04:36:53.091231+0000","last_became_peered":"2023-06-09T04:36:53.091231+0000","last_unstale":"2023-06-09T04:36:57.516551+0000","last_undegraded":"2023-06-09T04:36:57.516551+0000","last_fullsized":"2023-06-09T04:36:57.516551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:59:04.716639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500415+0000","last_change":"2023-06-09T04:36:53.080466+0000","last_active":"2023-06-09T04:36:57.500415+0000","last_peered":"2023-06-09T04:36:57.500415+0000","last_clean":"2023-06-09T04:36:57.500415+0000","last_became_active":"2023-06-09T04:36:53.080202+0000","last_became_peered":"2023-06-09T04:36:53.080202+0000","last_unstale":"2023-06-09T04:36:57.500415+0000","last_undegraded":"2023-06-09T04:36:57.500415+0000","last_fullsized":"2023-06-09T04:36:57.500415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:46.590852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502000+0000","last_change":"2023-06-09T04:36:53.085316+0000","last_active":"2023-06-09T04:36:57.502000+0000","last_peered":"2023-06-09T04:36:57.502000+0000","last_clean":"2023-06-09T04:36:57.502000+0000","last_became_active":"2023-06-09T04:36:53.085026+0000","last_became_peered":"2023-06-09T04:36:53.085026+0000","last_unstale":"2023-06-09T04:36:57.502000+0000","last_undegraded":"2023-06-09T04:36:57.502000+0000","last_fullsized":"2023-06-09T04:36:57.502000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:31.842402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516514+0000","last_change":"2023-06-09T04:36:53.095876+0000","last_active":"2023-06-09T04:36:57.516514+0000","last_peered":"2023-06-09T04:36:57.516514+0000","last_clean":"2023-06-09T04:36:57.516514+0000","last_became_active":"2023-06-09T04:36:53.095604+0000","last_became_peered":"2023-06-09T04:36:53.095604+0000","last_unstale":"2023-06-09T04:36:57.516514+0000","last_undegraded":"2023-06-09T04:36:57.516514+0000","last_fullsized":"2023-06-09T04:36:57.516514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:00.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500546+0000","last_change":"2023-06-09T04:36:53.089342+0000","last_active":"2023-06-09T04:36:57.500546+0000","last_peered":"2023-06-09T04:36:57.500546+0000","last_clean":"2023-06-09T04:36:57.500546+0000","last_became_active":"2023-06-09T04:36:53.089039+0000","last_became_peered":"2023-06-09T04:36:53.089039+0000","last_unstale":"2023-06-09T04:36:57.500546+0000","last_undegraded":"2023-06-09T04:36:57.500546+0000","last_fullsized":"2023-06-09T04:36:57.500546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:19.525415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500861+0000","last_change":"2023-06-09T04:36:53.087617+0000","last_active":"2023-06-09T04:36:57.500861+0000","last_peered":"2023-06-09T04:36:57.500861+0000","last_clean":"2023-06-09T04:36:57.500861+0000","last_became_active":"2023-06-09T04:36:53.086962+0000","last_became_peered":"2023-06-09T04:36:53.086962+0000","last_unstale":"2023-06-09T04:36:57.500861+0000","last_undegraded":"2023-06-09T04:36:57.500861+0000","last_fullsized":"2023-06-09T04:36:57.500861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502145+0000","last_change":"2023-06-09T04:36:53.086101+0000","last_active":"2023-06-09T04:36:57.502145+0000","last_peered":"2023-06-09T04:36:57.502145+0000","last_clean":"2023-06-09T04:36:57.502145+0000","last_became_active":"2023-06-09T04:36:53.085845+0000","last_became_peered":"2023-06-09T04:36:53.085845+0000","last_unstale":"2023-06-09T04:36:57.502145+0000","last_undegraded":"2023-06-09T04:36:57.502145+0000","last_fullsized":"2023-06-09T04:36:57.502145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502428+0000","last_change":"2023-06-09T04:36:53.081983+0000","last_active":"2023-06-09T04:36:57.502428+0000","last_peered":"2023-06-09T04:36:57.502428+0000","last_clean":"2023-06-09T04:36:57.502428+0000","last_became_active":"2023-06-09T04:36:53.081436+0000","last_became_peered":"2023-06-09T04:36:53.081436+0000","last_unstale":"2023-06-09T04:36:57.502428+0000","last_undegraded":"2023-06-09T04:36:57.502428+0000","last_fullsized":"2023-06-09T04:36:57.502428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:21:57.284108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517008+0000","last_change":"2023-06-09T04:36:53.091581+0000","last_active":"2023-06-09T04:36:57.517008+0000","last_peered":"2023-06-09T04:36:57.517008+0000","last_clean":"2023-06-09T04:36:57.517008+0000","last_became_active":"2023-06-09T04:36:53.091344+0000","last_became_peered":"2023-06-09T04:36:53.091344+0000","last_unstale":"2023-06-09T04:36:57.517008+0000","last_undegraded":"2023-06-09T04:36:57.517008+0000","last_fullsized":"2023-06-09T04:36:57.517008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:58.932374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516760+0000","last_change":"2023-06-09T04:36:53.079790+0000","last_active":"2023-06-09T04:36:57.516760+0000","last_peered":"2023-06-09T04:36:57.516760+0000","last_clean":"2023-06-09T04:36:57.516760+0000","last_became_active":"2023-06-09T04:36:53.079521+0000","last_became_peered":"2023-06-09T04:36:53.079521+0000","last_unstale":"2023-06-09T04:36:57.516760+0000","last_undegraded":"2023-06-09T04:36:57.516760+0000","last_fullsized":"2023-06-09T04:36:57.516760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:42:47.447288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501345+0000","last_change":"2023-06-09T04:36:53.085801+0000","last_active":"2023-06-09T04:36:57.501345+0000","last_peered":"2023-06-09T04:36:57.501345+0000","last_clean":"2023-06-09T04:36:57.501345+0000","last_became_active":"2023-06-09T04:36:53.085510+0000","last_became_peered":"2023-06-09T04:36:53.085510+0000","last_unstale":"2023-06-09T04:36:57.501345+0000","last_undegraded":"2023-06-09T04:36:57.501345+0000","last_fullsized":"2023-06-09T04:36:57.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516281+0000","last_change":"2023-06-09T04:36:53.095858+0000","last_active":"2023-06-09T04:36:57.516281+0000","last_peered":"2023-06-09T04:36:57.516281+0000","last_clean":"2023-06-09T04:36:57.516281+0000","last_became_active":"2023-06-09T04:36:53.095564+0000","last_became_peered":"2023-06-09T04:36:53.095564+0000","last_unstale":"2023-06-09T04:36:57.516281+0000","last_undegraded":"2023-06-09T04:36:57.516281+0000","last_fullsized":"2023-06-09T04:36:57.516281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502192+0000","last_change":"2023-06-09T04:36:53.087327+0000","last_active":"2023-06-09T04:36:57.502192+0000","last_peered":"2023-06-09T04:36:57.502192+0000","last_clean":"2023-06-09T04:36:57.502192+0000","last_became_active":"2023-06-09T04:36:53.087056+0000","last_became_peered":"2023-06-09T04:36:53.087056+0000","last_unstale":"2023-06-09T04:36:57.502192+0000","last_undegraded":"2023-06-09T04:36:57.502192+0000","last_fullsized":"2023-06-09T04:36:57.502192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:14.334505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500728+0000","last_change":"2023-06-09T04:36:53.087787+0000","last_active":"2023-06-09T04:36:57.500728+0000","last_peered":"2023-06-09T04:36:57.500728+0000","last_clean":"2023-06-09T04:36:57.500728+0000","last_became_active":"2023-06-09T04:36:53.087324+0000","last_became_peered":"2023-06-09T04:36:53.087324+0000","last_unstale":"2023-06-09T04:36:57.500728+0000","last_undegraded":"2023-06-09T04:36:57.500728+0000","last_fullsized":"2023-06-09T04:36:57.500728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502659+0000","last_change":"2023-06-09T04:36:53.087244+0000","last_active":"2023-06-09T04:36:57.502659+0000","last_peered":"2023-06-09T04:36:57.502659+0000","last_clean":"2023-06-09T04:36:57.502659+0000","last_became_active":"2023-06-09T04:36:53.086960+0000","last_became_peered":"2023-06-09T04:36:53.086960+0000","last_unstale":"2023-06-09T04:36:57.502659+0000","last_undegraded":"2023-06-09T04:36:57.502659+0000","last_fullsized":"2023-06-09T04:36:57.502659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:55.924392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517576+0000","last_change":"2023-06-09T04:36:53.093961+0000","last_active":"2023-06-09T04:36:57.517576+0000","last_peered":"2023-06-09T04:36:57.517576+0000","last_clean":"2023-06-09T04:36:57.517576+0000","last_became_active":"2023-06-09T04:36:53.093752+0000","last_became_peered":"2023-06-09T04:36:53.093752+0000","last_unstale":"2023-06-09T04:36:57.517576+0000","last_undegraded":"2023-06-09T04:36:57.517576+0000","last_fullsized":"2023-06-09T04:36:57.517576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:45.981753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501974+0000","last_change":"2023-06-09T04:36:53.080631+0000","last_active":"2023-06-09T04:36:57.501974+0000","last_peered":"2023-06-09T04:36:57.501974+0000","last_clean":"2023-06-09T04:36:57.501974+0000","last_became_active":"2023-06-09T04:36:53.080361+0000","last_became_peered":"2023-06-09T04:36:53.080361+0000","last_unstale":"2023-06-09T04:36:57.501974+0000","last_undegraded":"2023-06-09T04:36:57.501974+0000","last_fullsized":"2023-06-09T04:36:57.501974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:18.986311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516459+0000","last_change":"2023-06-09T04:36:53.093919+0000","last_active":"2023-06-09T04:36:57.516459+0000","last_peered":"2023-06-09T04:36:57.516459+0000","last_clean":"2023-06-09T04:36:57.516459+0000","last_became_active":"2023-06-09T04:36:53.093661+0000","last_became_peered":"2023-06-09T04:36:53.093661+0000","last_unstale":"2023-06-09T04:36:57.516459+0000","last_undegraded":"2023-06-09T04:36:57.516459+0000","last_fullsized":"2023-06-09T04:36:57.516459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500031+0000","last_change":"2023-06-09T04:36:53.088748+0000","last_active":"2023-06-09T04:36:57.500031+0000","last_peered":"2023-06-09T04:36:57.500031+0000","last_clean":"2023-06-09T04:36:57.500031+0000","last_became_active":"2023-06-09T04:36:53.088502+0000","last_became_peered":"2023-06-09T04:36:53.088502+0000","last_unstale":"2023-06-09T04:36:57.500031+0000","last_undegraded":"2023-06-09T04:36:57.500031+0000","last_fullsized":"2023-06-09T04:36:57.500031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517058+0000","last_change":"2023-06-09T04:36:53.083847+0000","last_active":"2023-06-09T04:36:57.517058+0000","last_peered":"2023-06-09T04:36:57.517058+0000","last_clean":"2023-06-09T04:36:57.517058+0000","last_became_active":"2023-06-09T04:36:53.083583+0000","last_became_peered":"2023-06-09T04:36:53.083583+0000","last_unstale":"2023-06-09T04:36:57.517058+0000","last_undegraded":"2023-06-09T04:36:57.517058+0000","last_fullsized":"2023-06-09T04:36:57.517058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:03.284187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516893+0000","last_change":"2023-06-09T04:36:53.095654+0000","last_active":"2023-06-09T04:36:57.516893+0000","last_peered":"2023-06-09T04:36:57.516893+0000","last_clean":"2023-06-09T04:36:57.516893+0000","last_became_active":"2023-06-09T04:36:53.095185+0000","last_became_peered":"2023-06-09T04:36:53.095185+0000","last_unstale":"2023-06-09T04:36:57.516893+0000","last_undegraded":"2023-06-09T04:36:57.516893+0000","last_fullsized":"2023-06-09T04:36:57.516893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:55:22.307750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517490+0000","last_change":"2023-06-09T04:36:53.097881+0000","last_active":"2023-06-09T04:36:57.517490+0000","last_peered":"2023-06-09T04:36:57.517490+0000","last_clean":"2023-06-09T04:36:57.517490+0000","last_became_active":"2023-06-09T04:36:53.097547+0000","last_became_peered":"2023-06-09T04:36:53.097547+0000","last_unstale":"2023-06-09T04:36:57.517490+0000","last_undegraded":"2023-06-09T04:36:57.517490+0000","last_fullsized":"2023-06-09T04:36:57.517490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:04.707925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517800+0000","last_change":"2023-06-09T04:36:53.086120+0000","last_active":"2023-06-09T04:36:57.517800+0000","last_peered":"2023-06-09T04:36:57.517800+0000","last_clean":"2023-06-09T04:36:57.517800+0000","last_became_active":"2023-06-09T04:36:53.084767+0000","last_became_peered":"2023-06-09T04:36:53.084767+0000","last_unstale":"2023-06-09T04:36:57.517800+0000","last_undegraded":"2023-06-09T04:36:57.517800+0000","last_fullsized":"2023-06-09T04:36:57.517800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:21.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501176+0000","last_change":"2023-06-09T04:36:53.097702+0000","last_active":"2023-06-09T04:36:57.501176+0000","last_peered":"2023-06-09T04:36:57.501176+0000","last_clean":"2023-06-09T04:36:57.501176+0000","last_became_active":"2023-06-09T04:36:53.097430+0000","last_became_peered":"2023-06-09T04:36:53.097430+0000","last_unstale":"2023-06-09T04:36:57.501176+0000","last_undegraded":"2023-06-09T04:36:57.501176+0000","last_fullsized":"2023-06-09T04:36:57.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:53.656092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502448+0000","last_change":"2023-06-09T04:36:57.111577+0000","last_active":"2023-06-09T04:36:57.502448+0000","last_peered":"2023-06-09T04:36:57.502448+0000","last_clean":"2023-06-09T04:36:57.502448+0000","last_became_active":"2023-06-09T04:36:57.111245+0000","last_became_peered":"2023-06-09T04:36:57.111245+0000","last_unstale":"2023-06-09T04:36:57.502448+0000","last_undegraded":"2023-06-09T04:36:57.502448+0000","last_fullsized":"2023-06-09T04:36:57.502448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:23:59.825454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501854+0000","last_change":"2023-06-09T04:36:52.689588+0000","last_active":"2023-06-09T04:36:57.501854+0000","last_peered":"2023-06-09T04:36:57.501854+0000","last_clean":"2023-06-09T04:36:57.501854+0000","last_became_active":"2023-06-09T04:36:52.689361+0000","last_became_peered":"2023-06-09T04:36:52.689361+0000","last_unstale":"2023-06-09T04:36:57.501854+0000","last_undegraded":"2023-06-09T04:36:57.501854+0000","last_fullsized":"2023-06-09T04:36:57.501854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:58.398325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518173+0000","last_change":"2023-06-09T04:36:53.091208+0000","last_active":"2023-06-09T04:36:57.518173+0000","last_peered":"2023-06-09T04:36:57.518173+0000","last_clean":"2023-06-09T04:36:57.518173+0000","last_became_active":"2023-06-09T04:36:53.090968+0000","last_became_peered":"2023-06-09T04:36:53.090968+0000","last_unstale":"2023-06-09T04:36:57.518173+0000","last_undegraded":"2023-06-09T04:36:57.518173+0000","last_fullsized":"2023-06-09T04:36:57.518173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:13.600595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517253+0000","last_change":"2023-06-09T04:36:57.119505+0000","last_active":"2023-06-09T04:36:57.517253+0000","last_peered":"2023-06-09T04:36:57.517253+0000","last_clean":"2023-06-09T04:36:57.517253+0000","last_became_active":"2023-06-09T04:36:57.119057+0000","last_became_peered":"2023-06-09T04:36:57.119057+0000","last_unstale":"2023-06-09T04:36:57.517253+0000","last_undegraded":"2023-06-09T04:36:57.517253+0000","last_fullsized":"2023-06-09T04:36:57.517253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:49:47.898866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515849+0000","last_change":"2023-06-09T04:36:52.689176+0000","last_active":"2023-06-09T04:36:57.515849+0000","last_peered":"2023-06-09T04:36:57.515849+0000","last_clean":"2023-06-09T04:36:57.515849+0000","last_became_active":"2023-06-09T04:36:52.688832+0000","last_became_peered":"2023-06-09T04:36:52.688832+0000","last_unstale":"2023-06-09T04:36:57.515849+0000","last_undegraded":"2023-06-09T04:36:57.515849+0000","last_fullsized":"2023-06-09T04:36:57.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:30.392902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500719+0000","last_change":"2023-06-09T04:36:53.084730+0000","last_active":"2023-06-09T04:36:57.500719+0000","last_peered":"2023-06-09T04:36:57.500719+0000","last_clean":"2023-06-09T04:36:57.500719+0000","last_became_active":"2023-06-09T04:36:53.084457+0000","last_became_peered":"2023-06-09T04:36:53.084457+0000","last_unstale":"2023-06-09T04:36:57.500719+0000","last_undegraded":"2023-06-09T04:36:57.500719+0000","last_fullsized":"2023-06-09T04:36:57.500719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:46.230118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500777+0000","last_change":"2023-06-09T04:36:57.115570+0000","last_active":"2023-06-09T04:36:57.500777+0000","last_peered":"2023-06-09T04:36:57.500777+0000","last_clean":"2023-06-09T04:36:57.500777+0000","last_became_active":"2023-06-09T04:36:57.115189+0000","last_became_peered":"2023-06-09T04:36:57.115189+0000","last_unstale":"2023-06-09T04:36:57.500777+0000","last_undegraded":"2023-06-09T04:36:57.500777+0000","last_fullsized":"2023-06-09T04:36:57.500777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:03.834311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516808+0000","last_change":"2023-06-09T04:36:52.687655+0000","last_active":"2023-06-09T04:36:57.516808+0000","last_peered":"2023-06-09T04:36:57.516808+0000","last_clean":"2023-06-09T04:36:57.516808+0000","last_became_active":"2023-06-09T04:36:52.687400+0000","last_became_peered":"2023-06-09T04:36:52.687400+0000","last_unstale":"2023-06-09T04:36:57.516808+0000","last_undegraded":"2023-06-09T04:36:57.516808+0000","last_fullsized":"2023-06-09T04:36:57.516808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:27:37.159215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517354+0000","last_change":"2023-06-09T04:36:53.092476+0000","last_active":"2023-06-09T04:36:57.517354+0000","last_peered":"2023-06-09T04:36:57.517354+0000","last_clean":"2023-06-09T04:36:57.517354+0000","last_became_active":"2023-06-09T04:36:53.091216+0000","last_became_peered":"2023-06-09T04:36:53.091216+0000","last_unstale":"2023-06-09T04:36:57.517354+0000","last_undegraded":"2023-06-09T04:36:57.517354+0000","last_fullsized":"2023-06-09T04:36:57.517354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:18:25.432988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515945+0000","last_change":"2023-06-09T04:36:57.117686+0000","last_active":"2023-06-09T04:36:57.515945+0000","last_peered":"2023-06-09T04:36:57.515945+0000","last_clean":"2023-06-09T04:36:57.515945+0000","last_became_active":"2023-06-09T04:36:57.117316+0000","last_became_peered":"2023-06-09T04:36:57.117316+0000","last_unstale":"2023-06-09T04:36:57.515945+0000","last_undegraded":"2023-06-09T04:36:57.515945+0000","last_fullsized":"2023-06-09T04:36:57.515945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:39:59.205133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500858+0000","last_change":"2023-06-09T04:36:52.680452+0000","last_active":"2023-06-09T04:36:57.500858+0000","last_peered":"2023-06-09T04:36:57.500858+0000","last_clean":"2023-06-09T04:36:57.500858+0000","last_became_active":"2023-06-09T04:36:52.680163+0000","last_became_peered":"2023-06-09T04:36:52.680163+0000","last_unstale":"2023-06-09T04:36:57.500858+0000","last_undegraded":"2023-06-09T04:36:57.500858+0000","last_fullsized":"2023-06-09T04:36:57.500858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516765+0000","last_change":"2023-06-09T04:36:53.082234+0000","last_active":"2023-06-09T04:36:57.516765+0000","last_peered":"2023-06-09T04:36:57.516765+0000","last_clean":"2023-06-09T04:36:57.516765+0000","last_became_active":"2023-06-09T04:36:53.081968+0000","last_became_peered":"2023-06-09T04:36:53.081968+0000","last_unstale":"2023-06-09T04:36:57.516765+0000","last_undegraded":"2023-06-09T04:36:57.516765+0000","last_fullsized":"2023-06-09T04:36:57.516765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:56.517310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515939+0000","last_change":"2023-06-09T04:36:57.124201+0000","last_active":"2023-06-09T04:36:57.515939+0000","last_peered":"2023-06-09T04:36:57.515939+0000","last_clean":"2023-06-09T04:36:57.515939+0000","last_became_active":"2023-06-09T04:36:57.123897+0000","last_became_peered":"2023-06-09T04:36:57.123897+0000","last_unstale":"2023-06-09T04:36:57.515939+0000","last_undegraded":"2023-06-09T04:36:57.515939+0000","last_fullsized":"2023-06-09T04:36:57.515939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:57.073264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501691+0000","last_change":"2023-06-09T04:36:52.685020+0000","last_active":"2023-06-09T04:36:57.501691+0000","last_peered":"2023-06-09T04:36:57.501691+0000","last_clean":"2023-06-09T04:36:57.501691+0000","last_became_active":"2023-06-09T04:36:52.684745+0000","last_became_peered":"2023-06-09T04:36:52.684745+0000","last_unstale":"2023-06-09T04:36:57.501691+0000","last_undegraded":"2023-06-09T04:36:57.501691+0000","last_fullsized":"2023-06-09T04:36:57.501691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:59.409669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516410+0000","last_change":"2023-06-09T04:36:53.087590+0000","last_active":"2023-06-09T04:36:57.516410+0000","last_peered":"2023-06-09T04:36:57.516410+0000","last_clean":"2023-06-09T04:36:57.516410+0000","last_became_active":"2023-06-09T04:36:53.087288+0000","last_became_peered":"2023-06-09T04:36:53.087288+0000","last_unstale":"2023-06-09T04:36:57.516410+0000","last_undegraded":"2023-06-09T04:36:57.516410+0000","last_fullsized":"2023-06-09T04:36:57.516410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:08.176626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517477+0000","last_change":"2023-06-09T04:36:57.117163+0000","last_active":"2023-06-09T04:36:57.517477+0000","last_peered":"2023-06-09T04:36:57.517477+0000","last_clean":"2023-06-09T04:36:57.517477+0000","last_became_active":"2023-06-09T04:36:57.116767+0000","last_became_peered":"2023-06-09T04:36:57.116767+0000","last_unstale":"2023-06-09T04:36:57.517477+0000","last_undegraded":"2023-06-09T04:36:57.517477+0000","last_fullsized":"2023-06-09T04:36:57.517477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:19.081920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516877+0000","last_change":"2023-06-09T04:36:52.688067+0000","last_active":"2023-06-09T04:36:57.516877+0000","last_peered":"2023-06-09T04:36:57.516877+0000","last_clean":"2023-06-09T04:36:57.516877+0000","last_became_active":"2023-06-09T04:36:52.687767+0000","last_became_peered":"2023-06-09T04:36:52.687767+0000","last_unstale":"2023-06-09T04:36:57.516877+0000","last_undegraded":"2023-06-09T04:36:57.516877+0000","last_fullsized":"2023-06-09T04:36:57.516877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516575+0000","last_change":"2023-06-09T04:36:53.094793+0000","last_active":"2023-06-09T04:36:57.516575+0000","last_peered":"2023-06-09T04:36:57.516575+0000","last_clean":"2023-06-09T04:36:57.516575+0000","last_became_active":"2023-06-09T04:36:53.094544+0000","last_became_peered":"2023-06-09T04:36:53.094544+0000","last_unstale":"2023-06-09T04:36:57.516575+0000","last_undegraded":"2023-06-09T04:36:57.516575+0000","last_fullsized":"2023-06-09T04:36:57.516575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:23.171635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516588+0000","last_change":"2023-06-09T04:36:57.115780+0000","last_active":"2023-06-09T04:36:57.516588+0000","last_peered":"2023-06-09T04:36:57.516588+0000","last_clean":"2023-06-09T04:36:57.516588+0000","last_became_active":"2023-06-09T04:36:57.115404+0000","last_became_peered":"2023-06-09T04:36:57.115404+0000","last_unstale":"2023-06-09T04:36:57.516588+0000","last_undegraded":"2023-06-09T04:36:57.516588+0000","last_fullsized":"2023-06-09T04:36:57.516588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:51:48.980218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:37:02.349143+0000","last_change":"2023-06-09T04:36:52.692095+0000","last_active":"2023-06-09T04:37:02.349143+0000","last_peered":"2023-06-09T04:37:02.349143+0000","last_clean":"2023-06-09T04:37:02.349143+0000","last_became_active":"2023-06-09T04:36:52.691784+0000","last_became_peered":"2023-06-09T04:36:52.691784+0000","last_unstale":"2023-06-09T04:37:02.349143+0000","last_undegraded":"2023-06-09T04:37:02.349143+0000","last_fullsized":"2023-06-09T04:37:02.349143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:15.356816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502053+0000","last_change":"2023-06-09T04:36:53.090930+0000","last_active":"2023-06-09T04:36:57.502053+0000","last_peered":"2023-06-09T04:36:57.502053+0000","last_clean":"2023-06-09T04:36:57.502053+0000","last_became_active":"2023-06-09T04:36:53.090657+0000","last_became_peered":"2023-06-09T04:36:53.090657+0000","last_unstale":"2023-06-09T04:36:57.502053+0000","last_undegraded":"2023-06-09T04:36:57.502053+0000","last_fullsized":"2023-06-09T04:36:57.502053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:51.015748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501544+0000","last_change":"2023-06-09T04:36:57.117459+0000","last_active":"2023-06-09T04:36:57.501544+0000","last_peered":"2023-06-09T04:36:57.501544+0000","last_clean":"2023-06-09T04:36:57.501544+0000","last_became_active":"2023-06-09T04:36:57.116484+0000","last_became_peered":"2023-06-09T04:36:57.116484+0000","last_unstale":"2023-06-09T04:36:57.501544+0000","last_undegraded":"2023-06-09T04:36:57.501544+0000","last_fullsized":"2023-06-09T04:36:57.501544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:49.647290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516290+0000","last_change":"2023-06-09T04:36:52.695139+0000","last_active":"2023-06-09T04:36:57.516290+0000","last_peered":"2023-06-09T04:36:57.516290+0000","last_clean":"2023-06-09T04:36:57.516290+0000","last_became_active":"2023-06-09T04:36:52.694827+0000","last_became_peered":"2023-06-09T04:36:52.694827+0000","last_unstale":"2023-06-09T04:36:57.516290+0000","last_undegraded":"2023-06-09T04:36:57.516290+0000","last_fullsized":"2023-06-09T04:36:57.516290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517671+0000","last_change":"2023-06-09T04:36:53.095157+0000","last_active":"2023-06-09T04:36:57.517671+0000","last_peered":"2023-06-09T04:36:57.517671+0000","last_clean":"2023-06-09T04:36:57.517671+0000","last_became_active":"2023-06-09T04:36:53.094875+0000","last_became_peered":"2023-06-09T04:36:53.094875+0000","last_unstale":"2023-06-09T04:36:57.517671+0000","last_undegraded":"2023-06-09T04:36:57.517671+0000","last_fullsized":"2023-06-09T04:36:57.517671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.901417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517856+0000","last_change":"2023-06-09T04:36:57.121242+0000","last_active":"2023-06-09T04:36:57.517856+0000","last_peered":"2023-06-09T04:36:57.517856+0000","last_clean":"2023-06-09T04:36:57.517856+0000","last_became_active":"2023-06-09T04:36:57.120828+0000","last_became_peered":"2023-06-09T04:36:57.120828+0000","last_unstale":"2023-06-09T04:36:57.517856+0000","last_undegraded":"2023-06-09T04:36:57.517856+0000","last_fullsized":"2023-06-09T04:36:57.517856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:34.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500201+0000","last_change":"2023-06-09T04:36:52.685837+0000","last_active":"2023-06-09T04:36:57.500201+0000","last_peered":"2023-06-09T04:36:57.500201+0000","last_clean":"2023-06-09T04:36:57.500201+0000","last_became_active":"2023-06-09T04:36:52.685574+0000","last_became_peered":"2023-06-09T04:36:52.685574+0000","last_unstale":"2023-06-09T04:36:57.500201+0000","last_undegraded":"2023-06-09T04:36:57.500201+0000","last_fullsized":"2023-06-09T04:36:57.500201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:30.615879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501059+0000","last_change":"2023-06-09T04:36:53.097686+0000","last_active":"2023-06-09T04:36:57.501059+0000","last_peered":"2023-06-09T04:36:57.501059+0000","last_clean":"2023-06-09T04:36:57.501059+0000","last_became_active":"2023-06-09T04:36:53.097408+0000","last_became_peered":"2023-06-09T04:36:53.097408+0000","last_unstale":"2023-06-09T04:36:57.501059+0000","last_undegraded":"2023-06-09T04:36:57.501059+0000","last_fullsized":"2023-06-09T04:36:57.501059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517413+0000","last_change":"2023-06-09T04:36:57.121670+0000","last_active":"2023-06-09T04:36:57.517413+0000","last_peered":"2023-06-09T04:36:57.517413+0000","last_clean":"2023-06-09T04:36:57.517413+0000","last_became_active":"2023-06-09T04:36:57.121104+0000","last_became_peered":"2023-06-09T04:36:57.121104+0000","last_unstale":"2023-06-09T04:36:57.517413+0000","last_undegraded":"2023-06-09T04:36:57.517413+0000","last_fullsized":"2023-06-09T04:36:57.517413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:16:39.554269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516432+0000","last_change":"2023-06-09T04:36:52.694081+0000","last_active":"2023-06-09T04:36:57.516432+0000","last_peered":"2023-06-09T04:36:57.516432+0000","last_clean":"2023-06-09T04:36:57.516432+0000","last_became_active":"2023-06-09T04:36:52.693752+0000","last_became_peered":"2023-06-09T04:36:52.693752+0000","last_unstale":"2023-06-09T04:36:57.516432+0000","last_undegraded":"2023-06-09T04:36:57.516432+0000","last_fullsized":"2023-06-09T04:36:57.516432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:45.222648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500883+0000","last_change":"2023-06-09T04:36:53.080447+0000","last_active":"2023-06-09T04:36:57.500883+0000","last_peered":"2023-06-09T04:36:57.500883+0000","last_clean":"2023-06-09T04:36:57.500883+0000","last_became_active":"2023-06-09T04:36:53.080171+0000","last_became_peered":"2023-06-09T04:36:53.080171+0000","last_unstale":"2023-06-09T04:36:57.500883+0000","last_undegraded":"2023-06-09T04:36:57.500883+0000","last_fullsized":"2023-06-09T04:36:57.500883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:42.879671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501651+0000","last_change":"2023-06-09T04:36:57.117032+0000","last_active":"2023-06-09T04:36:57.501651+0000","last_peered":"2023-06-09T04:36:57.501651+0000","last_clean":"2023-06-09T04:36:57.501651+0000","last_became_active":"2023-06-09T04:36:57.116612+0000","last_became_peered":"2023-06-09T04:36:57.116612+0000","last_unstale":"2023-06-09T04:36:57.501651+0000","last_undegraded":"2023-06-09T04:36:57.501651+0000","last_fullsized":"2023-06-09T04:36:57.501651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:28.517085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515881+0000","last_change":"2023-06-09T04:36:52.694818+0000","last_active":"2023-06-09T04:36:57.515881+0000","last_peered":"2023-06-09T04:36:57.515881+0000","last_clean":"2023-06-09T04:36:57.515881+0000","last_became_active":"2023-06-09T04:36:52.694511+0000","last_became_peered":"2023-06-09T04:36:52.694511+0000","last_unstale":"2023-06-09T04:36:57.515881+0000","last_undegraded":"2023-06-09T04:36:57.515881+0000","last_fullsized":"2023-06-09T04:36:57.515881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:03:02.382793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517854+0000","last_change":"2023-06-09T04:36:53.093019+0000","last_active":"2023-06-09T04:36:57.517854+0000","last_peered":"2023-06-09T04:36:57.517854+0000","last_clean":"2023-06-09T04:36:57.517854+0000","last_became_active":"2023-06-09T04:36:53.092732+0000","last_became_peered":"2023-06-09T04:36:53.092732+0000","last_unstale":"2023-06-09T04:36:57.517854+0000","last_undegraded":"2023-06-09T04:36:57.517854+0000","last_fullsized":"2023-06-09T04:36:57.517854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:55.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516764+0000","last_change":"2023-06-09T04:36:57.121228+0000","last_active":"2023-06-09T04:36:57.516764+0000","last_peered":"2023-06-09T04:36:57.516764+0000","last_clean":"2023-06-09T04:36:57.516764+0000","last_became_active":"2023-06-09T04:36:57.120064+0000","last_became_peered":"2023-06-09T04:36:57.120064+0000","last_unstale":"2023-06-09T04:36:57.516764+0000","last_undegraded":"2023-06-09T04:36:57.516764+0000","last_fullsized":"2023-06-09T04:36:57.516764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:46.296844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516944+0000","last_change":"2023-06-09T04:36:52.692512+0000","last_active":"2023-06-09T04:36:57.516944+0000","last_peered":"2023-06-09T04:36:57.516944+0000","last_clean":"2023-06-09T04:36:57.516944+0000","last_became_active":"2023-06-09T04:36:52.692141+0000","last_became_peered":"2023-06-09T04:36:52.692141+0000","last_unstale":"2023-06-09T04:36:57.516944+0000","last_undegraded":"2023-06-09T04:36:57.516944+0000","last_fullsized":"2023-06-09T04:36:57.516944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:53:31.420451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500425+0000","last_change":"2023-06-09T04:36:53.091220+0000","last_active":"2023-06-09T04:36:57.500425+0000","last_peered":"2023-06-09T04:36:57.500425+0000","last_clean":"2023-06-09T04:36:57.500425+0000","last_became_active":"2023-06-09T04:36:53.090754+0000","last_became_peered":"2023-06-09T04:36:53.090754+0000","last_unstale":"2023-06-09T04:36:57.500425+0000","last_undegraded":"2023-06-09T04:36:57.500425+0000","last_fullsized":"2023-06-09T04:36:57.500425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:06.194724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516278+0000","last_change":"2023-06-09T04:36:57.113964+0000","last_active":"2023-06-09T04:36:57.516278+0000","last_peered":"2023-06-09T04:36:57.516278+0000","last_clean":"2023-06-09T04:36:57.516278+0000","last_became_active":"2023-06-09T04:36:57.113569+0000","last_became_peered":"2023-06-09T04:36:57.113569+0000","last_unstale":"2023-06-09T04:36:57.516278+0000","last_undegraded":"2023-06-09T04:36:57.516278+0000","last_fullsized":"2023-06-09T04:36:57.516278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:36.118778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516531+0000","last_change":"2023-06-09T04:36:52.692397+0000","last_active":"2023-06-09T04:36:57.516531+0000","last_peered":"2023-06-09T04:36:57.516531+0000","last_clean":"2023-06-09T04:36:57.516531+0000","last_became_active":"2023-06-09T04:36:52.692131+0000","last_became_peered":"2023-06-09T04:36:52.692131+0000","last_unstale":"2023-06-09T04:36:57.516531+0000","last_undegraded":"2023-06-09T04:36:57.516531+0000","last_fullsized":"2023-06-09T04:36:57.516531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:53.328867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501708+0000","last_change":"2023-06-09T04:36:53.091347+0000","last_active":"2023-06-09T04:36:57.501708+0000","last_peered":"2023-06-09T04:36:57.501708+0000","last_clean":"2023-06-09T04:36:57.501708+0000","last_became_active":"2023-06-09T04:36:53.091096+0000","last_became_peered":"2023-06-09T04:36:53.091096+0000","last_unstale":"2023-06-09T04:36:57.501708+0000","last_undegraded":"2023-06-09T04:36:57.501708+0000","last_fullsized":"2023-06-09T04:36:57.501708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:49:02.631814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516638+0000","last_change":"2023-06-09T04:36:57.119015+0000","last_active":"2023-06-09T04:36:57.516638+0000","last_peered":"2023-06-09T04:36:57.516638+0000","last_clean":"2023-06-09T04:36:57.516638+0000","last_became_active":"2023-06-09T04:36:57.118718+0000","last_became_peered":"2023-06-09T04:36:57.118718+0000","last_unstale":"2023-06-09T04:36:57.516638+0000","last_undegraded":"2023-06-09T04:36:57.516638+0000","last_fullsized":"2023-06-09T04:36:57.516638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:37.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516611+0000","last_change":"2023-06-09T04:36:52.687979+0000","last_active":"2023-06-09T04:36:57.516611+0000","last_peered":"2023-06-09T04:36:57.516611+0000","last_clean":"2023-06-09T04:36:57.516611+0000","last_became_active":"2023-06-09T04:36:52.687674+0000","last_became_peered":"2023-06-09T04:36:52.687674+0000","last_unstale":"2023-06-09T04:36:57.516611+0000","last_undegraded":"2023-06-09T04:36:57.516611+0000","last_fullsized":"2023-06-09T04:36:57.516611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515933+0000","last_change":"2023-06-09T04:36:53.092231+0000","last_active":"2023-06-09T04:36:57.515933+0000","last_peered":"2023-06-09T04:36:57.515933+0000","last_clean":"2023-06-09T04:36:57.515933+0000","last_became_active":"2023-06-09T04:36:53.091964+0000","last_became_peered":"2023-06-09T04:36:53.091964+0000","last_unstale":"2023-06-09T04:36:57.515933+0000","last_undegraded":"2023-06-09T04:36:57.515933+0000","last_fullsized":"2023-06-09T04:36:57.515933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:52.833274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516701+0000","last_change":"2023-06-09T04:36:57.112419+0000","last_active":"2023-06-09T04:36:57.516701+0000","last_peered":"2023-06-09T04:36:57.516701+0000","last_clean":"2023-06-09T04:36:57.516701+0000","last_became_active":"2023-06-09T04:36:57.112077+0000","last_became_peered":"2023-06-09T04:36:57.112077+0000","last_unstale":"2023-06-09T04:36:57.516701+0000","last_undegraded":"2023-06-09T04:36:57.516701+0000","last_fullsized":"2023-06-09T04:36:57.516701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:05.009136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501097+0000","last_change":"2023-06-09T04:36:52.688267+0000","last_active":"2023-06-09T04:36:57.501097+0000","last_peered":"2023-06-09T04:36:57.501097+0000","last_clean":"2023-06-09T04:36:57.501097+0000","last_became_active":"2023-06-09T04:36:52.687992+0000","last_became_peered":"2023-06-09T04:36:52.687992+0000","last_unstale":"2023-06-09T04:36:57.501097+0000","last_undegraded":"2023-06-09T04:36:57.501097+0000","last_fullsized":"2023-06-09T04:36:57.501097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:24.458188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500688+0000","last_change":"2023-06-09T04:36:53.090432+0000","last_active":"2023-06-09T04:36:57.500688+0000","last_peered":"2023-06-09T04:36:57.500688+0000","last_clean":"2023-06-09T04:36:57.500688+0000","last_became_active":"2023-06-09T04:36:53.090048+0000","last_became_peered":"2023-06-09T04:36:53.090048+0000","last_unstale":"2023-06-09T04:36:57.500688+0000","last_undegraded":"2023-06-09T04:36:57.500688+0000","last_fullsized":"2023-06-09T04:36:57.500688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516962+0000","last_change":"2023-06-09T04:36:57.119128+0000","last_active":"2023-06-09T04:36:57.516962+0000","last_peered":"2023-06-09T04:36:57.516962+0000","last_clean":"2023-06-09T04:36:57.516962+0000","last_became_active":"2023-06-09T04:36:57.118804+0000","last_became_peered":"2023-06-09T04:36:57.118804+0000","last_unstale":"2023-06-09T04:36:57.516962+0000","last_undegraded":"2023-06-09T04:36:57.516962+0000","last_fullsized":"2023-06-09T04:36:57.516962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:45:01.621362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517322+0000","last_change":"2023-06-09T04:36:52.687200+0000","last_active":"2023-06-09T04:36:57.517322+0000","last_peered":"2023-06-09T04:36:57.517322+0000","last_clean":"2023-06-09T04:36:57.517322+0000","last_became_active":"2023-06-09T04:36:52.686926+0000","last_became_peered":"2023-06-09T04:36:52.686926+0000","last_unstale":"2023-06-09T04:36:57.517322+0000","last_undegraded":"2023-06-09T04:36:57.517322+0000","last_fullsized":"2023-06-09T04:36:57.517322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:55.176458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501823+0000","last_change":"2023-06-09T04:36:53.087793+0000","last_active":"2023-06-09T04:36:57.501823+0000","last_peered":"2023-06-09T04:36:57.501823+0000","last_clean":"2023-06-09T04:36:57.501823+0000","last_became_active":"2023-06-09T04:36:53.087526+0000","last_became_peered":"2023-06-09T04:36:53.087526+0000","last_unstale":"2023-06-09T04:36:57.501823+0000","last_undegraded":"2023-06-09T04:36:57.501823+0000","last_fullsized":"2023-06-09T04:36:57.501823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:08:25.419479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516970+0000","last_change":"2023-06-09T04:36:57.109316+0000","last_active":"2023-06-09T04:36:57.516970+0000","last_peered":"2023-06-09T04:36:57.516970+0000","last_clean":"2023-06-09T04:36:57.516970+0000","last_became_active":"2023-06-09T04:36:57.108933+0000","last_became_peered":"2023-06-09T04:36:57.108933+0000","last_unstale":"2023-06-09T04:36:57.516970+0000","last_undegraded":"2023-06-09T04:36:57.516970+0000","last_fullsized":"2023-06-09T04:36:57.516970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:37:23.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516752+0000","last_change":"2023-06-09T04:36:52.693014+0000","last_active":"2023-06-09T04:36:57.516752+0000","last_peered":"2023-06-09T04:36:57.516752+0000","last_clean":"2023-06-09T04:36:57.516752+0000","last_became_active":"2023-06-09T04:36:52.692786+0000","last_became_peered":"2023-06-09T04:36:52.692786+0000","last_unstale":"2023-06-09T04:36:57.516752+0000","last_undegraded":"2023-06-09T04:36:57.516752+0000","last_fullsized":"2023-06-09T04:36:57.516752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:37.205136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502190+0000","last_change":"2023-06-09T04:36:53.087658+0000","last_active":"2023-06-09T04:36:57.502190+0000","last_peered":"2023-06-09T04:36:57.502190+0000","last_clean":"2023-06-09T04:36:57.502190+0000","last_became_active":"2023-06-09T04:36:53.087414+0000","last_became_peered":"2023-06-09T04:36:53.087414+0000","last_unstale":"2023-06-09T04:36:57.502190+0000","last_undegraded":"2023-06-09T04:36:57.502190+0000","last_fullsized":"2023-06-09T04:36:57.502190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:43.763282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501165+0000","last_change":"2023-06-09T04:36:57.118582+0000","last_active":"2023-06-09T04:36:57.501165+0000","last_peered":"2023-06-09T04:36:57.501165+0000","last_clean":"2023-06-09T04:36:57.501165+0000","last_became_active":"2023-06-09T04:36:57.118128+0000","last_became_peered":"2023-06-09T04:36:57.118128+0000","last_unstale":"2023-06-09T04:36:57.501165+0000","last_undegraded":"2023-06-09T04:36:57.501165+0000","last_fullsized":"2023-06-09T04:36:57.501165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:35.040521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501455+0000","last_change":"2023-06-09T04:36:52.695510+0000","last_active":"2023-06-09T04:36:57.501455+0000","last_peered":"2023-06-09T04:36:57.501455+0000","last_clean":"2023-06-09T04:36:57.501455+0000","last_became_active":"2023-06-09T04:36:52.695256+0000","last_became_peered":"2023-06-09T04:36:52.695256+0000","last_unstale":"2023-06-09T04:36:57.501455+0000","last_undegraded":"2023-06-09T04:36:57.501455+0000","last_fullsized":"2023-06-09T04:36:57.501455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:35.772477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502738+0000","last_change":"2023-06-09T04:36:53.094151+0000","last_active":"2023-06-09T04:36:57.502738+0000","last_peered":"2023-06-09T04:36:57.502738+0000","last_clean":"2023-06-09T04:36:57.502738+0000","last_became_active":"2023-06-09T04:36:53.093875+0000","last_became_peered":"2023-06-09T04:36:53.093875+0000","last_unstale":"2023-06-09T04:36:57.502738+0000","last_undegraded":"2023-06-09T04:36:57.502738+0000","last_fullsized":"2023-06-09T04:36:57.502738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:31.886725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502450+0000","last_change":"2023-06-09T04:36:57.115949+0000","last_active":"2023-06-09T04:36:57.502450+0000","last_peered":"2023-06-09T04:36:57.502450+0000","last_clean":"2023-06-09T04:36:57.502450+0000","last_became_active":"2023-06-09T04:36:57.115534+0000","last_became_peered":"2023-06-09T04:36:57.115534+0000","last_unstale":"2023-06-09T04:36:57.502450+0000","last_undegraded":"2023-06-09T04:36:57.502450+0000","last_fullsized":"2023-06-09T04:36:57.502450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:19:23.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516691+0000","last_change":"2023-06-09T04:36:52.690632+0000","last_active":"2023-06-09T04:36:57.516691+0000","last_peered":"2023-06-09T04:36:57.516691+0000","last_clean":"2023-06-09T04:36:57.516691+0000","last_became_active":"2023-06-09T04:36:52.690338+0000","last_became_peered":"2023-06-09T04:36:52.690338+0000","last_unstale":"2023-06-09T04:36:57.516691+0000","last_undegraded":"2023-06-09T04:36:57.516691+0000","last_fullsized":"2023-06-09T04:36:57.516691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:15:03.415789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517712+0000","last_change":"2023-06-09T04:36:53.095130+0000","last_active":"2023-06-09T04:36:57.517712+0000","last_peered":"2023-06-09T04:36:57.517712+0000","last_clean":"2023-06-09T04:36:57.517712+0000","last_became_active":"2023-06-09T04:36:53.094805+0000","last_became_peered":"2023-06-09T04:36:53.094805+0000","last_unstale":"2023-06-09T04:36:57.517712+0000","last_undegraded":"2023-06-09T04:36:57.517712+0000","last_fullsized":"2023-06-09T04:36:57.517712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:22.682476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501842+0000","last_change":"2023-06-09T04:36:57.115754+0000","last_active":"2023-06-09T04:36:57.501842+0000","last_peered":"2023-06-09T04:36:57.501842+0000","last_clean":"2023-06-09T04:36:57.501842+0000","last_became_active":"2023-06-09T04:36:57.115330+0000","last_became_peered":"2023-06-09T04:36:57.115330+0000","last_unstale":"2023-06-09T04:36:57.501842+0000","last_undegraded":"2023-06-09T04:36:57.501842+0000","last_fullsized":"2023-06-09T04:36:57.501842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:29.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517666+0000","last_change":"2023-06-09T04:36:52.693950+0000","last_active":"2023-06-09T04:36:57.517666+0000","last_peered":"2023-06-09T04:36:57.517666+0000","last_clean":"2023-06-09T04:36:57.517666+0000","last_became_active":"2023-06-09T04:36:52.691659+0000","last_became_peered":"2023-06-09T04:36:52.691659+0000","last_unstale":"2023-06-09T04:36:57.517666+0000","last_undegraded":"2023-06-09T04:36:57.517666+0000","last_fullsized":"2023-06-09T04:36:57.517666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:44.676469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502189+0000","last_change":"2023-06-09T04:36:47.621971+0000","last_active":"2023-06-09T04:36:57.502189+0000","last_peered":"2023-06-09T04:36:57.502189+0000","last_clean":"2023-06-09T04:36:57.502189+0000","last_became_active":"2023-06-09T04:36:47.621651+0000","last_became_peered":"2023-06-09T04:36:47.621651+0000","last_unstale":"2023-06-09T04:36:57.502189+0000","last_undegraded":"2023-06-09T04:36:57.502189+0000","last_fullsized":"2023-06-09T04:36:57.502189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:37:38.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516574+0000","last_change":"2023-06-09T04:36:53.087151+0000","last_active":"2023-06-09T04:36:57.516574+0000","last_peered":"2023-06-09T04:36:57.516574+0000","last_clean":"2023-06-09T04:36:57.516574+0000","last_became_active":"2023-06-09T04:36:53.086901+0000","last_became_peered":"2023-06-09T04:36:53.086901+0000","last_unstale":"2023-06-09T04:36:57.516574+0000","last_undegraded":"2023-06-09T04:36:57.516574+0000","last_fullsized":"2023-06-09T04:36:57.516574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:45.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516429+0000","last_change":"2023-06-09T04:36:57.124627+0000","last_active":"2023-06-09T04:36:57.516429+0000","last_peered":"2023-06-09T04:36:57.516429+0000","last_clean":"2023-06-09T04:36:57.516429+0000","last_became_active":"2023-06-09T04:36:57.124220+0000","last_became_peered":"2023-06-09T04:36:57.124220+0000","last_unstale":"2023-06-09T04:36:57.516429+0000","last_undegraded":"2023-06-09T04:36:57.516429+0000","last_fullsized":"2023-06-09T04:36:57.516429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:22:55.831089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517546+0000","last_change":"2023-06-09T04:36:47.613976+0000","last_active":"2023-06-09T04:36:57.517546+0000","last_peered":"2023-06-09T04:36:57.517546+0000","last_clean":"2023-06-09T04:36:57.517546+0000","last_became_active":"2023-06-09T04:36:47.613691+0000","last_became_peered":"2023-06-09T04:36:47.613691+0000","last_unstale":"2023-06-09T04:36:57.517546+0000","last_undegraded":"2023-06-09T04:36:57.517546+0000","last_fullsized":"2023-06-09T04:36:57.517546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:59.301853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500484+0000","last_change":"2023-06-09T04:36:52.686932+0000","last_active":"2023-06-09T04:36:57.500484+0000","last_peered":"2023-06-09T04:36:57.500484+0000","last_clean":"2023-06-09T04:36:57.500484+0000","last_became_active":"2023-06-09T04:36:52.686353+0000","last_became_peered":"2023-06-09T04:36:52.686353+0000","last_unstale":"2023-06-09T04:36:57.500484+0000","last_undegraded":"2023-06-09T04:36:57.500484+0000","last_fullsized":"2023-06-09T04:36:57.500484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:24.229634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501505+0000","last_change":"2023-06-09T04:36:53.086408+0000","last_active":"2023-06-09T04:36:57.501505+0000","last_peered":"2023-06-09T04:36:57.501505+0000","last_clean":"2023-06-09T04:36:57.501505+0000","last_became_active":"2023-06-09T04:36:53.086039+0000","last_became_peered":"2023-06-09T04:36:53.086039+0000","last_unstale":"2023-06-09T04:36:57.501505+0000","last_undegraded":"2023-06-09T04:36:57.501505+0000","last_fullsized":"2023-06-09T04:36:57.501505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:20:52.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500834+0000","last_change":"2023-06-09T04:36:57.119321+0000","last_active":"2023-06-09T04:36:57.500834+0000","last_peered":"2023-06-09T04:36:57.500834+0000","last_clean":"2023-06-09T04:36:57.500834+0000","last_became_active":"2023-06-09T04:36:57.118916+0000","last_became_peered":"2023-06-09T04:36:57.118916+0000","last_unstale":"2023-06-09T04:36:57.500834+0000","last_undegraded":"2023-06-09T04:36:57.500834+0000","last_fullsized":"2023-06-09T04:36:57.500834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:50.167224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516431+0000","last_change":"2023-06-09T04:36:47.626414+0000","last_active":"2023-06-09T04:36:57.516431+0000","last_peered":"2023-06-09T04:36:57.516431+0000","last_clean":"2023-06-09T04:36:57.516431+0000","last_became_active":"2023-06-09T04:36:47.626166+0000","last_became_peered":"2023-06-09T04:36:47.626166+0000","last_unstale":"2023-06-09T04:36:57.516431+0000","last_undegraded":"2023-06-09T04:36:57.516431+0000","last_fullsized":"2023-06-09T04:36:57.516431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:57.290510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516988+0000","last_change":"2023-06-09T04:36:47.627673+0000","last_active":"2023-06-09T04:36:57.516988+0000","last_peered":"2023-06-09T04:36:57.516988+0000","last_clean":"2023-06-09T04:36:57.516988+0000","last_became_active":"2023-06-09T04:36:47.626658+0000","last_became_peered":"2023-06-09T04:36:47.626658+0000","last_unstale":"2023-06-09T04:36:57.516988+0000","last_undegraded":"2023-06-09T04:36:57.516988+0000","last_fullsized":"2023-06-09T04:36:57.516988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:59.243942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500010+0000","last_change":"2023-06-09T04:36:52.690886+0000","last_active":"2023-06-09T04:36:57.500010+0000","last_peered":"2023-06-09T04:36:57.500010+0000","last_clean":"2023-06-09T04:36:57.500010+0000","last_became_active":"2023-06-09T04:36:52.690597+0000","last_became_peered":"2023-06-09T04:36:52.690597+0000","last_unstale":"2023-06-09T04:36:57.500010+0000","last_undegraded":"2023-06-09T04:36:57.500010+0000","last_fullsized":"2023-06-09T04:36:57.500010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500874+0000","last_change":"2023-06-09T04:36:53.090386+0000","last_active":"2023-06-09T04:36:57.500874+0000","last_peered":"2023-06-09T04:36:57.500874+0000","last_clean":"2023-06-09T04:36:57.500874+0000","last_became_active":"2023-06-09T04:36:53.081404+0000","last_became_peered":"2023-06-09T04:36:53.081404+0000","last_unstale":"2023-06-09T04:36:57.500874+0000","last_undegraded":"2023-06-09T04:36:57.500874+0000","last_fullsized":"2023-06-09T04:36:57.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:16.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518008+0000","last_change":"2023-06-09T04:36:57.120772+0000","last_active":"2023-06-09T04:36:57.518008+0000","last_peered":"2023-06-09T04:36:57.518008+0000","last_clean":"2023-06-09T04:36:57.518008+0000","last_became_active":"2023-06-09T04:36:57.120404+0000","last_became_peered":"2023-06-09T04:36:57.120404+0000","last_unstale":"2023-06-09T04:36:57.518008+0000","last_undegraded":"2023-06-09T04:36:57.518008+0000","last_fullsized":"2023-06-09T04:36:57.518008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:11.255903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516279+0000","last_change":"2023-06-09T04:36:47.618577+0000","last_active":"2023-06-09T04:36:57.516279+0000","last_peered":"2023-06-09T04:36:57.516279+0000","last_clean":"2023-06-09T04:36:57.516279+0000","last_became_active":"2023-06-09T04:36:47.618339+0000","last_became_peered":"2023-06-09T04:36:47.618339+0000","last_unstale":"2023-06-09T04:36:57.516279+0000","last_undegraded":"2023-06-09T04:36:57.516279+0000","last_fullsized":"2023-06-09T04:36:57.516279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:36.907071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515932+0000","last_change":"2023-06-09T04:36:52.696188+0000","last_active":"2023-06-09T04:36:57.515932+0000","last_peered":"2023-06-09T04:36:57.515932+0000","last_clean":"2023-06-09T04:36:57.515932+0000","last_became_active":"2023-06-09T04:36:52.695918+0000","last_became_peered":"2023-06-09T04:36:52.695918+0000","last_unstale":"2023-06-09T04:36:57.515932+0000","last_undegraded":"2023-06-09T04:36:57.515932+0000","last_fullsized":"2023-06-09T04:36:57.515932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:17:09.723017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517602+0000","last_change":"2023-06-09T04:36:53.096297+0000","last_active":"2023-06-09T04:36:57.517602+0000","last_peered":"2023-06-09T04:36:57.517602+0000","last_clean":"2023-06-09T04:36:57.517602+0000","last_became_active":"2023-06-09T04:36:53.096047+0000","last_became_peered":"2023-06-09T04:36:53.096047+0000","last_unstale":"2023-06-09T04:36:57.517602+0000","last_undegraded":"2023-06-09T04:36:57.517602+0000","last_fullsized":"2023-06-09T04:36:57.517602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:58.427626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516635+0000","last_change":"2023-06-09T04:36:57.120908+0000","last_active":"2023-06-09T04:36:57.516635+0000","last_peered":"2023-06-09T04:36:57.516635+0000","last_clean":"2023-06-09T04:36:57.516635+0000","last_became_active":"2023-06-09T04:36:57.120245+0000","last_became_peered":"2023-06-09T04:36:57.120245+0000","last_unstale":"2023-06-09T04:36:57.516635+0000","last_undegraded":"2023-06-09T04:36:57.516635+0000","last_fullsized":"2023-06-09T04:36:57.516635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:45.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516785+0000","last_change":"2023-06-09T04:36:47.618679+0000","last_active":"2023-06-09T04:36:57.516785+0000","last_peered":"2023-06-09T04:36:57.516785+0000","last_clean":"2023-06-09T04:36:57.516785+0000","last_became_active":"2023-06-09T04:36:47.618391+0000","last_became_peered":"2023-06-09T04:36:47.618391+0000","last_unstale":"2023-06-09T04:36:57.516785+0000","last_undegraded":"2023-06-09T04:36:57.516785+0000","last_fullsized":"2023-06-09T04:36:57.516785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:10.798839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517186+0000","last_change":"2023-06-09T04:36:52.687289+0000","last_active":"2023-06-09T04:36:57.517186+0000","last_peered":"2023-06-09T04:36:57.517186+0000","last_clean":"2023-06-09T04:36:57.517186+0000","last_became_active":"2023-06-09T04:36:52.686981+0000","last_became_peered":"2023-06-09T04:36:52.686981+0000","last_unstale":"2023-06-09T04:36:57.517186+0000","last_undegraded":"2023-06-09T04:36:57.517186+0000","last_fullsized":"2023-06-09T04:36:57.517186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:34.246906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516182+0000","last_change":"2023-06-09T04:36:53.090839+0000","last_active":"2023-06-09T04:36:57.516182+0000","last_peered":"2023-06-09T04:36:57.516182+0000","last_clean":"2023-06-09T04:36:57.516182+0000","last_became_active":"2023-06-09T04:36:53.090549+0000","last_became_peered":"2023-06-09T04:36:53.090549+0000","last_unstale":"2023-06-09T04:36:57.516182+0000","last_undegraded":"2023-06-09T04:36:57.516182+0000","last_fullsized":"2023-06-09T04:36:57.516182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:34.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500518+0000","last_change":"2023-06-09T04:36:57.115365+0000","last_active":"2023-06-09T04:36:57.500518+0000","last_peered":"2023-06-09T04:36:57.500518+0000","last_clean":"2023-06-09T04:36:57.500518+0000","last_became_active":"2023-06-09T04:36:57.114167+0000","last_became_peered":"2023-06-09T04:36:57.114167+0000","last_unstale":"2023-06-09T04:36:57.500518+0000","last_undegraded":"2023-06-09T04:36:57.500518+0000","last_fullsized":"2023-06-09T04:36:57.500518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:52.854459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500766+0000","last_change":"2023-06-09T04:36:47.616483+0000","last_active":"2023-06-09T04:36:57.500766+0000","last_peered":"2023-06-09T04:36:57.500766+0000","last_clean":"2023-06-09T04:36:57.500766+0000","last_became_active":"2023-06-09T04:36:47.616149+0000","last_became_peered":"2023-06-09T04:36:47.616149+0000","last_unstale":"2023-06-09T04:36:57.500766+0000","last_undegraded":"2023-06-09T04:36:57.500766+0000","last_fullsized":"2023-06-09T04:36:57.500766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:05.520144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502042+0000","last_change":"2023-06-09T04:36:52.692599+0000","last_active":"2023-06-09T04:36:57.502042+0000","last_peered":"2023-06-09T04:36:57.502042+0000","last_clean":"2023-06-09T04:36:57.502042+0000","last_became_active":"2023-06-09T04:36:52.692296+0000","last_became_peered":"2023-06-09T04:36:52.692296+0000","last_unstale":"2023-06-09T04:36:57.502042+0000","last_undegraded":"2023-06-09T04:36:57.502042+0000","last_fullsized":"2023-06-09T04:36:57.502042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:21:23.110649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516068+0000","last_change":"2023-06-09T04:36:53.086306+0000","last_active":"2023-06-09T04:36:57.516068+0000","last_peered":"2023-06-09T04:36:57.516068+0000","last_clean":"2023-06-09T04:36:57.516068+0000","last_became_active":"2023-06-09T04:36:53.081070+0000","last_became_peered":"2023-06-09T04:36:53.081070+0000","last_unstale":"2023-06-09T04:36:57.516068+0000","last_undegraded":"2023-06-09T04:36:57.516068+0000","last_fullsized":"2023-06-09T04:36:57.516068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:34.737443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516958+0000","last_change":"2023-06-09T04:36:57.116547+0000","last_active":"2023-06-09T04:36:57.516958+0000","last_peered":"2023-06-09T04:36:57.516958+0000","last_clean":"2023-06-09T04:36:57.516958+0000","last_became_active":"2023-06-09T04:36:57.116187+0000","last_became_peered":"2023-06-09T04:36:57.116187+0000","last_unstale":"2023-06-09T04:36:57.516958+0000","last_undegraded":"2023-06-09T04:36:57.516958+0000","last_fullsized":"2023-06-09T04:36:57.516958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:45:19.560682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517169+0000","last_change":"2023-06-09T04:36:47.616467+0000","last_active":"2023-06-09T04:36:57.517169+0000","last_peered":"2023-06-09T04:36:57.517169+0000","last_clean":"2023-06-09T04:36:57.517169+0000","last_became_active":"2023-06-09T04:36:47.616166+0000","last_became_peered":"2023-06-09T04:36:47.616166+0000","last_unstale":"2023-06-09T04:36:57.517169+0000","last_undegraded":"2023-06-09T04:36:57.517169+0000","last_fullsized":"2023-06-09T04:36:57.517169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:07:04.193240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516221+0000","last_change":"2023-06-09T04:36:52.695847+0000","last_active":"2023-06-09T04:36:57.516221+0000","last_peered":"2023-06-09T04:36:57.516221+0000","last_clean":"2023-06-09T04:36:57.516221+0000","last_became_active":"2023-06-09T04:36:52.695537+0000","last_became_peered":"2023-06-09T04:36:52.695537+0000","last_unstale":"2023-06-09T04:36:57.516221+0000","last_undegraded":"2023-06-09T04:36:57.516221+0000","last_fullsized":"2023-06-09T04:36:57.516221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:29:03.665158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500418+0000","last_change":"2023-06-09T04:36:53.092478+0000","last_active":"2023-06-09T04:36:57.500418+0000","last_peered":"2023-06-09T04:36:57.500418+0000","last_clean":"2023-06-09T04:36:57.500418+0000","last_became_active":"2023-06-09T04:36:53.092205+0000","last_became_peered":"2023-06-09T04:36:53.092205+0000","last_unstale":"2023-06-09T04:36:57.500418+0000","last_undegraded":"2023-06-09T04:36:57.500418+0000","last_fullsized":"2023-06-09T04:36:57.500418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:41.939536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500219+0000","last_change":"2023-06-09T04:36:57.117220+0000","last_active":"2023-06-09T04:36:57.500219+0000","last_peered":"2023-06-09T04:36:57.500219+0000","last_clean":"2023-06-09T04:36:57.500219+0000","last_became_active":"2023-06-09T04:36:57.116782+0000","last_became_peered":"2023-06-09T04:36:57.116782+0000","last_unstale":"2023-06-09T04:36:57.500219+0000","last_undegraded":"2023-06-09T04:36:57.500219+0000","last_fullsized":"2023-06-09T04:36:57.500219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:28.882830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517307+0000","last_change":"2023-06-09T04:36:47.613658+0000","last_active":"2023-06-09T04:36:57.517307+0000","last_peered":"2023-06-09T04:36:57.517307+0000","last_clean":"2023-06-09T04:36:57.517307+0000","last_became_active":"2023-06-09T04:36:47.613327+0000","last_became_peered":"2023-06-09T04:36:47.613327+0000","last_unstale":"2023-06-09T04:36:57.517307+0000","last_undegraded":"2023-06-09T04:36:57.517307+0000","last_fullsized":"2023-06-09T04:36:57.517307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:03.397674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500912+0000","last_change":"2023-06-09T04:36:52.688906+0000","last_active":"2023-06-09T04:36:57.500912+0000","last_peered":"2023-06-09T04:36:57.500912+0000","last_clean":"2023-06-09T04:36:57.500912+0000","last_became_active":"2023-06-09T04:36:52.688407+0000","last_became_peered":"2023-06-09T04:36:52.688407+0000","last_unstale":"2023-06-09T04:36:57.500912+0000","last_undegraded":"2023-06-09T04:36:57.500912+0000","last_fullsized":"2023-06-09T04:36:57.500912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515917+0000","last_change":"2023-06-09T04:36:53.088941+0000","last_active":"2023-06-09T04:36:57.515917+0000","last_peered":"2023-06-09T04:36:57.515917+0000","last_clean":"2023-06-09T04:36:57.515917+0000","last_became_active":"2023-06-09T04:36:53.088714+0000","last_became_peered":"2023-06-09T04:36:53.088714+0000","last_unstale":"2023-06-09T04:36:57.515917+0000","last_undegraded":"2023-06-09T04:36:57.515917+0000","last_fullsized":"2023-06-09T04:36:57.515917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:45:51.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517126+0000","last_change":"2023-06-09T04:36:57.107346+0000","last_active":"2023-06-09T04:36:57.517126+0000","last_peered":"2023-06-09T04:36:57.517126+0000","last_clean":"2023-06-09T04:36:57.517126+0000","last_became_active":"2023-06-09T04:36:57.106951+0000","last_became_peered":"2023-06-09T04:36:57.106951+0000","last_unstale":"2023-06-09T04:36:57.517126+0000","last_undegraded":"2023-06-09T04:36:57.517126+0000","last_fullsized":"2023-06-09T04:36:57.517126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:19:15.561278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500285+0000","last_change":"2023-06-09T04:36:52.690142+0000","last_active":"2023-06-09T04:36:57.500285+0000","last_peered":"2023-06-09T04:36:57.500285+0000","last_clean":"2023-06-09T04:36:57.500285+0000","last_became_active":"2023-06-09T04:36:52.689899+0000","last_became_peered":"2023-06-09T04:36:52.689899+0000","last_unstale":"2023-06-09T04:36:57.500285+0000","last_undegraded":"2023-06-09T04:36:57.500285+0000","last_fullsized":"2023-06-09T04:36:57.500285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:52.648622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516780+0000","last_change":"2023-06-09T04:36:53.090134+0000","last_active":"2023-06-09T04:36:57.516780+0000","last_peered":"2023-06-09T04:36:57.516780+0000","last_clean":"2023-06-09T04:36:57.516780+0000","last_became_active":"2023-06-09T04:36:53.089876+0000","last_became_peered":"2023-06-09T04:36:53.089876+0000","last_unstale":"2023-06-09T04:36:57.516780+0000","last_undegraded":"2023-06-09T04:36:57.516780+0000","last_fullsized":"2023-06-09T04:36:57.516780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:34.780805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516202+0000","last_change":"2023-06-09T04:36:57.119574+0000","last_active":"2023-06-09T04:36:57.516202+0000","last_peered":"2023-06-09T04:36:57.516202+0000","last_clean":"2023-06-09T04:36:57.516202+0000","last_became_active":"2023-06-09T04:36:57.119150+0000","last_became_peered":"2023-06-09T04:36:57.119150+0000","last_unstale":"2023-06-09T04:36:57.516202+0000","last_undegraded":"2023-06-09T04:36:57.516202+0000","last_fullsized":"2023-06-09T04:36:57.516202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500755+0000","last_change":"2023-06-09T04:36:52.690645+0000","last_active":"2023-06-09T04:36:57.500755+0000","last_peered":"2023-06-09T04:36:57.500755+0000","last_clean":"2023-06-09T04:36:57.500755+0000","last_became_active":"2023-06-09T04:36:52.690308+0000","last_became_peered":"2023-06-09T04:36:52.690308+0000","last_unstale":"2023-06-09T04:36:57.500755+0000","last_undegraded":"2023-06-09T04:36:57.500755+0000","last_fullsized":"2023-06-09T04:36:57.500755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:40.932066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502199+0000","last_change":"2023-06-09T04:36:53.081068+0000","last_active":"2023-06-09T04:36:57.502199+0000","last_peered":"2023-06-09T04:36:57.502199+0000","last_clean":"2023-06-09T04:36:57.502199+0000","last_became_active":"2023-06-09T04:36:53.080667+0000","last_became_peered":"2023-06-09T04:36:53.080667+0000","last_unstale":"2023-06-09T04:36:57.502199+0000","last_undegraded":"2023-06-09T04:36:57.502199+0000","last_fullsized":"2023-06-09T04:36:57.502199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:43.978989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501298+0000","last_change":"2023-06-09T04:36:57.122830+0000","last_active":"2023-06-09T04:36:57.501298+0000","last_peered":"2023-06-09T04:36:57.501298+0000","last_clean":"2023-06-09T04:36:57.501298+0000","last_became_active":"2023-06-09T04:36:57.122375+0000","last_became_peered":"2023-06-09T04:36:57.122375+0000","last_unstale":"2023-06-09T04:36:57.501298+0000","last_undegraded":"2023-06-09T04:36:57.501298+0000","last_fullsized":"2023-06-09T04:36:57.501298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501357+0000","last_change":"2023-06-09T04:36:52.690672+0000","last_active":"2023-06-09T04:36:57.501357+0000","last_peered":"2023-06-09T04:36:57.501357+0000","last_clean":"2023-06-09T04:36:57.501357+0000","last_became_active":"2023-06-09T04:36:52.690387+0000","last_became_peered":"2023-06-09T04:36:52.690387+0000","last_unstale":"2023-06-09T04:36:57.501357+0000","last_undegraded":"2023-06-09T04:36:57.501357+0000","last_fullsized":"2023-06-09T04:36:57.501357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501440+0000","last_change":"2023-06-09T04:36:53.087522+0000","last_active":"2023-06-09T04:36:57.501440+0000","last_peered":"2023-06-09T04:36:57.501440+0000","last_clean":"2023-06-09T04:36:57.501440+0000","last_became_active":"2023-06-09T04:36:53.087137+0000","last_became_peered":"2023-06-09T04:36:53.087137+0000","last_unstale":"2023-06-09T04:36:57.501440+0000","last_undegraded":"2023-06-09T04:36:57.501440+0000","last_fullsized":"2023-06-09T04:36:57.501440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:19:08.704227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501282+0000","last_change":"2023-06-09T04:36:57.122912+0000","last_active":"2023-06-09T04:36:57.501282+0000","last_peered":"2023-06-09T04:36:57.501282+0000","last_clean":"2023-06-09T04:36:57.501282+0000","last_became_active":"2023-06-09T04:36:57.122522+0000","last_became_peered":"2023-06-09T04:36:57.122522+0000","last_unstale":"2023-06-09T04:36:57.501282+0000","last_undegraded":"2023-06-09T04:36:57.501282+0000","last_fullsized":"2023-06-09T04:36:57.501282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:55.270027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517342+0000","last_change":"2023-06-09T04:36:52.692799+0000","last_active":"2023-06-09T04:36:57.517342+0000","last_peered":"2023-06-09T04:36:57.517342+0000","last_clean":"2023-06-09T04:36:57.517342+0000","last_became_active":"2023-06-09T04:36:52.692553+0000","last_became_peered":"2023-06-09T04:36:52.692553+0000","last_unstale":"2023-06-09T04:36:57.517342+0000","last_undegraded":"2023-06-09T04:36:57.517342+0000","last_fullsized":"2023-06-09T04:36:57.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:52.314087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516677+0000","last_change":"2023-06-09T04:36:53.080161+0000","last_active":"2023-06-09T04:36:57.516677+0000","last_peered":"2023-06-09T04:36:57.516677+0000","last_clean":"2023-06-09T04:36:57.516677+0000","last_became_active":"2023-06-09T04:36:53.079901+0000","last_became_peered":"2023-06-09T04:36:53.079901+0000","last_unstale":"2023-06-09T04:36:57.516677+0000","last_undegraded":"2023-06-09T04:36:57.516677+0000","last_fullsized":"2023-06-09T04:36:57.516677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:39:27.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516214+0000","last_change":"2023-06-09T04:36:57.115160+0000","last_active":"2023-06-09T04:36:57.516214+0000","last_peered":"2023-06-09T04:36:57.516214+0000","last_clean":"2023-06-09T04:36:57.516214+0000","last_became_active":"2023-06-09T04:36:57.114742+0000","last_became_peered":"2023-06-09T04:36:57.114742+0000","last_unstale":"2023-06-09T04:36:57.516214+0000","last_undegraded":"2023-06-09T04:36:57.516214+0000","last_fullsized":"2023-06-09T04:36:57.516214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:40:15.379010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500994+0000","last_change":"2023-06-09T04:36:52.680891+0000","last_active":"2023-06-09T04:36:57.500994+0000","last_peered":"2023-06-09T04:36:57.500994+0000","last_clean":"2023-06-09T04:36:57.500994+0000","last_became_active":"2023-06-09T04:36:52.680385+0000","last_became_peered":"2023-06-09T04:36:52.680385+0000","last_unstale":"2023-06-09T04:36:57.500994+0000","last_undegraded":"2023-06-09T04:36:57.500994+0000","last_fullsized":"2023-06-09T04:36:57.500994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502005+0000","last_change":"2023-06-09T04:36:53.096473+0000","last_active":"2023-06-09T04:36:57.502005+0000","last_peered":"2023-06-09T04:36:57.502005+0000","last_clean":"2023-06-09T04:36:57.502005+0000","last_became_active":"2023-06-09T04:36:53.096189+0000","last_became_peered":"2023-06-09T04:36:53.096189+0000","last_unstale":"2023-06-09T04:36:57.502005+0000","last_undegraded":"2023-06-09T04:36:57.502005+0000","last_fullsized":"2023-06-09T04:36:57.502005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:34:20.659382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515964+0000","last_change":"2023-06-09T04:36:53.097902+0000","last_active":"2023-06-09T04:36:57.515964+0000","last_peered":"2023-06-09T04:36:57.515964+0000","last_clean":"2023-06-09T04:36:57.515964+0000","last_became_active":"2023-06-09T04:36:53.097382+0000","last_became_peered":"2023-06-09T04:36:53.097382+0000","last_unstale":"2023-06-09T04:36:57.515964+0000","last_undegraded":"2023-06-09T04:36:57.515964+0000","last_fullsized":"2023-06-09T04:36:57.515964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:43.428603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517665+0000","last_change":"2023-06-09T04:36:53.082845+0000","last_active":"2023-06-09T04:36:57.517665+0000","last_peered":"2023-06-09T04:36:57.517665+0000","last_clean":"2023-06-09T04:36:57.517665+0000","last_became_active":"2023-06-09T04:36:53.082622+0000","last_became_peered":"2023-06-09T04:36:53.082622+0000","last_unstale":"2023-06-09T04:36:57.517665+0000","last_undegraded":"2023-06-09T04:36:57.517665+0000","last_fullsized":"2023-06-09T04:36:57.517665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:11:34.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502339+0000","last_change":"2023-06-09T04:36:53.094170+0000","last_active":"2023-06-09T04:36:57.502339+0000","last_peered":"2023-06-09T04:36:57.502339+0000","last_clean":"2023-06-09T04:36:57.502339+0000","last_became_active":"2023-06-09T04:36:53.093889+0000","last_became_peered":"2023-06-09T04:36:53.093889+0000","last_unstale":"2023-06-09T04:36:57.502339+0000","last_undegraded":"2023-06-09T04:36:57.502339+0000","last_fullsized":"2023-06-09T04:36:57.502339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:24.623854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517280+0000","last_change":"2023-06-09T04:36:53.090661+0000","last_active":"2023-06-09T04:36:57.517280+0000","last_peered":"2023-06-09T04:36:57.517280+0000","last_clean":"2023-06-09T04:36:57.517280+0000","last_became_active":"2023-06-09T04:36:53.090014+0000","last_became_peered":"2023-06-09T04:36:53.090014+0000","last_unstale":"2023-06-09T04:36:57.517280+0000","last_undegraded":"2023-06-09T04:36:57.517280+0000","last_fullsized":"2023-06-09T04:36:57.517280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:08.675015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516377+0000","last_change":"2023-06-09T04:36:53.087442+0000","last_active":"2023-06-09T04:36:57.516377+0000","last_peered":"2023-06-09T04:36:57.516377+0000","last_clean":"2023-06-09T04:36:57.516377+0000","last_became_active":"2023-06-09T04:36:53.086525+0000","last_became_peered":"2023-06-09T04:36:53.086525+0000","last_unstale":"2023-06-09T04:36:57.516377+0000","last_undegraded":"2023-06-09T04:36:57.516377+0000","last_fullsized":"2023-06-09T04:36:57.516377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:30:03.858670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":110193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":115204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":705732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":112006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":701722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":111354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:37:16.994 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:37:16.994 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-09T04:37:16.994 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-09T04:37:16.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-09T04:37:16.995 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-09T04:37:17.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 Processor -- start 2023-06-09T04:37:17.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 -- start start 2023-06-09T04:37:17.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6c84159380 0x7f6c840716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6c840b1dc0 0x7f6c840cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84071d50 0x7f6c840cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c840b10d0 con 0x7f6c840b1dc0 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8406f480 con 0x7f6c84159380 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.149+0000 7f6c89c92700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8406f760 con 0x7f6c84071d50 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6c840b1dc0 0x7f6c840cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6c840b1dc0 0x7f6c840cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36434/0 (socket says 172.21.15.149:36434) 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 -- 172.21.15.149:0/196223993 learned_addr learned my addr 172.21.15.149:0/196223993 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c837fe700 1 --2- 172.21.15.149:0/196223993 >> v2:172.21.15.184:3300/0 conn(0x7f6c84159380 0x7f6c840716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c83fff700 1 --2- 172.21.15.149:0/196223993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84071d50 0x7f6c840cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 -- 172.21.15.149:0/196223993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84071d50 msgr2=0x7f6c840cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:17.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 --2- 172.21.15.149:0/196223993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84071d50 0x7f6c840cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 -- 172.21.15.149:0/196223993 >> v2:172.21.15.184:3300/0 conn(0x7f6c84159380 msgr2=0x7f6c840716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:17.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 --2- 172.21.15.149:0/196223993 >> v2:172.21.15.184:3300/0 conn(0x7f6c84159380 0x7f6c840716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 -- 172.21.15.149:0/196223993 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c840b12e0 con 0x7f6c840b1dc0 2023-06-09T04:37:17.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c83fff700 1 --2- 172.21.15.149:0/196223993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84071d50 0x7f6c840cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:17.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c82ffd700 1 --2- 172.21.15.149:0/196223993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cd220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c84066830 tx=0x7f6c78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a7eefa31d8af8f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c827fc700 1 -- 172.21.15.149:0/196223993 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800b870 con 0x7f6c840b1dc0 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c827fc700 1 -- 172.21.15.149:0/196223993 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7800b9d0 con 0x7f6c840b1dc0 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.150+0000 7f6c827fc700 1 -- 172.21.15.149:0/196223993 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800bd60 con 0x7f6c840b1dc0 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 -- 172.21.15.149:0/196223993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1dc0 msgr2=0x7f6c840cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 --2- 172.21.15.149:0/196223993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cd220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6c84066830 tx=0x7f6c78009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 -- 172.21.15.149:0/196223993 shutdown_connections 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 --2- 172.21.15.149:0/196223993 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84071d50 0x7f6c840cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 --2- 172.21.15.149:0/196223993 >> v2:172.21.15.184:3300/0 conn(0x7f6c84159380 0x7f6c840716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 --2- 172.21.15.149:0/196223993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cd220 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 -- 172.21.15.149:0/196223993 >> 172.21.15.149:0/196223993 conn(0x7f6c8406aec0 msgr2=0x7f6c8406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:17.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 -- 172.21.15.149:0/196223993 shutdown_connections 2023-06-09T04:37:17.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.151+0000 7f6c89c92700 1 -- 172.21.15.149:0/196223993 wait complete. 2023-06-09T04:37:17.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.152+0000 7f6c89c92700 1 Processor -- start 2023-06-09T04:37:17.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.153+0000 7f6c89c92700 1 -- start start 2023-06-09T04:37:17.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.153+0000 7f6c89c92700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c84071d50 0x7f6c841498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.153+0000 7f6c89c92700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.153+0000 7f6c89c92700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84159380 0x7f6c840ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.153+0000 7f6c89c92700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84149e30 con 0x7f6c84071d50 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.153+0000 7f6c89c92700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840cc380 con 0x7f6c840b1dc0 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.153+0000 7f6c89c92700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c840cc600 con 0x7f6c84159380 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c84071d50 0x7f6c841498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c84071d50 0x7f6c841498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36438/0 (socket says 172.21.15.149:36438) 2023-06-09T04:37:17.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 -- 172.21.15.149:0/3645472954 learned_addr learned my addr 172.21.15.149:0/3645472954 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:17.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c82ffd700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c83fff700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84159380 0x7f6c840ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 -- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84159380 msgr2=0x7f6c840ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84159380 0x7f6c840ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 -- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c840b1dc0 msgr2=0x7f6c840cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 -- 172.21.15.149:0/3645472954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78009550 con 0x7f6c84071d50 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c82ffd700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c83fff700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84159380 0x7f6c840ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c837fe700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c84071d50 0x7f6c841498f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d800 tx=0x7f6c7400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c6bfff700 1 -- 172.21.15.149:0/3645472954 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740125f0 con 0x7f6c84071d50 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c6bfff700 1 -- 172.21.15.149:0/3645472954 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74012750 con 0x7f6c84071d50 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c840cc8e0 con 0x7f6c84071d50 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c6bfff700 1 -- 172.21.15.149:0/3645472954 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74012b00 con 0x7f6c84071d50 2023-06-09T04:37:17.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.154+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c840ccea0 con 0x7f6c84071d50 2023-06-09T04:37:17.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.155+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84073fa0 con 0x7f6c84071d50 2023-06-09T04:37:17.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.156+0000 7f6c6bfff700 1 -- 172.21.15.149:0/3645472954 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c74012c60 con 0x7f6c84071d50 2023-06-09T04:37:17.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.156+0000 7f6c6bfff700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6c7006ace0 0x7f6c7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.156+0000 7f6c6bfff700 1 -- 172.21.15.149:0/3645472954 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c74089b60 con 0x7f6c84071d50 2023-06-09T04:37:17.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.156+0000 7f6c82ffd700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6c7006ace0 0x7f6c7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.156+0000 7f6c82ffd700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6c7006ace0 0x7f6c7006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c840d0320 tx=0x7f6c78008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.161+0000 7f6c6bfff700 1 -- 172.21.15.149:0/3645472954 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c74054920 con 0x7f6c84071d50 2023-06-09T04:37:17.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.404+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6c840714a0 con 0x7f6c84071d50 2023-06-09T04:37:17.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.407+0000 7f6c6bfff700 1 -- 172.21.15.149:0/3645472954 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170846 (secure 0 0 0) 0x7f6c74057f40 con 0x7f6c84071d50 2023-06-09T04:37:17.409 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:17.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6c7006ace0 msgr2=0x7f6c7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6c7006ace0 0x7f6c7006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c840d0320 tx=0x7f6c78008030 comp rx=0 tx=0).stop 2023-06-09T04:37:17.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c84071d50 msgr2=0x7f6c841498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c84071d50 0x7f6c841498f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400d800 tx=0x7f6c7400dbc0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 shutdown_connections 2023-06-09T04:37:17.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6c7006ace0 0x7f6c7006d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6c84159380 0x7f6c840ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c84071d50 0x7f6c841498f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 --2- 172.21.15.149:0/3645472954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6c840b1dc0 0x7f6c840cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 >> 172.21.15.149:0/3645472954 conn(0x7f6c8406aec0 msgr2=0x7f6c840cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:17.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 shutdown_connections 2023-06-09T04:37:17.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.410+0000 7f6c89c92700 1 -- 172.21.15.149:0/3645472954 wait complete. 2023-06-09T04:37:17.422 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":2920572545},{"type":"v1","addr":"172.21.15.149:6833","nonce":2920572545}]},"active_addr":"172.21.15.149:6833/2920572545","active_change":"2023-06-09T04:36:40.379041+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":115354940}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":3291331645}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":105781559}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.149:0","nonce":590951117}]}]} 2023-06-09T04:37:17.427 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-09T04:37:17.427 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-09T04:37:17.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:17.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.549+0000 7fcf1ef96700 1 Processor -- start 2023-06-09T04:37:17.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.549+0000 7fcf1ef96700 1 -- start start 2023-06-09T04:37:17.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf1ef96700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf18069db0 0x7fcf1806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf1ef96700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180acbe0 con 0x7fcf180d0380 2023-06-09T04:37:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf1ef96700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180af8f0 con 0x7fcf180ae080 2023-06-09T04:37:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf1ef96700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180ac2d0 con 0x7fcf18069db0 2023-06-09T04:37:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf17fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fcf180d0380 0x7fcf180aead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60310/0 (socket says 172.21.15.149:60310) 2023-06-09T04:37:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf17fff700 1 -- 172.21.15.149:0/905610954 learned_addr learned my addr 172.21.15.149:0/905610954 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf1cd32700 1 --2- 172.21.15.149:0/905610954 >> v2:172.21.15.184:3300/0 conn(0x7fcf18069db0 0x7fcf1806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf177fe700 1 -- 172.21.15.149:0/905610954 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937508333 0 0) 0x7fcf180acbe0 con 0x7fcf180d0380 2023-06-09T04:37:17.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.550+0000 7fcf177fe700 1 -- 172.21.15.149:0/905610954 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf080035b0 con 0x7fcf180d0380 2023-06-09T04:37:17.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf1cd32700 1 -- 172.21.15.149:0/905610954 >> v1:172.21.15.184:6789/0 conn(0x7fcf180ae080 legacy=0x7fcf180af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf1cd32700 1 -- 172.21.15.149:0/905610954 >> v1:172.21.15.149:6789/0 conn(0x7fcf180d0380 legacy=0x7fcf180aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf177fe700 1 -- 172.21.15.149:0/905610954 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903073758 0 0) 0x7fcf080035b0 con 0x7fcf180d0380 2023-06-09T04:37:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf1cd32700 1 -- 172.21.15.149:0/905610954 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1806a6c0 con 0x7fcf18069db0 2023-06-09T04:37:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf1cd32700 1 --2- 172.21.15.149:0/905610954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 0x7fcf1806a180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009820 tx=0x7fcf0c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f3ebcd182e6013 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf177fe700 1 -- 172.21.15.149:0/905610954 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04001670 con 0x7fcf18069db0 2023-06-09T04:37:17.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf177fe700 1 -- 172.21.15.149:0/905610954 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c005c30 con 0x7fcf18069db0 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf177fe700 1 -- 172.21.15.149:0/905610954 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c004030 con 0x7fcf18069db0 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf1ef96700 1 -- 172.21.15.149:0/905610954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 msgr2=0x7fcf1806a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.551+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/905610954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 0x7fcf1806a180 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009820 tx=0x7fcf0c009b30 comp rx=0 tx=0).stop 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.552+0000 7fcf1ef96700 1 -- 172.21.15.149:0/905610954 shutdown_connections 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.552+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/905610954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 0x7fcf1806a180 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.552+0000 7fcf1ef96700 1 -- 172.21.15.149:0/905610954 >> 172.21.15.149:0/905610954 conn(0x7fcf1806b7e0 msgr2=0x7fcf180cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.552+0000 7fcf1ef96700 1 -- 172.21.15.149:0/905610954 shutdown_connections 2023-06-09T04:37:17.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.552+0000 7fcf1ef96700 1 -- 172.21.15.149:0/905610954 wait complete. 2023-06-09T04:37:17.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.553+0000 7fcf1ef96700 1 Processor -- start 2023-06-09T04:37:17.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.553+0000 7fcf1ef96700 1 -- start start 2023-06-09T04:37:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1ef96700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 0x7fcf181e6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1ef96700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf180ae080 0x7fcf1814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1ef96700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf180d0380 0x7fcf181e4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1ef96700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1814e040 con 0x7fcf180d0380 2023-06-09T04:37:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1ef96700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf181e5270 con 0x7fcf18069db0 2023-06-09T04:37:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1ef96700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf181e5550 con 0x7fcf180ae080 2023-06-09T04:37:17.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf180d0380 0x7fcf181e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf180d0380 0x7fcf181e4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36456/0 (socket says 172.21.15.149:36456) 2023-06-09T04:37:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 -- 172.21.15.149:0/4037427144 learned_addr learned my addr 172.21.15.149:0/4037427144 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1cd32700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 0x7fcf181e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf17fff700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf180ae080 0x7fcf1814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 -- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf180ae080 msgr2=0x7fcf1814db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf180ae080 0x7fcf1814db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 -- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 msgr2=0x7fcf181e6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 0x7fcf181e6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 -- 172.21.15.149:0/4037427144 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c009430 con 0x7fcf180d0380 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1d533700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf180d0380 0x7fcf181e4560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cb50 tx=0x7fcf1000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf157fa700 1 -- 172.21.15.149:0/4037427144 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10003c00 con 0x7fcf180d0380 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf181e5830 con 0x7fcf180d0380 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf157fa700 1 -- 172.21.15.149:0/4037427144 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10003d60 con 0x7fcf180d0380 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.554+0000 7fcf157fa700 1 -- 172.21.15.149:0/4037427144 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000aac0 con 0x7fcf180d0380 2023-06-09T04:37:17.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.555+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf181e5df0 con 0x7fcf180d0380 2023-06-09T04:37:17.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.555+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf181e5fe0 con 0x7fcf180d0380 2023-06-09T04:37:17.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.556+0000 7fcf157fa700 1 -- 172.21.15.149:0/4037427144 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf1000ac20 con 0x7fcf180d0380 2023-06-09T04:37:17.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.556+0000 7fcf157fa700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcefc06ad10 0x7fcefc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.556+0000 7fcf157fa700 1 -- 172.21.15.149:0/4037427144 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf100897e0 con 0x7fcf180d0380 2023-06-09T04:37:17.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.556+0000 7fcf1cd32700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcefc06ad10 0x7fcefc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.557+0000 7fcf1cd32700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcefc06ad10 0x7fcefc06d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009fd0 tx=0x7fcf0c008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.561+0000 7fcf157fa700 1 -- 172.21.15.149:0/4037427144 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf10054520 con 0x7fcf180d0380 2023-06-09T04:37:17.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.748+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf18073fa0 con 0x7fcf180d0380 2023-06-09T04:37:17.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.750+0000 7fcf157fa700 1 -- 172.21.15.149:0/4037427144 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7fcf10057b40 con 0x7fcf180d0380 2023-06-09T04:37:17.750 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:17.750 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:17.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcefc06ad10 msgr2=0x7fcefc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcefc06ad10 0x7fcefc06d1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c009fd0 tx=0x7fcf0c008070 comp rx=0 tx=0).stop 2023-06-09T04:37:17.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf180d0380 msgr2=0x7fcf181e4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf180d0380 0x7fcf181e4560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000cb50 tx=0x7fcf1000ce60 comp rx=0 tx=0).stop 2023-06-09T04:37:17.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 shutdown_connections 2023-06-09T04:37:17.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcefc06ad10 0x7fcefc06d1c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf180d0380 0x7fcf181e4560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf18069db0 0x7fcf181e6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 --2- 172.21.15.149:0/4037427144 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf180ae080 0x7fcf1814db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 >> 172.21.15.149:0/4037427144 conn(0x7fcf1806b7e0 msgr2=0x7fcf1806e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 shutdown_connections 2023-06-09T04:37:17.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.752+0000 7fcf1ef96700 1 -- 172.21.15.149:0/4037427144 wait complete. 2023-06-09T04:37:17.765 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-09T04:37:17.765 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:17.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.885+0000 7f8c2c357700 1 Processor -- start 2023-06-09T04:37:17.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.885+0000 7f8c2c357700 1 -- start start 2023-06-09T04:37:17.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.886+0000 7f8c2c357700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c240af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.886+0000 7f8c2c357700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8c240ccba0 0x7f8c240b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.886+0000 7f8c2c357700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c240af050 con 0x7f8c2415c590 2023-06-09T04:37:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.886+0000 7f8c2c357700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240afae0 con 0x7f8c240ccba0 2023-06-09T04:37:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.886+0000 7f8c2c357700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240af800 con 0x7f8c2406a4c0 2023-06-09T04:37:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a8f4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8c240ccba0 0x7f8c240b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a0f3700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8c2415c590 0x7f8c24069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60324/0 (socket says 172.21.15.149:60324) 2023-06-09T04:37:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a0f3700 1 -- 172.21.15.149:0/1763949490 learned_addr learned my addr 172.21.15.149:0/1763949490 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c298f2700 1 --2- 172.21.15.149:0/1763949490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c240af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a8f4700 1 -- 172.21.15.149:0/1763949490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 msgr2=0x7f8c240af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:17.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a8f4700 1 --2- 172.21.15.149:0/1763949490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c240af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a8f4700 1 -- 172.21.15.149:0/1763949490 >> v1:172.21.15.149:6789/0 conn(0x7f8c2415c590 legacy=0x7f8c24069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a8f4700 1 -- 172.21.15.149:0/1763949490 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240cc0c0 con 0x7f8c240ccba0 2023-06-09T04:37:17.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c298f2700 1 --2- 172.21.15.149:0/1763949490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c240af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:17.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c2a8f4700 1 --2- 172.21.15.149:0/1763949490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240b06d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009d90 tx=0x7f8c1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2be5b3af3ce93a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c290f1700 1 -- 172.21.15.149:0/1763949490 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00e070 con 0x7f8c240ccba0 2023-06-09T04:37:17.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c290f1700 1 -- 172.21.15.149:0/1763949490 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00bbd0 con 0x7f8c240ccba0 2023-06-09T04:37:17.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.887+0000 7f8c290f1700 1 -- 172.21.15.149:0/1763949490 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c012430 con 0x7f8c240ccba0 2023-06-09T04:37:17.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 -- 172.21.15.149:0/1763949490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 msgr2=0x7f8c240b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1763949490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240b06d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009d90 tx=0x7f8c1c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:17.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 -- 172.21.15.149:0/1763949490 shutdown_connections 2023-06-09T04:37:17.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1763949490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240b06d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1763949490 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c240af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 -- 172.21.15.149:0/1763949490 >> 172.21.15.149:0/1763949490 conn(0x7f8c2406b7e0 msgr2=0x7f8c240cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:17.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 -- 172.21.15.149:0/1763949490 shutdown_connections 2023-06-09T04:37:17.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.888+0000 7f8c2c357700 1 -- 172.21.15.149:0/1763949490 wait complete. 2023-06-09T04:37:17.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.889+0000 7f8c2c357700 1 Processor -- start 2023-06-09T04:37:17.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.889+0000 7f8c2c357700 1 -- start start 2023-06-09T04:37:17.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c24155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c2415c590 0x7f8c240cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b24d0 con 0x7f8c240ccba0 2023-06-09T04:37:17.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240b27b0 con 0x7f8c2415c590 2023-06-09T04:37:17.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241e76d0 con 0x7f8c2406a4c0 2023-06-09T04:37:17.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36468/0 (socket says 172.21.15.149:36468) 2023-06-09T04:37:17.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 -- 172.21.15.149:0/1470380555 learned_addr learned my addr 172.21.15.149:0/1470380555 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:17.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2a0f3700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c24155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2a8f4700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c2415c590 0x7f8c240cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 -- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 msgr2=0x7f8c24155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c24155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 -- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c2415c590 msgr2=0x7f8c240cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:17.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c2415c590 0x7f8c240cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:17.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 -- 172.21.15.149:0/1470380555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c009a70 con 0x7f8c240ccba0 2023-06-09T04:37:17.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c298f2700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240cb020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c7f0 tx=0x7f8c2000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c1affd700 1 -- 172.21.15.149:0/1470380555 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011800 con 0x7f8c240ccba0 2023-06-09T04:37:17.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c1affd700 1 -- 172.21.15.149:0/1470380555 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20011960 con 0x7f8c240ccba0 2023-06-09T04:37:17.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c1affd700 1 -- 172.21.15.149:0/1470380555 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20011cf0 con 0x7f8c240ccba0 2023-06-09T04:37:17.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c241e79b0 con 0x7f8c240ccba0 2023-06-09T04:37:17.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.890+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c24156400 con 0x7f8c240ccba0 2023-06-09T04:37:17.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.891+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c24073fa0 con 0x7f8c240ccba0 2023-06-09T04:37:17.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.892+0000 7f8c1affd700 1 -- 172.21.15.149:0/1470380555 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c20018360 con 0x7f8c240ccba0 2023-06-09T04:37:17.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.892+0000 7f8c1affd700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8c0806ace0 0x7f8c0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:17.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.892+0000 7f8c1affd700 1 -- 172.21.15.149:0/1470380555 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c200897f0 con 0x7f8c240ccba0 2023-06-09T04:37:17.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.892+0000 7f8c2a0f3700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8c0806ace0 0x7f8c0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:17.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.893+0000 7f8c2a0f3700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8c0806ace0 0x7f8c0806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c140010e0 tx=0x7f8c14009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:17.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:17.897+0000 7f8c1affd700 1 -- 172.21.15.149:0/1470380555 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c200545a0 con 0x7f8c240ccba0 2023-06-09T04:37:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.082+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c240b28f0 con 0x7f8c240ccba0 2023-06-09T04:37:18.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.084+0000 7f8c1affd700 1 -- 172.21.15.149:0/1470380555 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f8c20057bc0 con 0x7f8c240ccba0 2023-06-09T04:37:18.084 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:18.084 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:18.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8c0806ace0 msgr2=0x7f8c0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8c0806ace0 0x7f8c0806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8c140010e0 tx=0x7f8c14009040 comp rx=0 tx=0).stop 2023-06-09T04:37:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 msgr2=0x7f8c240cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240cb020 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c7f0 tx=0x7f8c2000cbb0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 shutdown_connections 2023-06-09T04:37:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8c0806ace0 0x7f8c0806d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8c2406a4c0 0x7f8c24155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c2415c590 0x7f8c240cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 --2- 172.21.15.149:0/1470380555 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c240ccba0 0x7f8c240cb020 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 >> 172.21.15.149:0/1470380555 conn(0x7f8c2406b7e0 msgr2=0x7f8c240ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 shutdown_connections 2023-06-09T04:37:18.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.086+0000 7f8c2c357700 1 -- 172.21.15.149:0/1470380555 wait complete. 2023-06-09T04:37:18.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-09T04:37:18.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-09T04:37:18.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-09T04:37:18.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-09T04:37:18.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-09T04:37:18.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-09T04:37:18.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-09T04:37:18.102 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-09T04:37:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.309+0000 7f9899def700 1 Processor -- start 2023-06-09T04:37:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.309+0000 7f9899def700 1 -- start start 2023-06-09T04:37:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.311+0000 7f9899def700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f98940b0330 0x7f98941592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.311+0000 7f9892ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f98940cf0a0 0x7f98940c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:38106/0 (socket says 172.21.15.149:38106) 2023-06-09T04:37:18.312 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.311+0000 7f9899def700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989406ffe0 con 0x7f98940b0700 2023-06-09T04:37:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.311+0000 7f9899def700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98940c9670 con 0x7f98940cf0a0 2023-06-09T04:37:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.311+0000 7f98937fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f98940b0330 0x7f98941592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.311+0000 7f9899def700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9894156140 con 0x7f98940b0330 2023-06-09T04:37:18.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f9892ffd700 1 -- 172.21.15.149:0/3640741670 learned_addr learned my addr 172.21.15.149:0/3640741670 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f98927fc700 1 -- 172.21.15.149:0/3640741670 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455579111 0 0) 0x7f989406ffe0 con 0x7f98940b0700 2023-06-09T04:37:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f98927fc700 1 -- 172.21.15.149:0/3640741670 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f987c0035b0 con 0x7f98940b0700 2023-06-09T04:37:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f98937fe700 1 -- 172.21.15.149:0/3640741670 >> v1:172.21.15.184:6789/0 conn(0x7f98940cf0a0 legacy=0x7f98940c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f98937fe700 1 -- 172.21.15.149:0/3640741670 >> v1:172.21.15.149:6789/0 conn(0x7f98940b0700 legacy=0x7f9894069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f98937fe700 1 -- 172.21.15.149:0/3640741670 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940c9390 con 0x7f98940b0330 2023-06-09T04:37:18.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f98937fe700 1 --2- 172.21.15.149:0/3640741670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0330 0x7f98941592c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f988800bd90 tx=0x7f988800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7bb32f8676e204 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f14f44b4700 1 Processor -- start 2023-06-09T04:37:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.312+0000 7f14f44b4700 1 -- start start 2023-06-09T04:37:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f98927fc700 1 -- 172.21.15.149:0/3640741670 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9888010070 con 0x7f98940b0330 2023-06-09T04:37:18.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f98927fc700 1 -- 172.21.15.149:0/3640741670 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988800dae0 con 0x7f98940b0330 2023-06-09T04:37:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f98927fc700 1 -- 172.21.15.149:0/3640741670 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988800de70 con 0x7f98940b0330 2023-06-09T04:37:18.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f14f44b4700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f14ec0b07d0 0x7f14ec0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f14f44b4700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec0adec0 con 0x7f14ec06a710 2023-06-09T04:37:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f14f44b4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec069f50 con 0x7f14ec160730 2023-06-09T04:37:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.313+0000 7f14f44b4700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec06ab30 con 0x7f14ec0b07d0 2023-06-09T04:37:18.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f2a51700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f14ec06a710 0x7f14ec164130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60348/0 (socket says 172.21.15.149:60348) 2023-06-09T04:37:18.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f2a51700 1 -- 172.21.15.149:0/2138003116 learned_addr learned my addr 172.21.15.149:0/2138003116 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:18.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f1a4f700 1 --2- 172.21.15.149:0/2138003116 >> v2:172.21.15.184:3300/0 conn(0x7f14ec0b07d0 0x7f14ec0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339955776 0 0) 0x7f14ec0adec0 con 0x7f14ec06a710 2023-06-09T04:37:18.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d80035b0 con 0x7f14ec06a710 2023-06-09T04:37:18.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f9899def700 1 -- 172.21.15.149:0/3640741670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0330 msgr2=0x7f98941592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f9899def700 1 --2- 172.21.15.149:0/3640741670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0330 0x7f98941592c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f988800bd90 tx=0x7f988800d330 comp rx=0 tx=0).stop 2023-06-09T04:37:18.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2369277606 0 0) 0x7f14ec069f50 con 0x7f14ec160730 2023-06-09T04:37:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ec0adec0 con 0x7f14ec160730 2023-06-09T04:37:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.314+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 <== mon.1 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595105537 0 0) 0x7f14ec0adec0 con 0x7f14ec160730 2023-06-09T04:37:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 >> v2:172.21.15.184:3300/0 conn(0x7f14ec0b07d0 msgr2=0x7f14ec0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 --2- 172.21.15.149:0/2138003116 >> v2:172.21.15.184:3300/0 conn(0x7f14ec0b07d0 0x7f14ec0ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 >> v1:172.21.15.149:6789/0 conn(0x7f14ec06a710 legacy=0x7f14ec164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0c92e0 con 0x7f14ec160730 2023-06-09T04:37:18.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 <== mon.1 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f14dc0015a0 con 0x7f14ec160730 2023-06-09T04:37:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 >> v1:172.21.15.184:6789/0 conn(0x7f14ec160730 legacy=0x7f14ec0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d8003c30 0x7f14d8004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8004850 0x7f14d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d8005350 0x7f14d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec06ab30 con 0x7f14d8005350 2023-06-09T04:37:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d800c280 con 0x7f14d8003c30 2023-06-09T04:37:18.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d800c440 con 0x7f14d8004850 2023-06-09T04:37:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2250700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d8003c30 0x7f14d8004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2a51700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d8005350 0x7f14d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f9899def700 1 -- 172.21.15.149:0/3640741670 shutdown_connections 2023-06-09T04:37:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f9899def700 1 --2- 172.21.15.149:0/3640741670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0330 0x7f98941592c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f9899def700 1 -- 172.21.15.149:0/3640741670 >> 172.21.15.149:0/3640741670 conn(0x7f98940ce5c0 msgr2=0x7f98940ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f9899def700 1 -- 172.21.15.149:0/3640741670 shutdown_connections 2023-06-09T04:37:18.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2a51700 1 -- 172.21.15.149:0/2138003116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8004850 msgr2=0x7f14d8004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2a51700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8004850 0x7f14d8004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2a51700 1 -- 172.21.15.149:0/2138003116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d8003c30 msgr2=0x7f14d8004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2a51700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14d8003c30 0x7f14d8004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2a51700 1 -- 172.21.15.149:0/2138003116 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0adec0 con 0x7f14d8005350 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f14f2a51700 1 -- 172.21.15.149:0/2138003116 reap_dead start 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.316+0000 7f14f2a51700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d8005350 0x7f14d800ba10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c320 tx=0x7f14d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda97a34ec8a383d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.316+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4014420 con 0x7f14d8005350 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.316+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e4014580 con 0x7f14d8005350 2023-06-09T04:37:18.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.316+0000 7f14f124e700 1 -- 172.21.15.149:0/2138003116 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40148f0 con 0x7f14d8005350 2023-06-09T04:37:18.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.317+0000 7f14f44b4700 1 -- 172.21.15.149:0/2138003116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d8005350 msgr2=0x7f14d800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.317+0000 7f14f44b4700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d8005350 0x7f14d800ba10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c320 tx=0x7f14d8005880 comp rx=0 tx=0).stop 2023-06-09T04:37:18.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.317+0000 7f14f44b4700 1 -- 172.21.15.149:0/2138003116 shutdown_connections 2023-06-09T04:37:18.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.317+0000 7f14f44b4700 1 --2- 172.21.15.149:0/2138003116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14d8005350 0x7f14d800ba10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.317+0000 7f14f44b4700 1 -- 172.21.15.149:0/2138003116 >> 172.21.15.149:0/2138003116 conn(0x7f14ec0ce5c0 msgr2=0x7f14ec0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.315+0000 7f9899def700 1 -- 172.21.15.149:0/3640741670 wait complete. 2023-06-09T04:37:18.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.317+0000 7f9899def700 1 Processor -- start 2023-06-09T04:37:18.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.318+0000 7f14f44b4700 1 -- 172.21.15.149:0/2138003116 shutdown_connections 2023-06-09T04:37:18.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.317+0000 7f9899def700 1 -- start start 2023-06-09T04:37:18.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.318+0000 7f9899def700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940b0330 0x7f98941527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.318+0000 7f9899def700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0700 0x7f98940c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.318+0000 7f9899def700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98940cf0a0 0x7f9894154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.318+0000 7f9899def700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894152d20 con 0x7f98940b0700 2023-06-09T04:37:18.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9899def700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98940c2d50 con 0x7f98940b0330 2023-06-09T04:37:18.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9899def700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98940c3030 con 0x7f98940cf0a0 2023-06-09T04:37:18.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0700 0x7f98940c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0700 0x7f98940c3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36494/0 (socket says 172.21.15.149:36494) 2023-06-09T04:37:18.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 -- 172.21.15.149:0/1429706334 learned_addr learned my addr 172.21.15.149:0/1429706334 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f98937fe700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940b0330 0x7f98941527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f14f44b4700 1 -- 172.21.15.149:0/2138003116 wait complete. 2023-06-09T04:37:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9893fff700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98940cf0a0 0x7f9894154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 -- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98940cf0a0 msgr2=0x7f9894154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f98940cf0a0 0x7f9894154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 -- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940b0330 msgr2=0x7f98941527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98940b0330 0x7f98941527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 -- 172.21.15.149:0/1429706334 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988800ba70 con 0x7f98940b0700 2023-06-09T04:37:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.319+0000 7f9892ffd700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0700 0x7f98940c3df0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f988400c450 tx=0x7f988400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.320+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884005d70 con 0x7f98940b0700 2023-06-09T04:37:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.320+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98840070d0 con 0x7f98940b0700 2023-06-09T04:37:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.320+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884007440 con 0x7f98940b0700 2023-06-09T04:37:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.320+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98940c3310 con 0x7f98940b0700 2023-06-09T04:37:18.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.320+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98940c38d0 con 0x7f98940b0700 2023-06-09T04:37:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.321+0000 7f14f44b4700 1 Processor -- start 2023-06-09T04:37:18.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.321+0000 7f14f44b4700 1 -- start start 2023-06-09T04:37:18.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.321+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9874000fc0 con 0x7f98940b0700 2023-06-09T04:37:18.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f3470e45700 1 Processor -- start 2023-06-09T04:37:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7ff804ff1700 1 Processor -- start 2023-06-09T04:37:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f44b4700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8005350 0x7f14ec15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f44b4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ec15c450 0x7f14ec15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f44b4700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec162ee0 0x7f14ec163380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f44b4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec161ab0 con 0x7f14ec15c450 2023-06-09T04:37:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f44b4700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec15c200 con 0x7f14ec162ee0 2023-06-09T04:37:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f44b4700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1614f0 con 0x7f14d8005350 2023-06-09T04:37:18.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f2250700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8005350 0x7f14ec15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f2250700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8005350 0x7f14ec15c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42108/0 (socket says 172.21.15.149:42108) 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f2250700 1 -- 172.21.15.149:0/112418705 learned_addr learned my addr 172.21.15.149:0/112418705 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f2a51700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec162ee0 0x7f14ec163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f14f1a4f700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ec15c450 0x7f14ec15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f14f2a51700 1 -- 172.21.15.149:0/112418705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8005350 msgr2=0x7f14ec15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f14f2a51700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f14d8005350 0x7f14ec15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f14f2a51700 1 -- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ec15c450 msgr2=0x7f14ec15bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f14f2a51700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ec15c450 0x7f14ec15bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f14f2a51700 1 -- 172.21.15.149:0/112418705 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec1617d0 con 0x7f14ec162ee0 2023-06-09T04:37:18.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f14f1a4f700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f14ec15c450 0x7f14ec15bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:18.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f3470e45700 1 -- start start 2023-06-09T04:37:18.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98840075a0 con 0x7f98940b0700 2023-06-09T04:37:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f3181e8b700 1 Processor -- start 2023-06-09T04:37:18.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f14f2a51700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec162ee0 0x7f14ec163380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0725e0 tx=0x7f14e4001650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f987bfff700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f988006ace0 0x7f988006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9884088a10 con 0x7f98940b0700 2023-06-09T04:37:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f987bfff700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:6816/966994911,v1:172.21.15.184:6818/966994911] conn(0x7f9880074930 0x7f9880076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 --> [v2:172.21.15.184:6816/966994911,v1:172.21.15.184:6818/966994911] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9880077430 con 0x7f9880074930 2023-06-09T04:37:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9884053820 con 0x7f98940b0700 2023-06-09T04:37:18.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f9893fff700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:6816/966994911,v1:172.21.15.184:6818/966994911] conn(0x7f9880074930 0x7f9880076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3470e45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1592c0 0x7f346c0b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3470e45700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c06ffe0 con 0x7f346c0cf0a0 2023-06-09T04:37:18.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3470e45700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346c0c9390 con 0x7f346c0b0600 2023-06-09T04:37:18.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3470e45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c156140 con 0x7f346c1592c0 2023-06-09T04:37:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.322+0000 7ff804ff1700 1 -- start start 2023-06-09T04:37:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7ff804ff1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff800069db0 0x7ff80006a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7ff804ff1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff800165200 con 0x7ff8001607a0 2023-06-09T04:37:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7ff804ff1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff800160b70 con 0x7ff8000c9100 2023-06-09T04:37:18.342 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7ff804ff1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80006a790 con 0x7ff800069db0 2023-06-09T04:37:18.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7ff7fe59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff8001607a0 0x7ff8000cc170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60368/0 (socket says 172.21.15.149:60368) 2023-06-09T04:37:18.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7ff7fe59c700 1 -- 172.21.15.149:0/1769643003 learned_addr learned my addr 172.21.15.149:0/1769643003 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:18.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f346a59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f346c0cf0a0 0x7f346c0c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60374/0 (socket says 172.21.15.149:60374) 2023-06-09T04:37:18.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f346a59c700 1 -- 172.21.15.149:0/600276237 learned_addr learned my addr 172.21.15.149:0/600276237 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:18.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7ff7fdd9b700 1 --2- 172.21.15.149:0/1769643003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff800069db0 0x7ff80006a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7ff7fdd9b700 1 -- 172.21.15.149:0/1769643003 >> v1:172.21.15.184:6789/0 conn(0x7ff8000c9100 legacy=0x7ff8000c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7ff7fdd9b700 1 -- 172.21.15.149:0/1769643003 >> v1:172.21.15.149:6789/0 conn(0x7ff8001607a0 legacy=0x7ff8000cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7ff7fdd9b700 1 -- 172.21.15.149:0/1769643003 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800164680 con 0x7ff800069db0 2023-06-09T04:37:18.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.323+0000 7f3181e8b700 1 -- start start 2023-06-09T04:37:18.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3181e8b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c1607a0 0x7f317c0cc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3181e8b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f317c0cc6b0 0x7f317c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3181e8b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f317c06a2f0 0x7f317c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f3181e8b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c06a770 con 0x7f317c0cc6b0 2023-06-09T04:37:18.345 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f3181e8b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c165200 con 0x7f317c06a2f0 2023-06-09T04:37:18.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f3181e8b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c160b70 con 0x7f317c1607a0 2023-06-09T04:37:18.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4014420 con 0x7f14ec162ee0 2023-06-09T04:37:18.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e400ced0 con 0x7f14ec162ee0 2023-06-09T04:37:18.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e401f650 con 0x7f14ec162ee0 2023-06-09T04:37:18.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec160ca0 con 0x7f14ec162ee0 2023-06-09T04:37:18.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec1638c0 con 0x7f14ec162ee0 2023-06-09T04:37:18.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7ff7fdd9b700 1 --2- 172.21.15.149:0/1769643003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff800069db0 0x7ff80006a250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e51330eb09a849f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.324+0000 7f3469d9b700 1 --2- 172.21.15.149:0/600276237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1592c0 0x7f346c0b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f9893fff700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:6816/966994911,v1:172.21.15.184:6818/966994911] conn(0x7f9880074930 0x7f9880076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f317bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f317c06a2f0 0x7f317c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f317bfff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f317c06a2f0 0x7f317c06c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55780/0 (socket says 172.21.15.149:55780) 2023-06-09T04:37:18.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f317bfff700 1 -- 172.21.15.149:0/1851967192 learned_addr learned my addr 172.21.15.149:0/1851967192 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7ff7fd59a700 1 -- 172.21.15.149:0/1769643003 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004230 con 0x7ff800069db0 2023-06-09T04:37:18.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317affd700 1 --2- 172.21.15.149:0/1851967192 >> v2:172.21.15.149:3300/0 conn(0x7f317c0cc6b0 0x7f317c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317bfff700 1 -- 172.21.15.149:0/1851967192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c1607a0 msgr2=0x7f317c0cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317bfff700 1 --2- 172.21.15.149:0/1851967192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c1607a0 0x7f317c0cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317bfff700 1 -- 172.21.15.149:0/1851967192 >> v2:172.21.15.149:3300/0 conn(0x7f317c0cc6b0 msgr2=0x7f317c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317bfff700 1 --2- 172.21.15.149:0/1851967192 >> v2:172.21.15.149:3300/0 conn(0x7f317c0cc6b0 0x7f317c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317bfff700 1 -- 172.21.15.149:0/1851967192 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c164680 con 0x7f317c06a2f0 2023-06-09T04:37:18.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f3469d9b700 1 -- 172.21.15.149:0/600276237 >> v1:172.21.15.184:6789/0 conn(0x7f346c0b0600 legacy=0x7f346c0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f3469d9b700 1 -- 172.21.15.149:0/600276237 >> v1:172.21.15.149:6789/0 conn(0x7f346c0cf0a0 legacy=0x7f346c0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f3469d9b700 1 -- 172.21.15.149:0/600276237 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c15eca0 con 0x7f346c1592c0 2023-06-09T04:37:18.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.325+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14d4000fc0 con 0x7f14ec162ee0 2023-06-09T04:37:18.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317bfff700 1 --2- 172.21.15.149:0/1851967192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c06a2f0 0x7f317c06c100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f317c0adb40 tx=0x7f317400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=147188dc81dabbdc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7ff7fd59a700 1 -- 172.21.15.149:0/1769643003 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0004390 con 0x7ff800069db0 2023-06-09T04:37:18.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7ff7fd59a700 1 -- 172.21.15.149:0/1769643003 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f00036a0 con 0x7ff800069db0 2023-06-09T04:37:18.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f3469d9b700 1 --2- 172.21.15.149:0/600276237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1592c0 0x7f346c0b00c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3460009870 tx=0x7f3460009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da10a17b8b8fc0c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== osd.6 v2:172.21.15.184:6816/966994911 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9880077430 con 0x7f9880074930 2023-06-09T04:37:18.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f98937fe700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f988006ace0 0x7f988006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f317a7fc700 1 -- 172.21.15.149:0/1851967192 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317400e070 con 0x7f317c06a2f0 2023-06-09T04:37:18.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7ff804ff1700 1 -- 172.21.15.149:0/1769643003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff800069db0 msgr2=0x7ff80006a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7ff804ff1700 1 --2- 172.21.15.149:0/1769643003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff800069db0 0x7ff80006a250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009870 tx=0x7ff7f0009b80 comp rx=0 tx=0).stop 2023-06-09T04:37:18.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.326+0000 7f346959a700 1 -- 172.21.15.149:0/600276237 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460004230 con 0x7f346c1592c0 2023-06-09T04:37:18.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7f317a7fc700 1 -- 172.21.15.149:0/1851967192 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317400b9c0 con 0x7f317c06a2f0 2023-06-09T04:37:18.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7f317a7fc700 1 -- 172.21.15.149:0/1851967192 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317400bd70 con 0x7f317c06a2f0 2023-06-09T04:37:18.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7ff804ff1700 1 -- 172.21.15.149:0/1769643003 shutdown_connections 2023-06-09T04:37:18.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7ff804ff1700 1 --2- 172.21.15.149:0/1769643003 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff800069db0 0x7ff80006a250 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7ff804ff1700 1 -- 172.21.15.149:0/1769643003 >> 172.21.15.149:0/1769643003 conn(0x7ff8000cf250 msgr2=0x7ff8000cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7ff804ff1700 1 -- 172.21.15.149:0/1769643003 shutdown_connections 2023-06-09T04:37:18.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7ff804ff1700 1 -- 172.21.15.149:0/1769643003 wait complete. 2023-06-09T04:37:18.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7f346959a700 1 -- 172.21.15.149:0/600276237 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460004390 con 0x7f346c1592c0 2023-06-09T04:37:18.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7f346959a700 1 -- 172.21.15.149:0/600276237 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34600036a0 con 0x7f346c1592c0 2023-06-09T04:37:18.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7f98937fe700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f988006ace0 0x7f988006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f988800bd60 tx=0x7f9888013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7f3181e8b700 1 -- 172.21.15.149:0/1851967192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c06a2f0 msgr2=0x7f317c06c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.327+0000 7f3181e8b700 1 --2- 172.21.15.149:0/1851967192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c06a2f0 0x7f317c06c100 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f317c0adb40 tx=0x7f317400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:18.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f1c6df48700 1 Processor -- start 2023-06-09T04:37:18.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3181e8b700 1 -- 172.21.15.149:0/1851967192 shutdown_connections 2023-06-09T04:37:18.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3181e8b700 1 --2- 172.21.15.149:0/1851967192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c06a2f0 0x7f317c06c100 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3181e8b700 1 --2- 172.21.15.149:0/1851967192 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c1607a0 0x7f317c0cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3181e8b700 1 --2- 172.21.15.149:0/1851967192 >> v2:172.21.15.149:3300/0 conn(0x7f317c0cc6b0 0x7f317c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3181e8b700 1 -- 172.21.15.149:0/1851967192 >> 172.21.15.149:0/1851967192 conn(0x7f317c0cf250 msgr2=0x7f317c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f1c6df48700 1 -- start start 2023-06-09T04:37:18.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3470e45700 1 -- 172.21.15.149:0/600276237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1592c0 msgr2=0x7f346c0b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3470e45700 1 --2- 172.21.15.149:0/600276237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1592c0 0x7f346c0b00c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3460009870 tx=0x7f3460009b80 comp rx=0 tx=0).stop 2023-06-09T04:37:18.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3470e45700 1 -- 172.21.15.149:0/600276237 shutdown_connections 2023-06-09T04:37:18.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3470e45700 1 --2- 172.21.15.149:0/600276237 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1592c0 0x7f346c0b00c0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3460009870 tx=0x7f3460009b80 comp rx=0 tx=0).stop 2023-06-09T04:37:18.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3470e45700 1 -- 172.21.15.149:0/600276237 >> 172.21.15.149:0/600276237 conn(0x7f346c0ce5c0 msgr2=0x7f346c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3470e45700 1 -- 172.21.15.149:0/600276237 shutdown_connections 2023-06-09T04:37:18.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.328+0000 7f3470e45700 1 -- 172.21.15.149:0/600276237 wait complete. 2023-06-09T04:37:18.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7ff804ff1700 1 Processor -- start 2023-06-09T04:37:18.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7ff804ff1700 1 -- start start 2023-06-09T04:37:18.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c6df48700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1c680cca40 0x7f1c680711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c6df48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c68069db0 0x7f1c6806a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c6df48700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c680ccf00 con 0x7f1c6815d7f0 2023-06-09T04:37:18.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c6df48700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6806a770 con 0x7f1c680cca40 2023-06-09T04:37:18.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c6df48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680720f0 con 0x7f1c68069db0 2023-06-09T04:37:18.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c68069db0 0x7f1c6806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c68069db0 0x7f1c6806a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42134/0 (socket says 172.21.15.149:42134) 2023-06-09T04:37:18.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.329+0000 7f1c67fff700 1 -- 172.21.15.149:0/4162844640 learned_addr learned my addr 172.21.15.149:0/4162844640 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f1c67fff700 1 -- 172.21.15.149:0/4162844640 >> v2:172.21.15.184:3300/0 conn(0x7f1c680cca40 msgr2=0x7f1c680711f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:37:18.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f1c67fff700 1 --2- 172.21.15.149:0/4162844640 >> v2:172.21.15.184:3300/0 conn(0x7f1c680cca40 0x7f1c680711f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f1c67fff700 1 -- 172.21.15.149:0/4162844640 >> v1:172.21.15.184:6789/0 conn(0x7f1c6815d7f0 legacy=0x7f1c680cb650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:37:18.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f1c67fff700 1 -- 172.21.15.149:0/4162844640 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6815dbc0 con 0x7f1c68069db0 2023-06-09T04:37:18.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7ff804ff1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff800069db0 0x7ff800161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7ff804ff1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8000c9100 0x7ff800163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7ff804ff1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8001607a0 0x7ff8000c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7ff804ff1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8000c5600 con 0x7ff8000c9100 2023-06-09T04:37:18.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7ff804ff1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800162240 con 0x7ff800069db0 2023-06-09T04:37:18.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7ff804ff1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff800161f60 con 0x7ff8001607a0 2023-06-09T04:37:18.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f3181e8b700 1 -- 172.21.15.149:0/1851967192 shutdown_connections 2023-06-09T04:37:18.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f3470e45700 1 Processor -- start 2023-06-09T04:37:18.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f1c67fff700 1 --2- 172.21.15.149:0/4162844640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c68069db0 0x7f1c6806a230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0098f0 tx=0x7f1c5c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92b6e87b01d88697 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7ff7fed9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8001607a0 0x7ff8000c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fe59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff800069db0 0x7ff800161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f14e401f7b0 con 0x7f14ec162ee0 2023-06-09T04:37:18.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f14e2ffd700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f14d006adb0 0x7f14d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f14e408bc00 con 0x7f14ec162ee0 2023-06-09T04:37:18.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f14e2ffd700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6808/2663874778,v1:172.21.15.149:6809/2663874778] conn(0x7f14d0074a80 0x7f14d0076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 --> [v2:172.21.15.149:6808/2663874778,v1:172.21.15.149:6809/2663874778] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14d0077580 con 0x7f14d0074a80 2023-06-09T04:37:18.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14e408bfb0 con 0x7f14ec162ee0 2023-06-09T04:37:18.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fe59c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff800069db0 0x7ff800161980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55792/0 (socket says 172.21.15.149:55792) 2023-06-09T04:37:18.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fe59c700 1 -- 172.21.15.149:0/397682166 learned_addr learned my addr 172.21.15.149:0/397682166 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fdd9b700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8000c9100 0x7ff800163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7f3470e45700 1 -- start start 2023-06-09T04:37:18.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fdd9b700 1 -- 172.21.15.149:0/397682166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8001607a0 msgr2=0x7ff8000c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fdd9b700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8001607a0 0x7ff8000c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fdd9b700 1 -- 172.21.15.149:0/397682166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff800069db0 msgr2=0x7ff800161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fdd9b700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff800069db0 0x7ff800161980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fdd9b700 1 -- 172.21.15.149:0/397682166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00094a0 con 0x7ff8000c9100 2023-06-09T04:37:18.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7ff7fed9d700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff8001607a0 0x7ff8000c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:18.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7f14f2250700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f14d006adb0 0x7f14d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.331+0000 7f1c667fc700 1 -- 172.21.15.149:0/4162844640 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c004230 con 0x7f1c68069db0 2023-06-09T04:37:18.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f1c667fc700 1 -- 172.21.15.149:0/4162844640 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c004390 con 0x7f1c68069db0 2023-06-09T04:37:18.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f1c667fc700 1 -- 172.21.15.149:0/4162844640 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0036a0 con 0x7f1c68069db0 2023-06-09T04:37:18.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.330+0000 7f3181e8b700 1 -- 172.21.15.149:0/1851967192 wait complete. 2023-06-09T04:37:18.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3181e8b700 1 Processor -- start 2023-06-09T04:37:18.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3470e45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f346c0b0600 0x7f346c148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3470e45700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f346c0cf0a0 0x7f346c14aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3470e45700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1506c0 0x7f346c150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3470e45700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c151080 con 0x7f346c0b0600 2023-06-09T04:37:18.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3470e45700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346c1517e0 con 0x7f346c0cf0a0 2023-06-09T04:37:18.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3470e45700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346c151a30 con 0x7f346c1506c0 2023-06-09T04:37:18.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3469d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f346c0cf0a0 0x7f346c14aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3469d9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f346c0cf0a0 0x7f346c14aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55802/0 (socket says 172.21.15.149:55802) 2023-06-09T04:37:18.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3469d9b700 1 -- 172.21.15.149:0/1377692240 learned_addr learned my addr 172.21.15.149:0/1377692240 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f346ad9d700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1506c0 0x7f346c150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f65e7bec700 1 Processor -- start 2023-06-09T04:37:18.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7ff7fdd9b700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8000c9100 0x7ff800163760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0015000 tx=0x7ff7f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.332+0000 7f3181e8b700 1 -- start start 2023-06-09T04:37:18.373 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 -- 172.21.15.149:0/4162844640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c68069db0 msgr2=0x7f1c6806a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 --2- 172.21.15.149:0/4162844640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c68069db0 0x7f1c6806a230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0098f0 tx=0x7f1c5c009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:18.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f14f2250700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f14d006adb0 0x7f14d006d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14dc001ae0 tx=0x7f14dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.374 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 -- 172.21.15.149:0/4162844640 shutdown_connections 2023-06-09T04:37:18.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 --2- 172.21.15.149:0/4162844640 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c68069db0 0x7f1c6806a230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 --2- 172.21.15.149:0/4162844640 >> v2:172.21.15.184:3300/0 conn(0x7f1c680cca40 0x7f1c680711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 -- 172.21.15.149:0/4162844640 >> 172.21.15.149:0/4162844640 conn(0x7f1c6806aec0 msgr2=0x7f1c6806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 -- 172.21.15.149:0/4162844640 shutdown_connections 2023-06-09T04:37:18.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0003df0 con 0x7ff8000c9100 2023-06-09T04:37:18.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f0020070 con 0x7ff8000c9100 2023-06-09T04:37:18.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0011870 con 0x7ff8000c9100 2023-06-09T04:37:18.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f346ad9d700 1 -- 172.21.15.149:0/1377692240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f346c0cf0a0 msgr2=0x7f346c14aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f346ad9d700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f346c0cf0a0 0x7f346c14aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f346ad9d700 1 -- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f346c0b0600 msgr2=0x7f346c148e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:37:18.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f346ad9d700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f346c0b0600 0x7f346c148e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f346ad9d700 1 -- 172.21.15.149:0/1377692240 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600094a0 con 0x7f346c1506c0 2023-06-09T04:37:18.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f346ad9d700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1506c0 0x7f346c150b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f346400c780 tx=0x7f346400ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464003e30 con 0x7f346c1506c0 2023-06-09T04:37:18.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3464005070 con 0x7f346c1506c0 2023-06-09T04:37:18.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464005420 con 0x7f346c1506c0 2023-06-09T04:37:18.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346c151d10 con 0x7f346c1506c0 2023-06-09T04:37:18.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346c1522d0 con 0x7f346c1506c0 2023-06-09T04:37:18.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f3469d9b700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f346c0cf0a0 0x7f346c14aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:18.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f14f1a4f700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6808/2663874778,v1:172.21.15.149:6809/2663874778] conn(0x7f14d0074a80 0x7f14d0076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3181e8b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c06a2f0 0x7f317c0712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3181e8b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f317c0cc6b0 0x7f317c0c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3181e8b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0c1180 0x7f317c146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3181e8b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c14ce00 con 0x7f317c0cc6b0 2023-06-09T04:37:18.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3181e8b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c14dbf0 con 0x7f317c0c1180 2023-06-09T04:37:18.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f3181e8b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317c14cfe0 con 0x7f317c06a2f0 2023-06-09T04:37:18.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8000aefb0 con 0x7ff8000c9100 2023-06-09T04:37:18.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8000af570 con 0x7ff8000c9100 2023-06-09T04:37:18.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f317b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c06a2f0 0x7f317c0712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.380 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f1c6df48700 1 -- 172.21.15.149:0/4162844640 wait complete. 2023-06-09T04:37:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f1c6df48700 1 Processor -- start 2023-06-09T04:37:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f1c6df48700 1 -- start start 2023-06-09T04:37:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff800164c40 con 0x7ff8000c9100 2023-06-09T04:37:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3450000fc0 con 0x7f346c1506c0 2023-06-09T04:37:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3464005580 con 0x7f346c1506c0 2023-06-09T04:37:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff7f0022030 con 0x7ff8000c9100 2023-06-09T04:37:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c6df48700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c68069db0 0x7f1c680c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c6df48700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c680cca40 0x7f1c681481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c6df48700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c6815d7f0 0x7f1c6815a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c6df48700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680b0040 con 0x7f1c68069db0 2023-06-09T04:37:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c6df48700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c68145740 con 0x7f1c6815d7f0 2023-06-09T04:37:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c6df48700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c680c9700 con 0x7f1c680cca40 2023-06-09T04:37:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c6815d7f0 0x7f1c6815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c67fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c6815d7f0 0x7f1c6815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55820/0 (socket says 172.21.15.149:55820) 2023-06-09T04:37:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c66ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c680cca40 0x7f1c681481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f1c67fff700 1 -- 172.21.15.149:0/1650161871 learned_addr learned my addr 172.21.15.149:0/1650161871 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.333+0000 7f65e7bec700 1 -- start start 2023-06-09T04:37:18.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e7bec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00b43f0 0x7f65e00b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e7bec700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f65e00cd430 0x7f65e00d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e7bec700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e00cf690 con 0x7f65e00ccfc0 2023-06-09T04:37:18.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e7bec700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e00d0180 con 0x7f65e00cd430 2023-06-09T04:37:18.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e7bec700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00d0770 con 0x7f65e00b43f0 2023-06-09T04:37:18.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e5988700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00b43f0 0x7f65e00b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e5988700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00b43f0 0x7f65e00b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42156/0 (socket says 172.21.15.149:42156) 2023-06-09T04:37:18.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f65e5988700 1 -- 172.21.15.149:0/1945345863 learned_addr learned my addr 172.21.15.149:0/1945345863 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e5988700 1 -- 172.21.15.149:0/1945345863 >> v2:172.21.15.149:3300/0 conn(0x7f65e00cd430 msgr2=0x7f65e00d1310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:37:18.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e5988700 1 --2- 172.21.15.149:0/1945345863 >> v2:172.21.15.149:3300/0 conn(0x7f65e00cd430 0x7f65e00d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e5988700 1 -- 172.21.15.149:0/1945345863 >> v1:172.21.15.149:6789/0 conn(0x7f65e00ccfc0 legacy=0x7f65e00d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e5988700 1 -- 172.21.15.149:0/1945345863 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00b4d00 con 0x7f65e00b43f0 2023-06-09T04:37:18.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e5988700 1 --2- 172.21.15.149:0/1945345863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00b43f0 0x7f65e00b47c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65dc006fd0 tx=0x7f65dc009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b8a064f1721e5fa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e4986700 1 -- 172.21.15.149:0/1945345863 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc005e30 con 0x7f65e00b43f0 2023-06-09T04:37:18.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e4986700 1 -- 172.21.15.149:0/1945345863 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc004030 con 0x7f65e00b43f0 2023-06-09T04:37:18.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f65e4986700 1 -- 172.21.15.149:0/1945345863 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc0043e0 con 0x7f65e00b43f0 2023-06-09T04:37:18.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f317b7fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c06a2f0 0x7f317c0712a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42154/0 (socket says 172.21.15.149:42154) 2023-06-09T04:37:18.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f317b7fe700 1 -- 172.21.15.149:0/536307718 learned_addr learned my addr 172.21.15.149:0/536307718 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.334+0000 7f317bfff700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0c1180 0x7f317c146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f317bfff700 1 -- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c06a2f0 msgr2=0x7f317c0712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f317bfff700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f317c06a2f0 0x7f317c0712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f317bfff700 1 -- 172.21.15.149:0/536307718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f317c0cc6b0 msgr2=0x7f317c0c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f317bfff700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f317c0cc6b0 0x7f317c0c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f317bfff700 1 -- 172.21.15.149:0/536307718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174009b30 con 0x7f317c0c1180 2023-06-09T04:37:18.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.335+0000 7f317bfff700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0c1180 0x7f317c146970 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3174015000 tx=0x7f3174004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740099b0 con 0x7f317c0c1180 2023-06-09T04:37:18.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3174004250 con 0x7f317c0c1180 2023-06-09T04:37:18.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740045c0 con 0x7f317c0c1180 2023-06-09T04:37:18.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c14d2c0 con 0x7f317c0c1180 2023-06-09T04:37:18.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.336+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c14d880 con 0x7f317c0c1180 2023-06-09T04:37:18.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f345affd700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f344c06ad80 0x7f344c06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3464089cd0 con 0x7f346c1506c0 2023-06-09T04:37:18.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f345affd700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6800/1207338987,v1:172.21.15.149:6801/1207338987] conn(0x7f344c074a50 0x7f344c076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 --> [v2:172.21.15.149:6800/1207338987,v1:172.21.15.149:6801/1207338987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f344c077550 con 0x7f344c074a50 2023-06-09T04:37:18.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f346408a080 con 0x7f346c1506c0 2023-06-09T04:37:18.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f346a59c700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f344c06ad80 0x7f344c06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f3469d9b700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6800/1207338987,v1:172.21.15.149:6801/1207338987] conn(0x7f344c074a50 0x7f344c076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f3469d9b700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6800/1207338987,v1:172.21.15.149:6801/1207338987] conn(0x7f344c074a50 0x7f344c076e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7ff7eeffd700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff7e006ad30 0x7ff7e006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff7f008b9f0 con 0x7ff8000c9100 2023-06-09T04:37:18.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7ff7eeffd700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6816/2598467347,v1:172.21.15.149:6817/2598467347] conn(0x7ff7e0074980 0x7ff7e0076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 --> [v2:172.21.15.149:6816/2598467347,v1:172.21.15.149:6817/2598467347] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7e0077480 con 0x7ff7e0074980 2023-06-09T04:37:18.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7ff7fed9d700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6816/2598467347,v1:172.21.15.149:6817/2598467347] conn(0x7ff7e0074980 0x7ff7e0076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7ff7fed9d700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6816/2598467347,v1:172.21.15.149:6817/2598467347] conn(0x7ff7e0074980 0x7ff7e0076db0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f14f1a4f700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6808/2663874778,v1:172.21.15.149:6809/2663874778] conn(0x7f14d0074a80 0x7f14d0076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f1c66ffd700 1 -- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c6815d7f0 msgr2=0x7f1c6815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f1c66ffd700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c6815d7f0 0x7f1c6815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f1c66ffd700 1 -- 172.21.15.149:0/1650161871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c68069db0 msgr2=0x7f1c680c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f1c66ffd700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c68069db0 0x7f1c680c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f1c66ffd700 1 -- 172.21.15.149:0/1650161871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009550 con 0x7f1c680cca40 2023-06-09T04:37:18.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f1c66ffd700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c680cca40 0x7f1c681481e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1c680cce30 tx=0x7f1c5800b750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58011830 con 0x7f1c680cca40 2023-06-09T04:37:18.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c58011990 con 0x7f1c680cca40 2023-06-09T04:37:18.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58011d40 con 0x7f1c680cca40 2023-06-09T04:37:18.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c68148720 con 0x7f1c680cca40 2023-06-09T04:37:18.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f65e7bec700 1 -- 172.21.15.149:0/1945345863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00b43f0 msgr2=0x7f65e00b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.338+0000 7f65e7bec700 1 --2- 172.21.15.149:0/1945345863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00b43f0 0x7f65e00b47c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65dc006fd0 tx=0x7f65dc009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f65e7bec700 1 -- 172.21.15.149:0/1945345863 shutdown_connections 2023-06-09T04:37:18.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f65e7bec700 1 --2- 172.21.15.149:0/1945345863 >> v2:172.21.15.149:3300/0 conn(0x7f65e00cd430 0x7f65e00d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f65e7bec700 1 --2- 172.21.15.149:0/1945345863 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00b43f0 0x7f65e00b47c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f65e7bec700 1 -- 172.21.15.149:0/1945345863 >> 172.21.15.149:0/1945345863 conn(0x7f65e006afb0 msgr2=0x7f65e006b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7f65e7bec700 1 -- 172.21.15.149:0/1945345863 shutdown_connections 2023-06-09T04:37:18.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.337+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f317c164c40 con 0x7f317c0c1180 2023-06-09T04:37:18.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3174004720 con 0x7f317c0c1180 2023-06-09T04:37:18.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f3163fff700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f316806ad30 0x7f316806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f317408a080 con 0x7f317c0c1180 2023-06-09T04:37:18.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f3163fff700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:6817/2909689851,v1:172.21.15.184:6819/2909689851] conn(0x7f3168074a00 0x7f3168076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 --> [v2:172.21.15.184:6817/2909689851,v1:172.21.15.184:6819/2909689851] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3168077500 con 0x7f3168074a00 2023-06-09T04:37:18.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f317408a400 con 0x7f317c0c1180 2023-06-09T04:37:18.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== osd.2 v2:172.21.15.149:6808/2663874778 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f14d0077580 con 0x7f14d0074a80 2023-06-09T04:37:18.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f346a59c700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f344c06ad80 0x7f344c06d230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f345c0017a0 tx=0x7f345c007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.339+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c680c38a0 con 0x7f1c680cca40 2023-06-09T04:37:18.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== osd.0 v2:172.21.15.149:6800/1207338987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f344c077550 con 0x7f344c074a50 2023-06-09T04:37:18.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7f317b7fe700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f316806ad30 0x7f316806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f0056a40 con 0x7ff8000c9100 2023-06-09T04:37:18.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== osd.1 v2:172.21.15.149:6816/2598467347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff7e0077480 con 0x7ff7e0074980 2023-06-09T04:37:18.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7ff7fe59c700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff7e006ad30 0x7ff7e006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.398 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7ff7fe59c700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff7e006ad30 0x7ff7e006d1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4018fd0 tx=0x7ff7f4018e20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7f65e7bec700 1 -- 172.21.15.149:0/1945345863 wait complete. 2023-06-09T04:37:18.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7f65e7bec700 1 Processor -- start 2023-06-09T04:37:18.399 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7f317b7fe700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f316806ad30 0x7f316806d1e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f317c16b5a0 tx=0x7f3170009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c680c9dd0 con 0x7f1c680cca40 2023-06-09T04:37:18.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7fcf99cea700 1 Processor -- start 2023-06-09T04:37:18.400 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.340+0000 7fcf99cea700 1 -- start start 2023-06-09T04:37:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7fcf99cea700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf9415baf0 0x7fcf940ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7fcf99cea700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9415bec0 0x7fcf940ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7fcf99cea700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9406d570 con 0x7fcf940caeb0 2023-06-09T04:37:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7fcf99cea700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf9406b210 con 0x7fcf9415baf0 2023-06-09T04:37:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.341+0000 7fcf99cea700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940ccc20 con 0x7fcf9415bec0 2023-06-09T04:37:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7fcf937fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf9415baf0 0x7fcf940ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.401 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9415bec0 0x7fcf940ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7fcf937fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf9415baf0 0x7fcf940ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55836/0 (socket says 172.21.15.149:55836) 2023-06-09T04:37:18.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7fcf937fe700 1 -- 172.21.15.149:0/3720859096 learned_addr learned my addr 172.21.15.149:0/3720859096 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9415bec0 0x7fcf940ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42186/0 (socket says 172.21.15.149:42186) 2023-06-09T04:37:18.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.342+0000 7f65e7bec700 1 -- start start 2023-06-09T04:37:18.402 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e7bec700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e00b43f0 0x7f65e015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e7bec700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65e00ccfc0 0x7f65e006df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e7bec700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00cd430 0x7f65e006fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e7bec700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e006f610 con 0x7f65e00ccfc0 2023-06-09T04:37:18.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e7bec700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e006fa30 con 0x7f65e00b43f0 2023-06-09T04:37:18.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e7bec700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e006e990 con 0x7f65e00cd430 2023-06-09T04:37:18.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e5988700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e00b43f0 0x7f65e015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e5988700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e00b43f0 0x7f65e015b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55842/0 (socket says 172.21.15.149:55842) 2023-06-09T04:37:18.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e5988700 1 -- 172.21.15.149:0/555790545 learned_addr learned my addr 172.21.15.149:0/555790545 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.343+0000 7f65e5187700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65e00ccfc0 0x7f65e006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7f65e6189700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00cd430 0x7f65e006fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7f65e5988700 1 -- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00cd430 msgr2=0x7f65e006fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7f65e5988700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65e00cd430 0x7f65e006fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7f65e5988700 1 -- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65e00ccfc0 msgr2=0x7f65e006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7f65e5988700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65e00ccfc0 0x7f65e006df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7f65e5988700 1 -- 172.21.15.149:0/555790545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc009500 con 0x7f65e00b43f0 2023-06-09T04:37:18.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf92ffd700 1 -- 172.21.15.149:0/3720859096 >> v2:172.21.15.184:3300/0 conn(0x7fcf9415baf0 msgr2=0x7fcf940ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf92ffd700 1 --2- 172.21.15.149:0/3720859096 >> v2:172.21.15.184:3300/0 conn(0x7fcf9415baf0 0x7fcf940ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf92ffd700 1 -- 172.21.15.149:0/3720859096 >> v1:172.21.15.149:6789/0 conn(0x7fcf940caeb0 legacy=0x7fcf940ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf92ffd700 1 -- 172.21.15.149:0/3720859096 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9406b420 con 0x7fcf9415bec0 2023-06-09T04:37:18.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf92ffd700 1 --2- 172.21.15.149:0/3720859096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9415bec0 0x7fcf940ce0e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009840 tx=0x7fcf88009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9290220b9f181bb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7f65e5988700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e00b43f0 0x7f65e015b040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65dc004000 tx=0x7f65dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf927fc700 1 -- 172.21.15.149:0/3720859096 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88004230 con 0x7fcf9415bec0 2023-06-09T04:37:18.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf927fc700 1 -- 172.21.15.149:0/3720859096 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf88004390 con 0x7fcf9415bec0 2023-06-09T04:37:18.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.344+0000 7fcf927fc700 1 -- 172.21.15.149:0/3720859096 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880036c0 con 0x7fcf9415bec0 2023-06-09T04:37:18.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.345+0000 7fcf99cea700 1 -- 172.21.15.149:0/3720859096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9415bec0 msgr2=0x7fcf940ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.345+0000 7fcf99cea700 1 --2- 172.21.15.149:0/3720859096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9415bec0 0x7fcf940ce0e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009840 tx=0x7fcf88009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:18.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.345+0000 7fcf99cea700 1 -- 172.21.15.149:0/3720859096 shutdown_connections 2023-06-09T04:37:18.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.345+0000 7fcf99cea700 1 --2- 172.21.15.149:0/3720859096 >> v2:172.21.15.184:3300/0 conn(0x7fcf9415baf0 0x7fcf940ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.345+0000 7fcf99cea700 1 --2- 172.21.15.149:0/3720859096 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf9415bec0 0x7fcf940ce0e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.345+0000 7fcf99cea700 1 -- 172.21.15.149:0/3720859096 >> 172.21.15.149:0/3720859096 conn(0x7fcf940cee30 msgr2=0x7fcf940cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.346+0000 7fcf99cea700 1 -- 172.21.15.149:0/3720859096 shutdown_connections 2023-06-09T04:37:18.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.346+0000 7fcf99cea700 1 -- 172.21.15.149:0/3720859096 wait complete. 2023-06-09T04:37:18.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c5801a400 con 0x7f1c680cca40 2023-06-09T04:37:18.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7fcf99cea700 1 Processor -- start 2023-06-09T04:37:18.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7fcf99cea700 1 -- start start 2023-06-09T04:37:18.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7f1c4ffff700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1c5406ace0 0x7f1c5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c580897d0 con 0x7f1c680cca40 2023-06-09T04:37:18.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7f1c4ffff700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:6800/2011701037,v1:172.21.15.184:6801/2011701037] conn(0x7f1c54074930 0x7f1c54076d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 --> [v2:172.21.15.184:6800/2011701037,v1:172.21.15.184:6801/2011701037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c54077430 con 0x7f1c54074930 2023-06-09T04:37:18.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7f1c677fe700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1c5406ace0 0x7f1c5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.347+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c5808bdf0 con 0x7f1c680cca40 2023-06-09T04:37:18.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7fcf99cea700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf940caeb0 0x7fcf940c1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7fcf99cea700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940c7820 0x7fcf940c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7fcf99cea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf9414c440 0x7fcf940ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7fcf99cea700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf94159300 con 0x7fcf9414c440 2023-06-09T04:37:18.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7fcf99cea700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940c9e20 con 0x7fcf940c7820 2023-06-09T04:37:18.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7fcf99cea700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940c7de0 con 0x7fcf940caeb0 2023-06-09T04:37:18.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940c7820 0x7fcf940c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf92ffd700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940c7820 0x7fcf940c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55854/0 (socket says 172.21.15.149:55854) 2023-06-09T04:37:18.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf92ffd700 1 -- 172.21.15.149:0/1640122450 learned_addr learned my addr 172.21.15.149:0/1640122450 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf93fff700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf9414c440 0x7fcf940ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf93fff700 1 -- 172.21.15.149:0/1640122450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf940caeb0 msgr2=0x7fcf940c1e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:37:18.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf93fff700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf940caeb0 0x7fcf940c1e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf93fff700 1 -- 172.21.15.149:0/1640122450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940c7820 msgr2=0x7fcf940c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf93fff700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf940c7820 0x7fcf940c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7fcf93fff700 1 -- 172.21.15.149:0/1640122450 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880094a0 con 0x7fcf9414c440 2023-06-09T04:37:18.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.350+0000 7fcf93fff700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf9414c440 0x7fcf940ce0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c7b0 tx=0x7fcf8c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7f1c67fff700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:6800/2011701037,v1:172.21.15.184:6801/2011701037] conn(0x7f1c54074930 0x7f1c54076d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7f1c67fff700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:6800/2011701037,v1:172.21.15.184:6801/2011701037] conn(0x7f1c54074930 0x7f1c54076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.350+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== osd.4 v2:172.21.15.184:6800/2011701037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1c54077430 con 0x7f1c54074930 2023-06-09T04:37:18.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc003c30 con 0x7f65e00b43f0 2023-06-09T04:37:18.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc003db0 con 0x7f65e00b43f0 2023-06-09T04:37:18.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc01d670 con 0x7f65e00b43f0 2023-06-09T04:37:18.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e006ec70 con 0x7f65e00b43f0 2023-06-09T04:37:18.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e006f230 con 0x7f65e00b43f0 2023-06-09T04:37:18.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65e00cfbc0 con 0x7f65e00b43f0 2023-06-09T04:37:18.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.350+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65dc01d7d0 con 0x7f65e00b43f0 2023-06-09T04:37:18.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.348+0000 7f317affd700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:6817/2909689851,v1:172.21.15.184:6819/2909689851] conn(0x7f3168074a00 0x7f3168076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7f317affd700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:6817/2909689851,v1:172.21.15.184:6819/2909689851] conn(0x7f3168074a00 0x7f3168076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.349+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== osd.7 v2:172.21.15.184:6817/2909689851 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3168077500 con 0x7f3168074a00 2023-06-09T04:37:18.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.351+0000 7f1c677fe700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1c5406ace0 0x7f1c5406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1c680ca280 tx=0x7f1c60009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.351+0000 7f65d67fc700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f65c406ad30 0x7f65c406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.351+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f65dc08aa10 con 0x7f65e00b43f0 2023-06-09T04:37:18.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.351+0000 7f65e5187700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f65c406ad30 0x7f65c406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.351+0000 7f65d67fc700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:6808/92283709,v1:172.21.15.184:6809/92283709] conn(0x7f65c4074980 0x7f65c4076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.351+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 --> [v2:172.21.15.184:6808/92283709,v1:172.21.15.184:6809/92283709] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65c4077480 con 0x7f65c4074980 2023-06-09T04:37:18.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.351+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65dc055940 con 0x7f65e00b43f0 2023-06-09T04:37:18.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.362+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 --> [v2:172.21.15.149:6816/2598467347,v1:172.21.15.149:6817/2598467347] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff800164960 con 0x7ff7e0074980 2023-06-09T04:37:18.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.352+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c003e10 con 0x7fcf9414c440 2023-06-09T04:37:18.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.352+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c0050f0 con 0x7fcf9414c440 2023-06-09T04:37:18.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.352+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0054a0 con 0x7fcf9414c440 2023-06-09T04:37:18.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.361+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940c80c0 con 0x7fcf9414c440 2023-06-09T04:37:18.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.361+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf940c6280 con 0x7fcf9414c440 2023-06-09T04:37:18.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.362+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf9406daf0 con 0x7fcf9414c440 2023-06-09T04:37:18.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.353+0000 7f65e5187700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f65c406ad30 0x7f65c406d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65d0007fd0 tx=0x7f65d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.353+0000 7f65e6189700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:6808/92283709,v1:172.21.15.184:6809/92283709] conn(0x7f65c4074980 0x7f65c4076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.353+0000 7f65e6189700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:6808/92283709,v1:172.21.15.184:6809/92283709] conn(0x7f65c4074980 0x7f65c4076db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.354+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== osd.5 v2:172.21.15.184:6808/92283709 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f65c4077480 con 0x7f65c4074980 2023-06-09T04:37:18.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.359+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 --> [v2:172.21.15.184:6816/966994911,v1:172.21.15.184:6818/966994911] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9874002d40 con 0x7f9880074930 2023-06-09T04:37:18.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.359+0000 7f987bfff700 1 -- 172.21.15.149:0/1429706334 <== osd.6 v2:172.21.15.184:6816/966994911 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9874002d40 con 0x7f9880074930 2023-06-09T04:37:18.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:6816/966994911,v1:172.21.15.184:6818/966994911] conn(0x7f9880074930 msgr2=0x7f9880076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.184:6816/966994911,v1:172.21.15.184:6818/966994911] conn(0x7f9880074930 0x7f9880076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f988006ace0 msgr2=0x7f988006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f988006ace0 0x7f988006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f988800bd60 tx=0x7f9888013000 comp rx=0 tx=0).stop 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0700 msgr2=0x7f98940c3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 --2- 172.21.15.149:0/1429706334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f98940b0700 0x7f98940c3df0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f988400c450 tx=0x7f988400c760 comp rx=0 tx=0).stop 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9893fff700 1 -- 172.21.15.149:0/1429706334 reap_dead start 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 shutdown_connections 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.360+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 >> 172.21.15.149:0/1429706334 conn(0x7f98940ce5c0 msgr2=0x7f98940af150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.361+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 shutdown_connections 2023-06-09T04:37:18.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.361+0000 7f9899def700 1 -- 172.21.15.149:0/1429706334 wait complete. 2023-06-09T04:37:18.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.364+0000 7ff7eeffd700 1 -- 172.21.15.149:0/397682166 <== osd.1 v2:172.21.15.149:6816/2598467347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff7f8001e50 con 0x7ff7e0074980 2023-06-09T04:37:18.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.363+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf8c005600 con 0x7fcf9414c440 2023-06-09T04:37:18.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.364+0000 7fcf7bfff700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf8006adb0 0x7fcf8006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.364+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf8c088d70 con 0x7fcf9414c440 2023-06-09T04:37:18.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.364+0000 7fcf7bfff700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6824/132658488,v1:172.21.15.149:6825/132658488] conn(0x7fcf80074a80 0x7fcf80076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.364+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 --> [v2:172.21.15.149:6824/132658488,v1:172.21.15.149:6825/132658488] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf80077580 con 0x7fcf80074a80 2023-06-09T04:37:18.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.364+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf8c08b390 con 0x7fcf9414c440 2023-06-09T04:37:18.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.365+0000 7fcf937fe700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf8006adb0 0x7fcf8006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.365+0000 7fcf937fe700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf8006adb0 0x7fcf8006d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf94071920 tx=0x7fcf840092c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.369+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 --> [v2:172.21.15.149:6808/2663874778,v1:172.21.15.149:6809/2663874778] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14d4002d40 con 0x7f14d0074a80 2023-06-09T04:37:18.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.369+0000 7f14e2ffd700 1 -- 172.21.15.149:0/112418705 <== osd.2 v2:172.21.15.149:6808/2663874778 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14d4002d40 con 0x7f14d0074a80 2023-06-09T04:37:18.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6808/2663874778,v1:172.21.15.149:6809/2663874778] conn(0x7f14d0074a80 msgr2=0x7f14d0076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6808/2663874778,v1:172.21.15.149:6809/2663874778] conn(0x7f14d0074a80 0x7f14d0076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f14d006adb0 msgr2=0x7f14d006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f14d006adb0 0x7f14d006d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f14dc001ae0 tx=0x7f14dc009040 comp rx=0 tx=0).stop 2023-06-09T04:37:18.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec162ee0 msgr2=0x7f14ec163380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 --2- 172.21.15.149:0/112418705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14ec162ee0 0x7f14ec163380 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0725e0 tx=0x7f14e4001650 comp rx=0 tx=0).stop 2023-06-09T04:37:18.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f2a51700 1 -- 172.21.15.149:0/112418705 reap_dead start 2023-06-09T04:37:18.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 shutdown_connections 2023-06-09T04:37:18.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.370+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 >> 172.21.15.149:0/112418705 conn(0x7f14ec0ce5c0 msgr2=0x7f14ec0af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.372+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 shutdown_connections 2023-06-09T04:37:18.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.372+0000 7f14f44b4700 1 -- 172.21.15.149:0/112418705 wait complete. 2023-06-09T04:37:18.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.373+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 --> [v2:172.21.15.149:6800/1207338987,v1:172.21.15.149:6801/1207338987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3450002d40 con 0x7f344c074a50 2023-06-09T04:37:18.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6816/2598467347,v1:172.21.15.149:6817/2598467347] conn(0x7ff7e0074980 msgr2=0x7ff7e0076db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff804ff1700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6816/2598467347,v1:172.21.15.149:6817/2598467347] conn(0x7ff7e0074980 0x7ff7e0076db0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.373+0000 7fcf92ffd700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6824/132658488,v1:172.21.15.149:6825/132658488] conn(0x7fcf80074a80 0x7fcf80076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7fcf92ffd700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6824/132658488,v1:172.21.15.149:6825/132658488] conn(0x7fcf80074a80 0x7fcf80076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff7e006ad30 msgr2=0x7ff7e006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff804ff1700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff7e006ad30 0x7ff7e006d1e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4018fd0 tx=0x7ff7f4018e20 comp rx=0 tx=0).stop 2023-06-09T04:37:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8000c9100 msgr2=0x7ff800163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff804ff1700 1 --2- 172.21.15.149:0/397682166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff8000c9100 0x7ff800163760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0015000 tx=0x7ff7f0004750 comp rx=0 tx=0).stop 2023-06-09T04:37:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff7fed9d700 1 -- 172.21.15.149:0/397682166 reap_dead start 2023-06-09T04:37:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.375+0000 7f345affd700 1 -- 172.21.15.149:0/1377692240 <== osd.0 v2:172.21.15.149:6800/1207338987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3450002d40 con 0x7f344c074a50 2023-06-09T04:37:18.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.374+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 shutdown_connections 2023-06-09T04:37:18.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.375+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 >> 172.21.15.149:0/397682166 conn(0x7ff8000cf250 msgr2=0x7ff8000b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.376+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== osd.3 v2:172.21.15.149:6824/132658488 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcf80077580 con 0x7fcf80074a80 2023-06-09T04:37:18.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.377+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 shutdown_connections 2023-06-09T04:37:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.378+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6800/1207338987,v1:172.21.15.149:6801/1207338987] conn(0x7f344c074a50 msgr2=0x7f344c076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.378+0000 7f3470e45700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6800/1207338987,v1:172.21.15.149:6801/1207338987] conn(0x7f344c074a50 0x7f344c076e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.378+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 --> [v2:172.21.15.184:6800/2011701037,v1:172.21.15.184:6801/2011701037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c68071dc0 con 0x7f1c54074930 2023-06-09T04:37:18.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.379+0000 7f1c4ffff700 1 -- 172.21.15.149:0/1650161871 <== osd.4 v2:172.21.15.184:6800/2011701037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c5c0036a0 con 0x7f1c54074930 2023-06-09T04:37:18.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 --> [v2:172.21.15.184:6817/2909689851,v1:172.21.15.184:6819/2909689851] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f317c164960 con 0x7f3168074a00 2023-06-09T04:37:18.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:6800/2011701037,v1:172.21.15.184:6801/2011701037] conn(0x7f1c54074930 msgr2=0x7f1c54076d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:6800/2011701037,v1:172.21.15.184:6801/2011701037] conn(0x7f1c54074930 0x7f1c54076d60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1c5406ace0 msgr2=0x7f1c5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1c5406ace0 0x7f1c5406d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1c680ca280 tx=0x7f1c60009250 comp rx=0 tx=0).stop 2023-06-09T04:37:18.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c680cca40 msgr2=0x7f1c681481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 --2- 172.21.15.149:0/1650161871 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1c680cca40 0x7f1c681481e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1c680cce30 tx=0x7f1c5800b750 comp rx=0 tx=0).stop 2023-06-09T04:37:18.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c67fff700 1 -- 172.21.15.149:0/1650161871 reap_dead start 2023-06-09T04:37:18.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 shutdown_connections 2023-06-09T04:37:18.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 >> 172.21.15.149:0/1650161871 conn(0x7f1c6806aec0 msgr2=0x7f1c6806eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7ff804ff1700 1 -- 172.21.15.149:0/397682166 wait complete. 2023-06-09T04:37:18.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.380+0000 7f3163fff700 1 -- 172.21.15.149:0/536307718 <== osd.7 v2:172.21.15.184:6817/2909689851 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f316c0094c0 con 0x7f3168074a00 2023-06-09T04:37:18.435 INFO:teuthology.orchestra.run.smithi149.stdout:64424509449 2023-06-09T04:37:18.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:37:18.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.382+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:6817/2909689851,v1:172.21.15.184:6819/2909689851] conn(0x7f3168074a00 msgr2=0x7f3168076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.382+0000 7f3181e8b700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:6817/2909689851,v1:172.21.15.184:6819/2909689851] conn(0x7f3168074a00 0x7f3168076e30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.382+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f316806ad30 msgr2=0x7f316806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.382+0000 7f3181e8b700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f316806ad30 0x7f316806d1e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f317c16b5a0 tx=0x7f3170009210 comp rx=0 tx=0).stop 2023-06-09T04:37:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.382+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0c1180 msgr2=0x7f317c146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.382+0000 7f3181e8b700 1 --2- 172.21.15.149:0/536307718 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f317c0c1180 0x7f317c146970 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3174015000 tx=0x7f3174004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.382+0000 7f317bfff700 1 -- 172.21.15.149:0/536307718 reap_dead start 2023-06-09T04:37:18.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f344c06ad80 msgr2=0x7f344c06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3470e45700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f344c06ad80 0x7f344c06d230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f345c0017a0 tx=0x7f345c007a30 comp rx=0 tx=0).stop 2023-06-09T04:37:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1506c0 msgr2=0x7f346c150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3470e45700 1 --2- 172.21.15.149:0/1377692240 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f346c1506c0 0x7f346c150b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f346400c780 tx=0x7f346400ca90 comp rx=0 tx=0).stop 2023-06-09T04:37:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 shutdown_connections 2023-06-09T04:37:18.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 >> 172.21.15.149:0/536307718 conn(0x7f317c0cf250 msgr2=0x7f317c0b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 --> [v2:172.21.15.184:6808/92283709,v1:172.21.15.184:6809/92283709] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65e00cf8e0 con 0x7f65c4074980 2023-06-09T04:37:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 shutdown_connections 2023-06-09T04:37:18.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.384+0000 7f3181e8b700 1 -- 172.21.15.149:0/536307718 wait complete. 2023-06-09T04:37:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.385+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 shutdown_connections 2023-06-09T04:37:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.385+0000 7f1c6df48700 1 -- 172.21.15.149:0/1650161871 wait complete. 2023-06-09T04:37:18.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.385+0000 7f65d67fc700 1 -- 172.21.15.149:0/555790545 <== osd.5 v2:172.21.15.184:6808/92283709 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65d8009bb0 con 0x7f65c4074980 2023-06-09T04:37:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.388+0000 7f346ad9d700 1 -- 172.21.15.149:0/1377692240 reap_dead start 2023-06-09T04:37:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.388+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 shutdown_connections 2023-06-09T04:37:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.388+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 >> 172.21.15.149:0/1377692240 conn(0x7f346c0ce5c0 msgr2=0x7f346c0ae180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:6808/92283709,v1:172.21.15.184:6809/92283709] conn(0x7f65c4074980 msgr2=0x7f65c4076db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:6808/92283709,v1:172.21.15.184:6809/92283709] conn(0x7f65c4074980 0x7f65c4076db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f65c406ad30 msgr2=0x7f65c406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f65c406ad30 0x7f65c406d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f65d0007fd0 tx=0x7f65d0009040 comp rx=0 tx=0).stop 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e00b43f0 msgr2=0x7f65e015b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 --2- 172.21.15.149:0/555790545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65e00b43f0 0x7f65e015b040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65dc004000 tx=0x7f65dc004750 comp rx=0 tx=0).stop 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e6189700 1 -- 172.21.15.149:0/555790545 reap_dead start 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 shutdown_connections 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 >> 172.21.15.149:0/555790545 conn(0x7f65e006afb0 msgr2=0x7f65e00b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 shutdown_connections 2023-06-09T04:37:18.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.387+0000 7f65e7bec700 1 -- 172.21.15.149:0/555790545 wait complete. 2023-06-09T04:37:18.443 INFO:teuthology.orchestra.run.smithi149.stdout:64424509449 2023-06-09T04:37:18.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:37:18.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.395+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 shutdown_connections 2023-06-09T04:37:18.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.400+0000 7f3470e45700 1 -- 172.21.15.149:0/1377692240 wait complete. 2023-06-09T04:37:18.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.401+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 --> [v2:172.21.15.149:6824/132658488,v1:172.21.15.149:6825/132658488] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf9406d810 con 0x7fcf80074a80 2023-06-09T04:37:18.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.401+0000 7fcf7bfff700 1 -- 172.21.15.149:0/1640122450 <== osd.3 v2:172.21.15.149:6824/132658488 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf880036a0 con 0x7fcf80074a80 2023-06-09T04:37:18.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6824/132658488,v1:172.21.15.149:6825/132658488] conn(0x7fcf80074a80 msgr2=0x7fcf80076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6824/132658488,v1:172.21.15.149:6825/132658488] conn(0x7fcf80074a80 0x7fcf80076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf8006adb0 msgr2=0x7fcf8006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf8006adb0 0x7fcf8006d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcf94071920 tx=0x7fcf840092c0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf9414c440 msgr2=0x7fcf940ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 --2- 172.21.15.149:0/1640122450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf9414c440 0x7fcf940ce0a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c7b0 tx=0x7fcf8c00cac0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf93fff700 1 -- 172.21.15.149:0/1640122450 reap_dead start 2023-06-09T04:37:18.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 shutdown_connections 2023-06-09T04:37:18.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 >> 172.21.15.149:0/1640122450 conn(0x7fcf940cee30 msgr2=0x7fcf940afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.402+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 shutdown_connections 2023-06-09T04:37:18.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.403+0000 7fcf99cea700 1 -- 172.21.15.149:0/1640122450 wait complete. 2023-06-09T04:37:18.448 INFO:teuthology.orchestra.run.smithi149.stdout:60129542155 2023-06-09T04:37:18.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:37:18.449 INFO:teuthology.orchestra.run.smithi149.stdout:64424509449 2023-06-09T04:37:18.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:37:18.450 INFO:teuthology.orchestra.run.smithi149.stdout:60129542155 2023-06-09T04:37:18.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:37:18.451 INFO:teuthology.orchestra.run.smithi149.stdout:60129542153 2023-06-09T04:37:18.451 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:37:18.452 INFO:teuthology.orchestra.run.smithi149.stdout:64424509451 2023-06-09T04:37:18.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:37:18.453 INFO:teuthology.orchestra.run.smithi149.stdout:60129542154 2023-06-09T04:37:18.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:37:18.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.684+0000 7fc7d3536700 1 Processor -- start 2023-06-09T04:37:18.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.685+0000 7fc7d3536700 1 -- start start 2023-06-09T04:37:18.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.686+0000 7fc7d3536700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc7cc0b02a0 0x7fc7cc1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.686+0000 7fc7d3536700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc7cc0cf0a0 0x7fc7cc0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.686+0000 7fc7d3536700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7cc06ffe0 con 0x7fc7cc0c8b80 2023-06-09T04:37:18.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.686+0000 7fc7d3536700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc156140 con 0x7fc7cc0b02a0 2023-06-09T04:37:18.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.686+0000 7fc7d3536700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7cc0c9670 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d1ad3700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc7cc0c8b80 0x7fc7cc069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:38234/0 (socket says 172.21.15.149:38234) 2023-06-09T04:37:18.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d1ad3700 1 -- 172.21.15.149:0/4165228728 learned_addr learned my addr 172.21.15.149:0/4165228728 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d0ad1700 1 --2- 172.21.15.149:0/4165228728 >> v2:172.21.15.184:3300/0 conn(0x7fc7cc0cf0a0 0x7fc7cc0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d12d2700 1 --2- 172.21.15.149:0/4165228728 >> v2:172.21.15.149:3300/0 conn(0x7fc7cc0b02a0 0x7fc7cc1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d12d2700 1 -- 172.21.15.149:0/4165228728 >> v2:172.21.15.184:3300/0 conn(0x7fc7cc0cf0a0 msgr2=0x7fc7cc0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d12d2700 1 --2- 172.21.15.149:0/4165228728 >> v2:172.21.15.184:3300/0 conn(0x7fc7cc0cf0a0 0x7fc7cc0b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d12d2700 1 -- 172.21.15.149:0/4165228728 >> v1:172.21.15.184:6789/0 conn(0x7fc7cc0c8b80 legacy=0x7fc7cc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.687+0000 7fc7d12d2700 1 -- 172.21.15.149:0/4165228728 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7cc0c9390 con 0x7fc7cc0b02a0 2023-06-09T04:37:18.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.688+0000 7fc7d12d2700 1 --2- 172.21.15.149:0/4165228728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0b02a0 0x7fc7cc1592c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0cb010 tx=0x7fc7c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945cb718d4811bf4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.691+0000 7fc7c3fff700 1 -- 172.21.15.149:0/4165228728 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400e070 con 0x7fc7cc0b02a0 2023-06-09T04:37:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.691+0000 7fc7c3fff700 1 -- 172.21.15.149:0/4165228728 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400bbd0 con 0x7fc7cc0b02a0 2023-06-09T04:37:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.691+0000 7fc7c3fff700 1 -- 172.21.15.149:0/4165228728 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4012430 con 0x7fc7cc0b02a0 2023-06-09T04:37:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.692+0000 7fc7d3536700 1 -- 172.21.15.149:0/4165228728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0b02a0 msgr2=0x7fc7cc1592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.692+0000 7fc7d3536700 1 --2- 172.21.15.149:0/4165228728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0b02a0 0x7fc7cc1592c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0cb010 tx=0x7fc7c400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.692+0000 7fc7d3536700 1 -- 172.21.15.149:0/4165228728 shutdown_connections 2023-06-09T04:37:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.692+0000 7fc7d3536700 1 --2- 172.21.15.149:0/4165228728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0b02a0 0x7fc7cc1592c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.692+0000 7fc7d3536700 1 --2- 172.21.15.149:0/4165228728 >> v2:172.21.15.184:3300/0 conn(0x7fc7cc0cf0a0 0x7fc7cc0b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.692+0000 7fc7d3536700 1 -- 172.21.15.149:0/4165228728 >> 172.21.15.149:0/4165228728 conn(0x7fc7cc0ce5c0 msgr2=0x7fc7cc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.693+0000 7fc7d3536700 1 -- 172.21.15.149:0/4165228728 shutdown_connections 2023-06-09T04:37:18.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.693+0000 7fc7d3536700 1 -- 172.21.15.149:0/4165228728 wait complete. 2023-06-09T04:37:18.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.694+0000 7fc7d3536700 1 Processor -- start 2023-06-09T04:37:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.695+0000 7fc7d3536700 1 -- start start 2023-06-09T04:37:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d3536700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7cc0b02a0 0x7fc7cc14cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d3536700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0c8b80 0x7fc7cc0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d3536700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7cc0cf0a0 0x7fc7cc0c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d3536700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc14d2a0 con 0x7fc7cc0c8b80 2023-06-09T04:37:18.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d3536700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0b26e0 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d3536700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7cc0b29c0 con 0x7fc7cc0b02a0 2023-06-09T04:37:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d1ad3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7cc0cf0a0 0x7fc7cc0c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d1ad3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7cc0cf0a0 0x7fc7cc0c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55872/0 (socket says 172.21.15.149:55872) 2023-06-09T04:37:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.696+0000 7fc7d1ad3700 1 -- 172.21.15.149:0/3752107412 learned_addr learned my addr 172.21.15.149:0/3752107412 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7d1ad3700 1 -- 172.21.15.149:0/3752107412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7cc0b02a0 msgr2=0x7fc7cc14cd60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:37:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7d1ad3700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7cc0b02a0 0x7fc7cc14cd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7d1ad3700 1 -- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0c8b80 msgr2=0x7fc7cc0c5600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:37:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7d1ad3700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0c8b80 0x7fc7cc0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7d1ad3700 1 -- 172.21.15.149:0/3752107412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4009a70 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7d1ad3700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7cc0cf0a0 0x7fc7cc0c2a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c370 tx=0x7fc7c800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7c1ffb700 1 -- 172.21.15.149:0/3752107412 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8005d70 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7c1ffb700 1 -- 172.21.15.149:0/3752107412 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c800ce80 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7c1ffb700 1 -- 172.21.15.149:0/3752107412 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8007310 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.697+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7cc0b2ca0 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.698+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc0b3260 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.699+0000 7ff630a76700 1 Processor -- start 2023-06-09T04:37:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.700+0000 7ff630a76700 1 -- start start 2023-06-09T04:37:18.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.700+0000 7f0ab00a7700 1 Processor -- start 2023-06-09T04:37:18.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff630a76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff62c0c9c40 0x7ff62c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff630a76700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff62c0cc100 0x7ff62c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff630a76700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c0ce230 con 0x7ff62c0cc570 2023-06-09T04:37:18.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff630a76700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c160c90 con 0x7ff62c0c9c40 2023-06-09T04:37:18.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff630a76700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff62c15fdc0 con 0x7ff62c0cc100 2023-06-09T04:37:18.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.699+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7cc0b3480 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.700+0000 7fc7c1ffb700 1 -- 172.21.15.149:0/3752107412 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7c8007470 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7fc7c1ffb700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc7b006ace0 0x7fc7b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7fc7c1ffb700 1 -- 172.21.15.149:0/3752107412 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc7c8088be0 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7fc7d12d2700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc7b006ace0 0x7fc7b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.700+0000 7f0ab00a7700 1 -- start start 2023-06-09T04:37:18.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7f0ab00a7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0aa80b0700 0x7f0aa81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0ab00a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0ab00a7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa806ffe0 con 0x7f0aa80b0330 2023-06-09T04:37:18.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0ab00a7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa8156140 con 0x7f0aa80b0700 2023-06-09T04:37:18.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0ab00a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80c9670 con 0x7f0aa80cd290 2023-06-09T04:37:18.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff62a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff62c0c9c40 0x7ff62c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff62a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff62c0c9c40 0x7ff62c0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36614/0 (socket says 172.21.15.149:36614) 2023-06-09T04:37:18.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff62a59c700 1 -- 172.21.15.149:0/861402403 learned_addr learned my addr 172.21.15.149:0/861402403 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff62a59c700 1 -- 172.21.15.149:0/861402403 >> v2:172.21.15.184:3300/0 conn(0x7ff62c0cc100 msgr2=0x7ff62c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff62a59c700 1 --2- 172.21.15.149:0/861402403 >> v2:172.21.15.184:3300/0 conn(0x7ff62c0cc100 0x7ff62c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff62a59c700 1 -- 172.21.15.149:0/861402403 >> v1:172.21.15.184:6789/0 conn(0x7ff62c0cc570 legacy=0x7ff62c15c9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:37:18.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.701+0000 7ff62a59c700 1 -- 172.21.15.149:0/861402403 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c160010 con 0x7ff62c0c9c40 2023-06-09T04:37:18.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7ff62a59c700 1 --2- 172.21.15.149:0/861402403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0c9c40 0x7ff62c0c8d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff6140098f0 tx=0x7ff614009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19911248204abe56 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0aae644700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0aae644700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42236/0 (socket says 172.21.15.149:42236) 2023-06-09T04:37:18.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0aae644700 1 -- 172.21.15.149:0/1018578232 learned_addr learned my addr 172.21.15.149:0/1018578232 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7fc7d12d2700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc7b006ace0 0x7fc7b006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400b370 tx=0x7fc7c4011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7ff62959a700 1 -- 172.21.15.149:0/861402403 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614004230 con 0x7ff62c0c9c40 2023-06-09T04:37:18.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7ff62959a700 1 -- 172.21.15.149:0/861402403 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614004390 con 0x7ff62c0c9c40 2023-06-09T04:37:18.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7ff62959a700 1 -- 172.21.15.149:0/861402403 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140036a0 con 0x7ff62c0c9c40 2023-06-09T04:37:18.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.702+0000 7f0aad642700 1 --2- 172.21.15.149:0/1018578232 >> v2:172.21.15.149:3300/0 conn(0x7f0aa80b0700 0x7f0aa81592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aad642700 1 -- 172.21.15.149:0/1018578232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 msgr2=0x7f0aa80cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aad642700 1 --2- 172.21.15.149:0/1018578232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aad642700 1 -- 172.21.15.149:0/1018578232 >> v1:172.21.15.184:6789/0 conn(0x7f0aa80b0330 legacy=0x7f0aa80c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aad642700 1 -- 172.21.15.149:0/1018578232 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80c9390 con 0x7f0aa80b0700 2023-06-09T04:37:18.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7ff630a76700 1 -- 172.21.15.149:0/861402403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0c9c40 msgr2=0x7ff62c0c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7ff630a76700 1 --2- 172.21.15.149:0/861402403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0c9c40 0x7ff62c0c8d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff6140098f0 tx=0x7ff614009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:18.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aad642700 1 --2- 172.21.15.149:0/1018578232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 0x7f0aa81592c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400bae0 tx=0x7f0aa400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8680c102c430aae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7ff630a76700 1 -- 172.21.15.149:0/861402403 shutdown_connections 2023-06-09T04:37:18.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7ff630a76700 1 --2- 172.21.15.149:0/861402403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0c9c40 0x7ff62c0c8d40 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff6140098f0 tx=0x7ff614009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:18.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7ff630a76700 1 --2- 172.21.15.149:0/861402403 >> v2:172.21.15.184:3300/0 conn(0x7ff62c0cc100 0x7ff62c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7ff630a76700 1 -- 172.21.15.149:0/861402403 >> 172.21.15.149:0/861402403 conn(0x7ff62c0cf250 msgr2=0x7ff62c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7faeb85db700 1 Processor -- start 2023-06-09T04:37:18.711 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.704+0000 7faeb85db700 1 -- start start 2023-06-09T04:37:18.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aace41700 1 -- 172.21.15.149:0/1018578232 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400dc70 con 0x7f0aa80b0700 2023-06-09T04:37:18.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aace41700 1 -- 172.21.15.149:0/1018578232 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400ddd0 con 0x7f0aa80b0700 2023-06-09T04:37:18.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.703+0000 7f0aace41700 1 -- 172.21.15.149:0/1018578232 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4010690 con 0x7f0aa80b0700 2023-06-09T04:37:18.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.704+0000 7f0ab00a7700 1 -- 172.21.15.149:0/1018578232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 msgr2=0x7f0aa81592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.704+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/1018578232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 0x7f0aa81592c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400bae0 tx=0x7f0aa400bdf0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.712 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.704+0000 7f0ab00a7700 1 -- 172.21.15.149:0/1018578232 shutdown_connections 2023-06-09T04:37:18.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/1018578232 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/1018578232 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 0x7f0aa81592c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7f0ab00a7700 1 -- 172.21.15.149:0/1018578232 >> 172.21.15.149:0/1018578232 conn(0x7f0aa80ce5c0 msgr2=0x7f0aa80ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb85db700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faeb00cdd70 0x7faeb0160600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb85db700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faeb00b00c0 0x7faeb00b0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.713 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb85db700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb00706d0 con 0x7faeb0069db0 2023-06-09T04:37:18.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb85db700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb00ce140 con 0x7faeb00cdd70 2023-06-09T04:37:18.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb85db700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb00b0aa0 con 0x7faeb00b00c0 2023-06-09T04:37:18.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7f0ab00a7700 1 -- 172.21.15.149:0/1018578232 shutdown_connections 2023-06-09T04:37:18.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb6377700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faeb00cdd70 0x7faeb0160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb6377700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faeb00cdd70 0x7faeb0160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36628/0 (socket says 172.21.15.149:36628) 2023-06-09T04:37:18.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb6377700 1 -- 172.21.15.149:0/3637253331 learned_addr learned my addr 172.21.15.149:0/3637253331 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb6b78700 1 --1- 172.21.15.149:0/3637253331 >> v1:172.21.15.184:6789/0 conn(0x7faeb0069db0 0x7faeb006a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:38260/0 (socket says 172.21.15.149:38260) 2023-06-09T04:37:18.715 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb5b76700 1 --2- 172.21.15.149:0/3637253331 >> v2:172.21.15.184:3300/0 conn(0x7faeb00b00c0 0x7faeb00b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb5b76700 1 -- 172.21.15.149:0/3637253331 >> v2:172.21.15.149:3300/0 conn(0x7faeb00cdd70 msgr2=0x7faeb0160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb5b76700 1 --2- 172.21.15.149:0/3637253331 >> v2:172.21.15.149:3300/0 conn(0x7faeb00cdd70 0x7faeb0160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb5b76700 1 -- 172.21.15.149:0/3637253331 >> v1:172.21.15.184:6789/0 conn(0x7faeb0069db0 legacy=0x7faeb006a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb5b76700 1 -- 172.21.15.149:0/3637253331 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0160b40 con 0x7faeb00b00c0 2023-06-09T04:37:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7faeb5b76700 1 --2- 172.21.15.149:0/3637253331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00b00c0 0x7faeb00b0560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faea0009840 tx=0x7faea0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b977b511def0a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.706+0000 7faeb5375700 1 -- 172.21.15.149:0/3637253331 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0011830 con 0x7faeb00b00c0 2023-06-09T04:37:18.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.706+0000 7faeb5375700 1 -- 172.21.15.149:0/3637253331 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea0011990 con 0x7faeb00b00c0 2023-06-09T04:37:18.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.706+0000 7faeb5375700 1 -- 172.21.15.149:0/3637253331 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0011d20 con 0x7faeb00b00c0 2023-06-09T04:37:18.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.706+0000 7fc7c1ffb700 1 -- 172.21.15.149:0/3752107412 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7c8053880 con 0x7fc7cc0cf0a0 2023-06-09T04:37:18.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.705+0000 7f0ab00a7700 1 -- 172.21.15.149:0/1018578232 wait complete. 2023-06-09T04:37:18.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7f0ab00a7700 1 Processor -- start 2023-06-09T04:37:18.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7faeb85db700 1 -- 172.21.15.149:0/3637253331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00b00c0 msgr2=0x7faeb00b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7faeb85db700 1 --2- 172.21.15.149:0/3637253331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00b00c0 0x7faeb00b0560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faea0009840 tx=0x7faea0009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:18.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7faeb85db700 1 -- 172.21.15.149:0/3637253331 shutdown_connections 2023-06-09T04:37:18.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7faeb85db700 1 --2- 172.21.15.149:0/3637253331 >> v2:172.21.15.149:3300/0 conn(0x7faeb00cdd70 0x7faeb0160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7faeb85db700 1 --2- 172.21.15.149:0/3637253331 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00b00c0 0x7faeb00b0560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7faeb85db700 1 -- 172.21.15.149:0/3637253331 >> 172.21.15.149:0/3637253331 conn(0x7faeb00ce5c0 msgr2=0x7faeb00ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.707+0000 7f0ab00a7700 1 -- start start 2023-06-09T04:37:18.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f748f266700 1 Processor -- start 2023-06-09T04:37:18.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0ab00a7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa80b0330 0x7f0aa80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0ab00a7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 0x7f0aa80af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0ab00a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0ab00a7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8149640 con 0x7f0aa80b0700 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0ab00a7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80c2060 con 0x7f0aa80b0330 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0ab00a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80c2320 con 0x7f0aa80cd290 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0aade43700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa80b0330 0x7f0aa80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0aade43700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa80b0330 0x7f0aa80b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55898/0 (socket says 172.21.15.149:55898) 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0aade43700 1 -- 172.21.15.149:0/2943683407 learned_addr learned my addr 172.21.15.149:0/2943683407 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f0aae644700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0aade43700 1 -- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 msgr2=0x7f0aa80af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0aade43700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0aade43700 1 -- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 msgr2=0x7f0aa80af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0aade43700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 0x7f0aa80af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0aade43700 1 -- 172.21.15.149:0/2943683407 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa400b740 con 0x7f0aa80b0330 2023-06-09T04:37:18.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0aade43700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa80b0330 0x7f0aa80b2a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c450 tx=0x7f0a9800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0a9e7fc700 1 -- 172.21.15.149:0/2943683407 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a980052d0 con 0x7f0aa80b0330 2023-06-09T04:37:18.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0a9e7fc700 1 -- 172.21.15.149:0/2943683407 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98005430 con 0x7f0aa80b0330 2023-06-09T04:37:18.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f0a9e7fc700 1 -- 172.21.15.149:0/2943683407 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a980038c0 con 0x7f0aa80b0330 2023-06-09T04:37:18.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.708+0000 7f748f266700 1 -- start start 2023-06-09T04:37:18.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748f266700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f748815e060 0x7f7488164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748f266700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f74881616f0 0x7f74880ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748f266700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7488161260 con 0x7f74880ad7d0 2023-06-09T04:37:18.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748f266700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7488161b40 con 0x7f748815e060 2023-06-09T04:37:18.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748f266700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880cec90 con 0x7f74881616f0 2023-06-09T04:37:18.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748d002700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f748815e060 0x7f7488164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748d002700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f748815e060 0x7f7488164cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36640/0 (socket says 172.21.15.149:36640) 2023-06-09T04:37:18.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748d002700 1 -- 172.21.15.149:0/1164484979 learned_addr learned my addr 172.21.15.149:0/1164484979 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.709+0000 7f748c801700 1 --2- 172.21.15.149:0/1164484979 >> v2:172.21.15.184:3300/0 conn(0x7f74881616f0 0x7f74880ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa80c2600 con 0x7f0aa80b0330 2023-06-09T04:37:18.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa80c2bc0 con 0x7f0aa80b0330 2023-06-09T04:37:18.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7faeb85db700 1 -- 172.21.15.149:0/3637253331 shutdown_connections 2023-06-09T04:37:18.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7f748d002700 1 -- 172.21.15.149:0/1164484979 >> v2:172.21.15.184:3300/0 conn(0x7f74881616f0 msgr2=0x7f74880ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7f748d002700 1 --2- 172.21.15.149:0/1164484979 >> v2:172.21.15.184:3300/0 conn(0x7f74881616f0 0x7f74880ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7f748d002700 1 -- 172.21.15.149:0/1164484979 >> v1:172.21.15.184:6789/0 conn(0x7f74880ad7d0 legacy=0x7f748806c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7f748d002700 1 -- 172.21.15.149:0/1164484979 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880cef60 con 0x7f748815e060 2023-06-09T04:37:18.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7f748d002700 1 --2- 172.21.15.149:0/1164484979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748815e060 0x7f7488164cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74880ae590 tx=0x7f7484009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb822287ab4d1560 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.711+0000 7f747ffff700 1 -- 172.21.15.149:0/1164484979 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484004230 con 0x7f748815e060 2023-06-09T04:37:18.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.711+0000 7f747ffff700 1 -- 172.21.15.149:0/1164484979 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7484004390 con 0x7f748815e060 2023-06-09T04:37:18.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.711+0000 7f747ffff700 1 -- 172.21.15.149:0/1164484979 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840036a0 con 0x7f748815e060 2023-06-09T04:37:18.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7ff630a76700 1 -- 172.21.15.149:0/861402403 shutdown_connections 2023-06-09T04:37:18.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.710+0000 7ff630a76700 1 -- 172.21.15.149:0/861402403 wait complete. 2023-06-09T04:37:18.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.711+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa80c2de0 con 0x7f0aa80b0330 2023-06-09T04:37:18.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7f748f266700 1 -- 172.21.15.149:0/1164484979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748815e060 msgr2=0x7f7488164cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7f748f266700 1 --2- 172.21.15.149:0/1164484979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748815e060 0x7f7488164cc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f74880ae590 tx=0x7f7484009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7f748f266700 1 -- 172.21.15.149:0/1164484979 shutdown_connections 2023-06-09T04:37:18.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7f748f266700 1 --2- 172.21.15.149:0/1164484979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f748815e060 0x7f7488164cc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7f748f266700 1 --2- 172.21.15.149:0/1164484979 >> v2:172.21.15.184:3300/0 conn(0x7f74881616f0 0x7f74880ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7f748f266700 1 -- 172.21.15.149:0/1164484979 >> 172.21.15.149:0/1164484979 conn(0x7f7488069db0 msgr2=0x7f748806a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7ff630a76700 1 Processor -- start 2023-06-09T04:37:18.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7ff630a76700 1 -- start start 2023-06-09T04:37:18.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.712+0000 7faeb85db700 1 -- 172.21.15.149:0/3637253331 wait complete. 2023-06-09T04:37:18.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7faeb85db700 1 Processor -- start 2023-06-09T04:37:18.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7faeb85db700 1 -- start start 2023-06-09T04:37:18.730 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7ff630a76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff62c0cc100 0x7ff62c1e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7ff630a76700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0cc570 0x7ff62c0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7ff630a76700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c1e82b0 0x7ff62c0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7ff630a76700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c158260 con 0x7ff62c0cc570 2023-06-09T04:37:18.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7ff630a76700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1e7210 con 0x7ff62c1e82b0 2023-06-09T04:37:18.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.713+0000 7ff630a76700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c1e74f0 con 0x7ff62c0cc100 2023-06-09T04:37:18.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62a59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff62c0cc100 0x7ff62c1e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.731 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62a59c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff62c0cc100 0x7ff62c1e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42258/0 (socket says 172.21.15.149:42258) 2023-06-09T04:37:18.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62a59c700 1 -- 172.21.15.149:0/3082759317 learned_addr learned my addr 172.21.15.149:0/3082759317 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff629d9b700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0cc570 0x7ff62c0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62ad9d700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c1e82b0 0x7ff62c0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb85db700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0069db0 0x7faeb015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb85db700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeb00b00c0 0x7faeb00cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb85db700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00cdd70 0x7faeb01e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb85db700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb015cfd0 con 0x7faeb0069db0 2023-06-09T04:37:18.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb85db700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb015d2b0 con 0x7faeb00cdd70 2023-06-09T04:37:18.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb85db700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb015d590 con 0x7faeb00b00c0 2023-06-09T04:37:18.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb5b76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeb00b00c0 0x7faeb00cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb5b76700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeb00b00c0 0x7faeb00cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42266/0 (socket says 172.21.15.149:42266) 2023-06-09T04:37:18.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb5b76700 1 -- 172.21.15.149:0/3835353359 learned_addr learned my addr 172.21.15.149:0/3835353359 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb6377700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0069db0 0x7faeb015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62ad9d700 1 -- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff62c0cc100 msgr2=0x7ff62c1e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62ad9d700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff62c0cc100 0x7ff62c1e6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62ad9d700 1 -- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0cc570 msgr2=0x7ff62c0c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62ad9d700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0cc570 0x7ff62c0c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62ad9d700 1 -- 172.21.15.149:0/3082759317 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614009550 con 0x7ff62c1e82b0 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62a59c700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff62c0cc100 0x7ff62c1e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7ff62ad9d700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c1e82b0 0x7ff62c0c5750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff62400bb00 tx=0x7ff62400be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7f748f266700 1 -- 172.21.15.149:0/1164484979 shutdown_connections 2023-06-09T04:37:18.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb5b76700 1 -- 172.21.15.149:0/3835353359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00cdd70 msgr2=0x7faeb01e59e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:37:18.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.714+0000 7faeb5b76700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00cdd70 0x7faeb01e59e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faeb5b76700 1 -- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0069db0 msgr2=0x7faeb015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faeb5b76700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0069db0 0x7faeb015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faeb5b76700 1 -- 172.21.15.149:0/3835353359 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea00094a0 con 0x7faeb00b00c0 2023-06-09T04:37:18.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faeb6377700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0069db0 0x7faeb015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:18.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7f748f266700 1 -- 172.21.15.149:0/1164484979 wait complete. 2023-06-09T04:37:18.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faeb5b76700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeb00b00c0 0x7faeb00cec00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faeb006d540 tx=0x7faea0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faea6ffd700 1 -- 172.21.15.149:0/3835353359 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea00038a0 con 0x7faeb00b00c0 2023-06-09T04:37:18.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faea6ffd700 1 -- 172.21.15.149:0/3835353359 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea001f070 con 0x7faeb00b00c0 2023-06-09T04:37:18.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faea6ffd700 1 -- 172.21.15.149:0/3835353359 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0003c40 con 0x7faeb00b00c0 2023-06-09T04:37:18.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7f0a9e7fc700 1 -- 172.21.15.149:0/2943683407 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a98003a20 con 0x7f0aa80b0330 2023-06-09T04:37:18.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7f0a9e7fc700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0a8c06ad60 0x7f0a8c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7f0a9e7fc700 1 -- 172.21.15.149:0/2943683407 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a98088eb0 con 0x7f0aa80b0330 2023-06-09T04:37:18.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7f0aad642700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0a8c06ad60 0x7f0a8c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb015d870 con 0x7faeb00b00c0 2023-06-09T04:37:18.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb015cbc0 con 0x7faeb00b00c0 2023-06-09T04:37:18.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7f748f266700 1 Processor -- start 2023-06-09T04:37:18.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7ff622ffd700 1 -- 172.21.15.149:0/3082759317 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62400c9b0 con 0x7ff62c1e82b0 2023-06-09T04:37:18.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7ff622ffd700 1 -- 172.21.15.149:0/3082759317 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62400cb10 con 0x7ff62c1e82b0 2023-06-09T04:37:18.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7ff622ffd700 1 -- 172.21.15.149:0/3082759317 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624014440 con 0x7ff62c1e82b0 2023-06-09T04:37:18.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c1e77d0 con 0x7ff62c1e82b0 2023-06-09T04:37:18.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c1e7d90 con 0x7ff62c1e82b0 2023-06-09T04:37:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7fc1fa73f700 1 Processor -- start 2023-06-09T04:37:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.715+0000 7fc1fa73f700 1 -- start start 2023-06-09T04:37:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7fc1fa73f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc1f40b19f0 0x7fc1f40cd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7fc1fa73f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc1f40ce780 0x7fc1f4164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7fc1fa73f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f40d2720 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7fc1fa73f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40d2160 con 0x7fc1f40ce780 2023-06-09T04:37:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.716+0000 7fc1fa73f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f40d2440 con 0x7fc1f40b19f0 2023-06-09T04:37:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc1f40ce780 0x7fc1f4164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc1f40ce780 0x7fc1f4164450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36660/0 (socket says 172.21.15.149:36660) 2023-06-09T04:37:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 -- 172.21.15.149:0/3668542098 learned_addr learned my addr 172.21.15.149:0/3668542098 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 -- 172.21.15.149:0/3668542098 >> v2:172.21.15.184:3300/0 conn(0x7fc1f40b19f0 msgr2=0x7fc1f40cd860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:37:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 --2- 172.21.15.149:0/3668542098 >> v2:172.21.15.184:3300/0 conn(0x7fc1f40b19f0 0x7fc1f40cd860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 -- 172.21.15.149:0/3668542098 >> v1:172.21.15.149:6789/0 conn(0x7fc1f40b1dc0 legacy=0x7fc1f40ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 -- 172.21.15.149:0/3668542098 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f40cd060 con 0x7fc1f40ce780 2023-06-09T04:37:18.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.718+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae980052f0 con 0x7faeb00b00c0 2023-06-09T04:37:18.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7fc1f8cdc700 1 --2- 172.21.15.149:0/3668542098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40ce780 0x7fc1f4164450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40ce040 tx=0x7fc1e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771d48ce6aba799e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.717+0000 7f0aad642700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0a8c06ad60 0x7f0a8c06d210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80aff70 tx=0x7f0aa4012000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7f0a9e7fc700 1 -- 172.21.15.149:0/2943683407 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a98053de0 con 0x7f0aa80b0330 2023-06-09T04:37:18.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7faea6ffd700 1 -- 172.21.15.149:0/3835353359 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faea0026480 con 0x7faeb00b00c0 2023-06-09T04:37:18.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c1e7fb0 con 0x7ff62c1e82b0 2023-06-09T04:37:18.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7ff622ffd700 1 -- 172.21.15.149:0/3082759317 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff62401d3b0 con 0x7ff62c1e82b0 2023-06-09T04:37:18.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7fc1f2ffd700 1 -- 172.21.15.149:0/3668542098 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4004230 con 0x7fc1f40ce780 2023-06-09T04:37:18.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7fc1f2ffd700 1 -- 172.21.15.149:0/3668542098 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e4004390 con 0x7fc1f40ce780 2023-06-09T04:37:18.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7fc1f2ffd700 1 -- 172.21.15.149:0/3668542098 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e40036a0 con 0x7fc1f40ce780 2023-06-09T04:37:18.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7faea6ffd700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fae9406ace0 0x7fae9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7faea6ffd700 1 -- 172.21.15.149:0/3835353359 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faea0021070 con 0x7faeb00b00c0 2023-06-09T04:37:18.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7ff622ffd700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff60c06ad30 0x7ff60c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7ff622ffd700 1 -- 172.21.15.149:0/3082759317 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff6240893a0 con 0x7ff62c1e82b0 2023-06-09T04:37:18.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7fc1fa73f700 1 -- 172.21.15.149:0/3668542098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40ce780 msgr2=0x7fc1f4164450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/3668542098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40ce780 0x7fc1f4164450 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc1f40ce040 tx=0x7fc1e4009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.719+0000 7f748f266700 1 -- start start 2023-06-09T04:37:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748f266700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74880ad7d0 0x7f74881493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748f266700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748815e060 0x7f7488148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748f266700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74881616f0 0x7f7488162c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748f266700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748814ac50 con 0x7f74880ad7d0 2023-06-09T04:37:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748f266700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7488146b70 con 0x7f74881616f0 2023-06-09T04:37:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748f266700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7488127af0 con 0x7f748815e060 2023-06-09T04:37:18.748 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748c801700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748815e060 0x7f7488148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7fc1fa73f700 1 -- 172.21.15.149:0/3668542098 shutdown_connections 2023-06-09T04:37:18.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/3668542098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40ce780 0x7fc1f4164450 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/3668542098 >> v2:172.21.15.184:3300/0 conn(0x7fc1f40b19f0 0x7fc1f40cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7fc1fa73f700 1 -- 172.21.15.149:0/3668542098 >> 172.21.15.149:0/3668542098 conn(0x7fc1f406bc40 msgr2=0x7fc1f40cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748815e060 0x7f7488148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42282/0 (socket says 172.21.15.149:42282) 2023-06-09T04:37:18.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748d803700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74881616f0 0x7f7488162c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 -- 172.21.15.149:0/3037597742 learned_addr learned my addr 172.21.15.149:0/3037597742 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.720+0000 7f748d002700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74880ad7d0 0x7f74881493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7ff62a59c700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff60c06ad30 0x7ff60c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 -- 172.21.15.149:0/3037597742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74881616f0 msgr2=0x7f7488162c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74881616f0 0x7f7488162c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 -- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74880ad7d0 msgr2=0x7f74881493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74880ad7d0 0x7f74881493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 -- 172.21.15.149:0/3037597742 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484009550 con 0x7f748815e060 2023-06-09T04:37:18.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7fc1fa73f700 1 -- 172.21.15.149:0/3668542098 shutdown_connections 2023-06-09T04:37:18.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7f748c801700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748815e060 0x7f7488148430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f747800d7d0 tx=0x7f747800dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7ff62a59c700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff60c06ad30 0x7ff60c06d1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff614004720 tx=0x7ff614008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7faeb6377700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fae9406ace0 0x7fae9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.722+0000 7f561aa5d700 1 Processor -- start 2023-06-09T04:37:18.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.722+0000 7f2792221700 1 Processor -- start 2023-06-09T04:37:18.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.722+0000 7faeb6377700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fae9406ace0 0x7fae9406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faeb0071f40 tx=0x7faeac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f2792221700 1 -- start start 2023-06-09T04:37:18.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.722+0000 7f561aa5d700 1 -- start start 2023-06-09T04:37:18.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.722+0000 7f561aa5d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140b43f0 0x7f56140b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f561aa5d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f56140ccfc0 0x7f56140d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f561aa5d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140cf690 con 0x7f56140cd430 2023-06-09T04:37:18.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f561aa5d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140d0180 con 0x7f56140ccfc0 2023-06-09T04:37:18.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f561aa5d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140d0770 con 0x7f56140b43f0 2023-06-09T04:37:18.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.721+0000 7fc1fa73f700 1 -- 172.21.15.149:0/3668542098 wait complete. 2023-06-09T04:37:18.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7fc1fa73f700 1 Processor -- start 2023-06-09T04:37:18.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f56140ccfc0 0x7f56140d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f56140ccfc0 0x7f56140d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:55940/0 (socket says 172.21.15.149:55940) 2023-06-09T04:37:18.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 -- 172.21.15.149:0/3407620763 learned_addr learned my addr 172.21.15.149:0/3407620763 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 -- 172.21.15.149:0/3407620763 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140b43f0 msgr2=0x7f56140b47c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:37:18.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 --2- 172.21.15.149:0/3407620763 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140b43f0 0x7f56140b47c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 -- 172.21.15.149:0/3407620763 >> v1:172.21.15.184:6789/0 conn(0x7f56140cd430 legacy=0x7f56140d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 -- 172.21.15.149:0/3407620763 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140b4d00 con 0x7f56140ccfc0 2023-06-09T04:37:18.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7f56137fe700 1 --2- 172.21.15.149:0/3407620763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56140ccfc0 0x7f56140d0c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f56080098f0 tx=0x7f5608009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d944c3bc7e0d7957 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.723+0000 7fc1fa73f700 1 -- start start 2023-06-09T04:37:18.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f2792221700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f278c0b43f0 0x7f278c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f2792221700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f278c0ccfc0 0x7f278c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f2792221700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c0cf690 con 0x7f278c0cd430 2023-06-09T04:37:18.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f2792221700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c0d0180 con 0x7f278c0ccfc0 2023-06-09T04:37:18.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f2792221700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c0d0770 con 0x7f278c0b43f0 2023-06-09T04:37:18.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f278c0cd430 0x7f278c0d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60544/0 (socket says 172.21.15.149:60544) 2023-06-09T04:37:18.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278bfff700 1 -- 172.21.15.149:0/3379652761 learned_addr learned my addr 172.21.15.149:0/3379652761 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:18.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278affd700 1 --2- 172.21.15.149:0/3379652761 >> v2:172.21.15.149:3300/0 conn(0x7f278c0ccfc0 0x7f278c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278b7fe700 1 --2- 172.21.15.149:0/3379652761 >> v2:172.21.15.184:3300/0 conn(0x7f278c0b43f0 0x7f278c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7faea6ffd700 1 -- 172.21.15.149:0/3835353359 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faea0055f70 con 0x7faeb00b00c0 2023-06-09T04:37:18.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278affd700 1 -- 172.21.15.149:0/3379652761 >> v2:172.21.15.184:3300/0 conn(0x7f278c0b43f0 msgr2=0x7f278c0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:18.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278affd700 1 --2- 172.21.15.149:0/3379652761 >> v2:172.21.15.184:3300/0 conn(0x7f278c0b43f0 0x7f278c0b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278affd700 1 -- 172.21.15.149:0/3379652761 >> v1:172.21.15.149:6789/0 conn(0x7f278c0cd430 legacy=0x7f278c0d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278affd700 1 -- 172.21.15.149:0/3379652761 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0b4d00 con 0x7f278c0ccfc0 2023-06-09T04:37:18.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f278affd700 1 --2- 172.21.15.149:0/3379652761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0ccfc0 0x7f278c0d0c00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f278c06cd20 tx=0x7f2780009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac209ec8f2b17eda server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7f278a7fc700 1 -- 172.21.15.149:0/3379652761 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011830 con 0x7f278c0ccfc0 2023-06-09T04:37:18.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7f278a7fc700 1 -- 172.21.15.149:0/3379652761 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2780011990 con 0x7f278c0ccfc0 2023-06-09T04:37:18.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7f278a7fc700 1 -- 172.21.15.149:0/3379652761 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780011d20 con 0x7f278c0ccfc0 2023-06-09T04:37:18.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f747dffb700 1 -- 172.21.15.149:0/3037597742 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74780125f0 con 0x7f748815e060 2023-06-09T04:37:18.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f747dffb700 1 -- 172.21.15.149:0/3037597742 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7478012750 con 0x7f748815e060 2023-06-09T04:37:18.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f747dffb700 1 -- 172.21.15.149:0/3037597742 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7478012ae0 con 0x7f748815e060 2023-06-09T04:37:18.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7488127dd0 con 0x7f748815e060 2023-06-09T04:37:18.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7488128390 con 0x7f748815e060 2023-06-09T04:37:18.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f5612ffd700 1 -- 172.21.15.149:0/3407620763 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608004230 con 0x7f56140ccfc0 2023-06-09T04:37:18.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f5612ffd700 1 -- 172.21.15.149:0/3407620763 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608004390 con 0x7f56140ccfc0 2023-06-09T04:37:18.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7f5612ffd700 1 -- 172.21.15.149:0/3407620763 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080036a0 con 0x7f56140ccfc0 2023-06-09T04:37:18.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1fa73f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40b19f0 0x7fc1f415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1fa73f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40b1dc0 0x7fc1f40b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1fa73f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ce780 0x7fc1f40b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1fa73f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41fa520 con 0x7fc1f40b19f0 2023-06-09T04:37:18.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1fa73f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f415ec00 con 0x7fc1f40ce780 2023-06-09T04:37:18.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1fa73f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f41f9760 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1f8cdc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ce780 0x7fc1f40b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.724+0000 7fc1f37fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40b1dc0 0x7fc1f40b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7fc1f37fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40b1dc0 0x7fc1f40b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42302/0 (socket says 172.21.15.149:42302) 2023-06-09T04:37:18.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7fc1f37fe700 1 -- 172.21.15.149:0/4129421802 learned_addr learned my addr 172.21.15.149:0/4129421802 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7fc1f37fe700 1 -- 172.21.15.149:0/4129421802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ce780 msgr2=0x7fc1f40b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7fc1f37fe700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ce780 0x7fc1f40b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7fc1f37fe700 1 -- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40b19f0 msgr2=0x7fc1f415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7fc1f37fe700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40b19f0 0x7fc1f415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.725+0000 7fc1f37fe700 1 -- 172.21.15.149:0/4129421802 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e4009550 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 -- 172.21.15.149:0/3379652761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0ccfc0 msgr2=0x7f278c0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 --2- 172.21.15.149:0/3379652761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0ccfc0 0x7f278c0d0c00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f278c06cd20 tx=0x7f2780009b20 comp rx=0 tx=0).stop 2023-06-09T04:37:18.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 -- 172.21.15.149:0/3379652761 shutdown_connections 2023-06-09T04:37:18.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 --2- 172.21.15.149:0/3379652761 >> v2:172.21.15.184:3300/0 conn(0x7f278c0b43f0 0x7f278c0b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 --2- 172.21.15.149:0/3379652761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0ccfc0 0x7f278c0d0c00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 -- 172.21.15.149:0/3379652761 >> 172.21.15.149:0/3379652761 conn(0x7f278c06afb0 msgr2=0x7f278c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 -- 172.21.15.149:0/3379652761 shutdown_connections 2023-06-09T04:37:18.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f2792221700 1 -- 172.21.15.149:0/3379652761 wait complete. 2023-06-09T04:37:18.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7488073fa0 con 0x7f748815e060 2023-06-09T04:37:18.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f561aa5d700 1 -- 172.21.15.149:0/3407620763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56140ccfc0 msgr2=0x7f56140d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.726+0000 7f561aa5d700 1 --2- 172.21.15.149:0/3407620763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56140ccfc0 0x7f56140d0c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f56080098f0 tx=0x7f5608009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:18.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.727+0000 7f561aa5d700 1 -- 172.21.15.149:0/3407620763 shutdown_connections 2023-06-09T04:37:18.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.727+0000 7f561aa5d700 1 --2- 172.21.15.149:0/3407620763 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140b43f0 0x7f56140b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.727+0000 7f561aa5d700 1 --2- 172.21.15.149:0/3407620763 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56140ccfc0 0x7f56140d0c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.727+0000 7f561aa5d700 1 -- 172.21.15.149:0/3407620763 >> 172.21.15.149:0/3407620763 conn(0x7f561406afb0 msgr2=0x7f561406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:18.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.727+0000 7fc1f37fe700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40b1dc0 0x7fc1f40b3a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800b4d0 tx=0x7fc1e800b890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7f747dffb700 1 -- 172.21.15.149:0/3037597742 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7478012c40 con 0x7f748815e060 2023-06-09T04:37:18.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7f2792221700 1 Processor -- start 2023-06-09T04:37:18.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7f747dffb700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f746c06ad30 0x7f746c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7f747dffb700 1 -- 172.21.15.149:0/3037597742 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f747808a1f0 con 0x7f748815e060 2023-06-09T04:37:18.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7f748d002700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f746c06ad30 0x7f746c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7f561aa5d700 1 -- 172.21.15.149:0/3407620763 shutdown_connections 2023-06-09T04:37:18.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f748d002700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f746c06ad30 0x7f746c06d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7484000c00 tx=0x7f7484008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7ff622ffd700 1 -- 172.21.15.149:0/3082759317 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff624054240 con 0x7ff62c1e82b0 2023-06-09T04:37:18.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.728+0000 7f2792221700 1 -- start start 2023-06-09T04:37:18.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f2792221700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0b43f0 0x7f278c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f2792221700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f278c0ccfc0 0x7f278c146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f2792221700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c0cd430 0x7f278c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f2792221700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c157700 con 0x7f278c0b43f0 2023-06-09T04:37:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f2792221700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c1579e0 con 0x7f278c0cd430 2023-06-09T04:37:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f2792221700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c15e5c0 con 0x7f278c0ccfc0 2023-06-09T04:37:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f278b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0b43f0 0x7f278c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f278b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0b43f0 0x7f278c1582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36698/0 (socket says 172.21.15.149:36698) 2023-06-09T04:37:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f278b7fe700 1 -- 172.21.15.149:0/1823442753 learned_addr learned my addr 172.21.15.149:0/1823442753 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f278affd700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f278c0ccfc0 0x7f278c146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f278bfff700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c0cd430 0x7f278c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f278affd700 1 -- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c0cd430 msgr2=0x7f278c0b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f278affd700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c0cd430 0x7f278c0b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f278affd700 1 -- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0b43f0 msgr2=0x7f278c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f278affd700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0b43f0 0x7f278c1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f278affd700 1 -- 172.21.15.149:0/1823442753 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27800094a0 con 0x7f278c0ccfc0 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f278bfff700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c0cd430 0x7f278c0b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:18.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f278b7fe700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0b43f0 0x7f278c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:18.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.729+0000 7f561aa5d700 1 -- 172.21.15.149:0/3407620763 wait complete. 2023-06-09T04:37:18.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.730+0000 7f561aa5d700 1 Processor -- start 2023-06-09T04:37:18.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.731+0000 7f561aa5d700 1 -- start start 2023-06-09T04:37:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.731+0000 7fc1f0ff9700 1 -- 172.21.15.149:0/4129421802 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8011830 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.731+0000 7fc1f0ff9700 1 -- 172.21.15.149:0/4129421802 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e8011990 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.731+0000 7fc1f0ff9700 1 -- 172.21.15.149:0/4129421802 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8011d40 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f747dffb700 1 -- 172.21.15.149:0/3037597742 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7478055090 con 0x7f748815e060 2023-06-09T04:37:18.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f561aa5d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140ccfc0 0x7f56141e1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f561aa5d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56140cd430 0x7f561414cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f561aa5d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56141e6d80 0x7f56140cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f561aa5d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141e2170 con 0x7f56140cd430 2023-06-09T04:37:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f561aa5d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141e2450 con 0x7f56141e6d80 2023-06-09T04:37:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f561aa5d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56141e2730 con 0x7f56140ccfc0 2023-06-09T04:37:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f56137fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56140cd430 0x7f561414cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f56137fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56140cd430 0x7f561414cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36702/0 (socket says 172.21.15.149:36702) 2023-06-09T04:37:18.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.732+0000 7f56137fe700 1 -- 172.21.15.149:0/453162279 learned_addr learned my addr 172.21.15.149:0/453162279 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f56137fe700 1 -- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140ccfc0 msgr2=0x7f56141e1900 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f56137fe700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140ccfc0 0x7f56141e1900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f56137fe700 1 -- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56141e6d80 msgr2=0x7f56140cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f5618ffa700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56141e6d80 0x7f56140cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f56137fe700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56141e6d80 0x7f56140cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f56137fe700 1 -- 172.21.15.149:0/453162279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5608009550 con 0x7f56140cd430 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f5618ffa700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56141e6d80 0x7f56140cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:18.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.733+0000 7f56137fe700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56140cd430 0x7f561414cc80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f561408b770 tx=0x7f5608004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.736+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f41f9a40 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.736+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f41fa000 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.737+0000 7f278affd700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f278c0ccfc0 0x7f278c146560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2780016000 tx=0x7f2780004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.737+0000 7f2773fff700 1 -- 172.21.15.149:0/1823442753 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27800036a0 con 0x7f278c0ccfc0 2023-06-09T04:37:18.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.737+0000 7f2773fff700 1 -- 172.21.15.149:0/1823442753 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278001e070 con 0x7f278c0ccfc0 2023-06-09T04:37:18.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.737+0000 7f2773fff700 1 -- 172.21.15.149:0/1823442753 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780003a40 con 0x7f278c0ccfc0 2023-06-09T04:37:18.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.737+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c15e8a0 con 0x7f278c0ccfc0 2023-06-09T04:37:18.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.737+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c158830 con 0x7f278c0ccfc0 2023-06-09T04:37:18.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.738+0000 7fc1f0ff9700 1 -- 172.21.15.149:0/4129421802 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1e801a400 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.738+0000 7fc1f0ff9700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1e006ace0 0x7fc1e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.738+0000 7fc1f0ff9700 1 -- 172.21.15.149:0/4129421802 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc1e80898c0 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.739+0000 7fc1f3fff700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1e006ace0 0x7fc1e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.739+0000 7fc1f3fff700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1e006ace0 0x7fc1e006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001ff0 tx=0x7fc1ec0015b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.740+0000 7f2773fff700 1 -- 172.21.15.149:0/1823442753 <== mon.2 v2:172.21.15.184:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2780003ba0 con 0x7f278c0ccfc0 2023-06-09T04:37:18.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.740+0000 7f2773fff700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f277806ace0 0x7f277806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.740+0000 7f2773fff700 1 -- 172.21.15.149:0/1823442753 <== mon.2 v2:172.21.15.184:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2780089d90 con 0x7f278c0ccfc0 2023-06-09T04:37:18.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.740+0000 7f278b7fe700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f277806ace0 0x7f277806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.741+0000 7f278b7fe700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f277806ace0 0x7f277806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f277c009fd0 tx=0x7f277c0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.747+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f41fa220 con 0x7fc1f40b1dc0 2023-06-09T04:37:18.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.747+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c0052f0 con 0x7f278c0ccfc0 2023-06-09T04:37:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.748+0000 7f5610ff9700 1 -- 172.21.15.149:0/453162279 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560800b660 con 0x7f56140cd430 2023-06-09T04:37:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.748+0000 7f5610ff9700 1 -- 172.21.15.149:0/453162279 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560800b7c0 con 0x7f56140cd430 2023-06-09T04:37:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.748+0000 7f5610ff9700 1 -- 172.21.15.149:0/453162279 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560800bb70 con 0x7f56140cd430 2023-06-09T04:37:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.748+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56141e2a10 con 0x7f56140cd430 2023-06-09T04:37:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.748+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56141e1e40 con 0x7f56140cd430 2023-06-09T04:37:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.749+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56141e2f30 con 0x7f56140cd430 2023-06-09T04:37:18.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.751+0000 7f5610ff9700 1 -- 172.21.15.149:0/453162279 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5608021070 con 0x7f56140cd430 2023-06-09T04:37:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.751+0000 7f5610ff9700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f560006ad30 0x7f560006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.751+0000 7f5610ff9700 1 -- 172.21.15.149:0/453162279 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f560808b3a0 con 0x7f56140cd430 2023-06-09T04:37:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.752+0000 7f5613fff700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f560006ad30 0x7f560006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.752+0000 7f5613fff700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f560006ad30 0x7f560006d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f561406cd20 tx=0x7f560c009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:18.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.757+0000 7f2773fff700 1 -- 172.21.15.149:0/1823442753 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2780054be0 con 0x7f278c0ccfc0 2023-06-09T04:37:18.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.758+0000 7f5610ff9700 1 -- 172.21.15.149:0/453162279 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56080562d0 con 0x7f56140cd430 2023-06-09T04:37:18.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:18.759+0000 7fc1f0ff9700 1 -- 172.21.15.149:0/4129421802 <== mon.2 v2:172.21.15.184:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc1e8054550 con 0x7fc1f40b1dc0 2023-06-09T04:37:19.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.106+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fae98005870 con 0x7faeb00b00c0 2023-06-09T04:37:19.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.107+0000 7faea6ffd700 1 -- 172.21.15.149:0/3835353359 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faea0059590 con 0x7faeb00b00c0 2023-06-09T04:37:19.112 INFO:teuthology.orchestra.run.smithi149.stdout:64424509449 2023-06-09T04:37:19.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.112+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fae9406ace0 msgr2=0x7fae9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.112+0000 7faeb85db700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fae9406ace0 0x7fae9406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7faeb0071f40 tx=0x7faeac008040 comp rx=0 tx=0).stop 2023-06-09T04:37:19.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.112+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeb00b00c0 msgr2=0x7faeb00cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.112+0000 7faeb85db700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeb00b00c0 0x7faeb00cec00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faeb006d540 tx=0x7faea0004750 comp rx=0 tx=0).stop 2023-06-09T04:37:19.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.112+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0aa80cf3f0 con 0x7f0aa80b0330 2023-06-09T04:37:19.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.113+0000 7f0a9e7fc700 1 -- 172.21.15.149:0/2943683407 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a98017020 con 0x7f0aa80b0330 2023-06-09T04:37:19.114 INFO:teuthology.orchestra.run.smithi149.stdout:64424509449 2023-06-09T04:37:19.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc7cc073fa0 con 0x7fc7cc0cf0a0 2023-06-09T04:37:19.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f748806a670 con 0x7f748815e060 2023-06-09T04:37:19.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 shutdown_connections 2023-06-09T04:37:19.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7faeb85db700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fae9406ace0 0x7fae9406d190 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7faeb85db700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb00cdd70 0x7faeb01e59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7faeb85db700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb0069db0 0x7faeb015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7faeb85db700 1 --2- 172.21.15.149:0/3835353359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faeb00b00c0 0x7faeb00cec00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.114+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 >> 172.21.15.149:0/3835353359 conn(0x7faeb00ce5c0 msgr2=0x7faeb00af760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.115+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 shutdown_connections 2023-06-09T04:37:19.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.115+0000 7fc7c1ffb700 1 -- 172.21.15.149:0/3752107412 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7c8056ea0 con 0x7fc7cc0cf0a0 2023-06-09T04:37:19.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.115+0000 7faeb85db700 1 -- 172.21.15.149:0/3835353359 wait complete. 2023-06-09T04:37:19.118 INFO:teuthology.orchestra.run.smithi149.stdout:64424509449 2023-06-09T04:37:19.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.115+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0a8c06ad60 msgr2=0x7f0a8c06d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.115+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0a8c06ad60 0x7f0a8c06d210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80aff70 tx=0x7f0aa4012000 comp rx=0 tx=0).stop 2023-06-09T04:37:19.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa80b0330 msgr2=0x7f0aa80b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa80b0330 0x7f0aa80b2a50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c450 tx=0x7f0a9800c760 comp rx=0 tx=0).stop 2023-06-09T04:37:19.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 shutdown_connections 2023-06-09T04:37:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0a8c06ad60 0x7f0a8c06d210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0aa80cd290 0x7f0aa80af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0aa80b0330 0x7f0aa80b2a50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 --2- 172.21.15.149:0/2943683407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0aa80b0700 0x7f0aa80af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 >> 172.21.15.149:0/2943683407 conn(0x7f0aa80ce5c0 msgr2=0x7f0aa80ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 shutdown_connections 2023-06-09T04:37:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.116+0000 7f0ab00a7700 1 -- 172.21.15.149:0/2943683407 wait complete. 2023-06-09T04:37:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.117+0000 7f747dffb700 1 -- 172.21.15.149:0/3037597742 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74780586b0 con 0x7f748815e060 2023-06-09T04:37:19.121 INFO:teuthology.orchestra.run.smithi149.stdout:60129542155 2023-06-09T04:37:19.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.119+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc7b006ace0 msgr2=0x7fc7b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.119+0000 7fc7d3536700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc7b006ace0 0x7fc7b006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400b370 tx=0x7fc7c4011000 comp rx=0 tx=0).stop 2023-06-09T04:37:19.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.119+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7cc0cf0a0 msgr2=0x7fc7cc0c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.119+0000 7fc7d3536700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7cc0cf0a0 0x7fc7cc0c2a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c370 tx=0x7fc7c800c730 comp rx=0 tx=0).stop 2023-06-09T04:37:19.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.120+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff62c073fa0 con 0x7ff62c1e82b0 2023-06-09T04:37:19.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 shutdown_connections 2023-06-09T04:37:19.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc7b006ace0 0x7fc7b006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc7cc0b02a0 0x7fc7cc14cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7cc0cf0a0 0x7fc7cc0c2a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 --2- 172.21.15.149:0/3752107412 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7cc0c8b80 0x7fc7cc0c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 >> 172.21.15.149:0/3752107412 conn(0x7fc7cc0ce5c0 msgr2=0x7fc7cc0af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 shutdown_connections 2023-06-09T04:37:19.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7fc7d3536700 1 -- 172.21.15.149:0/3752107412 wait complete. 2023-06-09T04:37:19.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7ff622ffd700 1 -- 172.21.15.149:0/3082759317 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff624057860 con 0x7ff62c1e82b0 2023-06-09T04:37:19.125 INFO:teuthology.orchestra.run.smithi149.stdout:60129542153 2023-06-09T04:37:19.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f746c06ad30 msgr2=0x7f746c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7f748f266700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f746c06ad30 0x7f746c06d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7484000c00 tx=0x7f7484008030 comp rx=0 tx=0).stop 2023-06-09T04:37:19.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748815e060 msgr2=0x7f7488148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.121+0000 7f748f266700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748815e060 0x7f7488148430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f747800d7d0 tx=0x7f747800dae0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.129+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 shutdown_connections 2023-06-09T04:37:19.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.129+0000 7f748f266700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f746c06ad30 0x7f746c06d1e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.129+0000 7f748f266700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74881616f0 0x7f7488162c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.129+0000 7f748f266700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74880ad7d0 0x7f74881493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.129+0000 7f748f266700 1 --2- 172.21.15.149:0/3037597742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f748815e060 0x7f7488148430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.129+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 >> 172.21.15.149:0/3037597742 conn(0x7f7488069db0 msgr2=0x7f74880b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff60c06ad30 msgr2=0x7ff60c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff60c06ad30 0x7ff60c06d1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff614004720 tx=0x7ff614008030 comp rx=0 tx=0).stop 2023-06-09T04:37:19.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c1e82b0 msgr2=0x7ff62c0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c1e82b0 0x7ff62c0c5750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff62400bb00 tx=0x7ff62400be10 comp rx=0 tx=0).stop 2023-06-09T04:37:19.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 shutdown_connections 2023-06-09T04:37:19.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff60c06ad30 0x7ff60c06d1e0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff614004720 tx=0x7ff614008030 comp rx=0 tx=0).stop 2023-06-09T04:37:19.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff62c0cc100 0x7ff62c1e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff62c1e82b0 0x7ff62c0c5750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 --2- 172.21.15.149:0/3082759317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff62c0cc570 0x7ff62c0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 >> 172.21.15.149:0/3082759317 conn(0x7ff62c0cf250 msgr2=0x7ff62c1585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 shutdown_connections 2023-06-09T04:37:19.136 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.133+0000 7ff630a76700 1 -- 172.21.15.149:0/3082759317 wait complete. 2023-06-09T04:37:19.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.137+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 shutdown_connections 2023-06-09T04:37:19.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.138+0000 7f748f266700 1 -- 172.21.15.149:0/3037597742 wait complete. 2023-06-09T04:37:19.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2023-06-09T04:37:19.141 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:19.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2023-06-09T04:37:19.144 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:19.145 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.144+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc1f4073fa0 con 0x7fc1f40b1dc0 2023-06-09T04:37:19.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2023-06-09T04:37:19.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.145+0000 7fc1f0ff9700 1 -- 172.21.15.149:0/4129421802 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1e8015030 con 0x7fc1f40b1dc0 2023-06-09T04:37:19.147 INFO:teuthology.orchestra.run.smithi149.stdout:60129542154 2023-06-09T04:37:19.147 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:19.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.146+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f276c005870 con 0x7f278c0ccfc0 2023-06-09T04:37:19.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.146+0000 7f2773fff700 1 -- 172.21.15.149:0/1823442753 <== mon.2 v2:172.21.15.184:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2780015070 con 0x7f278c0ccfc0 2023-06-09T04:37:19.148 INFO:teuthology.orchestra.run.smithi149.stdout:60129542155 2023-06-09T04:37:19.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f277806ace0 msgr2=0x7f277806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f277806ace0 0x7f277806d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f277c009fd0 tx=0x7f277c0091c0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f278c0ccfc0 msgr2=0x7f278c146560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f278c0ccfc0 0x7f278c146560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2780016000 tx=0x7f2780004750 comp rx=0 tx=0).stop 2023-06-09T04:37:19.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 shutdown_connections 2023-06-09T04:37:19.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f277806ace0 0x7f277806d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f278c0cd430 0x7f278c0b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f278c0b43f0 0x7f278c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 --2- 172.21.15.149:0/1823442753 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f278c0ccfc0 0x7f278c146560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 >> 172.21.15.149:0/1823442753 conn(0x7f278c06afb0 msgr2=0x7f278c0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 shutdown_connections 2023-06-09T04:37:19.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f2792221700 1 -- 172.21.15.149:0/1823442753 wait complete. 2023-06-09T04:37:19.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f56141e2f30 con 0x7f56140cd430 2023-06-09T04:37:19.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1e006ace0 msgr2=0x7fc1e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1e006ace0 0x7fc1e006d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001ff0 tx=0x7fc1ec0015b0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40b1dc0 msgr2=0x7fc1f40b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.149+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40b1dc0 0x7fc1f40b3a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800b4d0 tx=0x7fc1e800b890 comp rx=0 tx=0).stop 2023-06-09T04:37:19.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7f5610ff9700 1 -- 172.21.15.149:0/453162279 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56141e2f30 con 0x7f56140cd430 2023-06-09T04:37:19.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 shutdown_connections 2023-06-09T04:37:19.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc1e006ace0 0x7fc1e006d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1f40ce780 0x7fc1f40b3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f40b19f0 0x7fc1f415e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 --2- 172.21.15.149:0/4129421802 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc1f40b1dc0 0x7fc1f40b3a30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 >> 172.21.15.149:0/4129421802 conn(0x7fc1f406bc40 msgr2=0x7fc1f41643e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.155 INFO:teuthology.orchestra.run.smithi149.stdout:64424509450 2023-06-09T04:37:19.155 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 shutdown_connections 2023-06-09T04:37:19.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.150+0000 7fc1fa73f700 1 -- 172.21.15.149:0/4129421802 wait complete. 2023-06-09T04:37:19.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.154+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f560006ad30 msgr2=0x7f560006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.154+0000 7f561aa5d700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f560006ad30 0x7f560006d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f561406cd20 tx=0x7f560c009250 comp rx=0 tx=0).stop 2023-06-09T04:37:19.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.154+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56140cd430 msgr2=0x7f561414cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:19.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.154+0000 7f561aa5d700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56140cd430 0x7f561414cc80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f561408b770 tx=0x7f5608004750 comp rx=0 tx=0).stop 2023-06-09T04:37:19.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 shutdown_connections 2023-06-09T04:37:19.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f560006ad30 0x7f560006d1e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f56140ccfc0 0x7f56141e1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f56141e6d80 0x7f56140cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 --2- 172.21.15.149:0/453162279 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f56140cd430 0x7f561414cc80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:19.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 >> 172.21.15.149:0/453162279 conn(0x7f561406afb0 msgr2=0x7f56140b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:19.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 shutdown_connections 2023-06-09T04:37:19.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:19.155+0000 7f561aa5d700 1 -- 172.21.15.149:0/453162279 wait complete. 2023-06-09T04:37:19.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.5 2023-06-09T04:37:19.161 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:19.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2023-06-09T04:37:19.165 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:19.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.7 2023-06-09T04:37:19.171 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:19.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2023-06-09T04:37:19.177 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:19.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2023-06-09T04:37:20.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:37:20.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.312+0000 7fabb0f28700 1 Processor -- start 2023-06-09T04:37:20.313 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.312+0000 7fabb0f28700 1 -- start start 2023-06-09T04:37:20.314 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabb0f28700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fabac071fc0 0x7fabac0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:20.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabb0f28700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac072440 con 0x7fabac069db0 2023-06-09T04:37:20.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabb0f28700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac0b20b0 con 0x7fabac0cd220 2023-06-09T04:37:20.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabb0f28700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabac071320 con 0x7fabac071fc0 2023-06-09T04:37:20.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabaa59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fabac069db0 0x7fabac06a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60576/0 (socket says 172.21.15.149:60576) 2023-06-09T04:37:20.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabaa59c700 1 -- 172.21.15.149:0/196109095 learned_addr learned my addr 172.21.15.149:0/196109095 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:20.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabaad9d700 1 --2- 172.21.15.149:0/196109095 >> v2:172.21.15.184:3300/0 conn(0x7fabac071fc0 0x7fabac0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:20.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7faba959a700 1 -- 172.21.15.149:0/196109095 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465262642 0 0) 0x7fab9c001110 con 0x7fabac069db0 2023-06-09T04:37:20.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7faba959a700 1 -- 172.21.15.149:0/196109095 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab940035b0 con 0x7fabac069db0 2023-06-09T04:37:20.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7faba959a700 1 -- 172.21.15.149:0/196109095 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707982616 0 0) 0x7fabac0b20b0 con 0x7fabac0cd220 2023-06-09T04:37:20.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7faba959a700 1 -- 172.21.15.149:0/196109095 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab9c001110 con 0x7fabac0cd220 2023-06-09T04:37:20.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabaad9d700 1 -- 172.21.15.149:0/196109095 >> v1:172.21.15.184:6789/0 conn(0x7fabac0cd220 legacy=0x7fabac0b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:20.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabaad9d700 1 -- 172.21.15.149:0/196109095 >> v1:172.21.15.149:6789/0 conn(0x7fabac069db0 legacy=0x7fabac06a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:20.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.313+0000 7fabaad9d700 1 -- 172.21.15.149:0/196109095 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac071600 con 0x7fabac071fc0 2023-06-09T04:37:20.317 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7fabaad9d700 1 --2- 172.21.15.149:0/196109095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac071fc0 0x7fabac0ab8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faba4009d90 tx=0x7faba400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48aef7018afa7c16 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:20.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7faba959a700 1 -- 172.21.15.149:0/196109095 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400e070 con 0x7fabac071fc0 2023-06-09T04:37:20.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7faba959a700 1 -- 172.21.15.149:0/196109095 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba400bb20 con 0x7fabac071fc0 2023-06-09T04:37:20.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7faba959a700 1 -- 172.21.15.149:0/196109095 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400be90 con 0x7fabac071fc0 2023-06-09T04:37:20.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7fabb0f28700 1 -- 172.21.15.149:0/196109095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac071fc0 msgr2=0x7fabac0ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:20.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7fabb0f28700 1 --2- 172.21.15.149:0/196109095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac071fc0 0x7fabac0ab8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faba4009d90 tx=0x7faba400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:20.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7fabb0f28700 1 -- 172.21.15.149:0/196109095 shutdown_connections 2023-06-09T04:37:20.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7fabb0f28700 1 --2- 172.21.15.149:0/196109095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac071fc0 0x7fabac0ab8f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.314+0000 7fabb0f28700 1 -- 172.21.15.149:0/196109095 >> 172.21.15.149:0/196109095 conn(0x7fabac06aec0 msgr2=0x7fabac06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:20.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.315+0000 7fabb0f28700 1 -- 172.21.15.149:0/196109095 shutdown_connections 2023-06-09T04:37:20.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.315+0000 7fabb0f28700 1 -- 172.21.15.149:0/196109095 wait complete. 2023-06-09T04:37:20.320 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.316+0000 7fabb0f28700 1 Processor -- start 2023-06-09T04:37:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.316+0000 7fabb0f28700 1 -- start start 2023-06-09T04:37:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac069db0 0x7fabac1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabac071fc0 0x7fabac154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabac0cd220 0x7fabac0b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac155330 con 0x7fabac071fc0 2023-06-09T04:37:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0c9db0 con 0x7fabac069db0 2023-06-09T04:37:20.321 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0ca090 con 0x7fabac0cd220 2023-06-09T04:37:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabac071fc0 0x7fabac154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabac071fc0 0x7fabac154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36720/0 (socket says 172.21.15.149:36720) 2023-06-09T04:37:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 -- 172.21.15.149:0/2388868288 learned_addr learned my addr 172.21.15.149:0/2388868288 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabaa59c700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac069db0 0x7fabac1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabaad9d700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabac0cd220 0x7fabac0b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 -- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabac0cd220 msgr2=0x7fabac0b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:20.322 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabac0cd220 0x7fabac0b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 -- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac069db0 msgr2=0x7fabac1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac069db0 0x7fabac1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 -- 172.21.15.149:0/2388868288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009a70 con 0x7fabac071fc0 2023-06-09T04:37:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7faba9d9b700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabac071fc0 0x7fabac154df0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faba000c490 tx=0x7faba000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fab9affd700 1 -- 172.21.15.149:0/2388868288 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000cea0 con 0x7fabac071fc0 2023-06-09T04:37:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fab9affd700 1 -- 172.21.15.149:0/2388868288 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba00052f0 con 0x7fabac071fc0 2023-06-09T04:37:20.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac0ca370 con 0x7fabac071fc0 2023-06-09T04:37:20.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fab9affd700 1 -- 172.21.15.149:0/2388868288 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0003680 con 0x7fabac071fc0 2023-06-09T04:37:20.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.317+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac0ca930 con 0x7fabac071fc0 2023-06-09T04:37:20.324 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.319+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac073fa0 con 0x7fabac071fc0 2023-06-09T04:37:20.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.319+0000 7fab9affd700 1 -- 172.21.15.149:0/2388868288 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faba00037e0 con 0x7fabac071fc0 2023-06-09T04:37:20.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.319+0000 7fab9affd700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fab8c06ad30 0x7fab8c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:20.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.319+0000 7fab9affd700 1 -- 172.21.15.149:0/2388868288 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faba0088a00 con 0x7fabac071fc0 2023-06-09T04:37:20.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.319+0000 7fabaa59c700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fab8c06ad30 0x7fab8c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:20.325 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.320+0000 7fabaa59c700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fab8c06ad30 0x7fab8c06d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab9c007fd0 tx=0x7fab9c007dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:20.326 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.324+0000 7fab9affd700 1 -- 172.21.15.149:0/2388868288 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faba0053930 con 0x7fabac071fc0 2023-06-09T04:37:20.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.512+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabac0b55d0 con 0x7fabac071fc0 2023-06-09T04:37:20.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.512+0000 7fab9affd700 1 -- 172.21.15.149:0/2388868288 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faba0056f50 con 0x7fabac071fc0 2023-06-09T04:37:20.514 INFO:teuthology.orchestra.run.smithi149.stdout:64424509450 2023-06-09T04:37:20.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fab8c06ad30 msgr2=0x7fab8c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:20.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fab8c06ad30 0x7fab8c06d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab9c007fd0 tx=0x7fab9c007dc0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabac071fc0 msgr2=0x7fabac154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:20.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabac071fc0 0x7fabac154df0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faba000c490 tx=0x7faba000c7a0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 shutdown_connections 2023-06-09T04:37:20.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fab8c06ad30 0x7fab8c06d1e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabac0cd220 0x7fabac0b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac069db0 0x7fabac1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 --2- 172.21.15.149:0/2388868288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabac071fc0 0x7fabac154df0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:20.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.514+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 >> 172.21.15.149:0/2388868288 conn(0x7fabac06aec0 msgr2=0x7fabac159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:20.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.515+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 shutdown_connections 2023-06-09T04:37:20.517 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:20.515+0000 7fabb0f28700 1 -- 172.21.15.149:0/2388868288 wait complete. 2023-06-09T04:37:20.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2023-06-09T04:37:21.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:37:21.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.662+0000 7fc33e4a7700 1 Processor -- start 2023-06-09T04:37:21.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.663+0000 7fc33e4a7700 1 -- start start 2023-06-09T04:37:21.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.663+0000 7fc33e4a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc338159260 0x7fc338071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:21.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.663+0000 7fc33e4a7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3380ca5f0 0x7fc3380716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.663+0000 7fc33e4a7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc3380cc020 0x7fc3380cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.663+0000 7fc33e4a7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3380cca00 con 0x7fc3380ca5f0 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.663+0000 7fc33e4a7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3380aeee0 con 0x7fc3380cc020 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.663+0000 7fc33e4a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380ceb10 con 0x7fc338159260 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3380ca5f0 0x7fc3380716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3380ca5f0 0x7fc3380716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36726/0 (socket says 172.21.15.149:36726) 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 -- 172.21.15.149:0/765619436 learned_addr learned my addr 172.21.15.149:0/765619436 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:21.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc33ca44700 1 --2- 172.21.15.149:0/765619436 >> v2:172.21.15.184:3300/0 conn(0x7fc3380cc020 0x7fc3380cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:21.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc337fff700 1 --2- 172.21.15.149:0/765619436 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc338159260 0x7fc338071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:21.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 -- 172.21.15.149:0/765619436 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc338159260 msgr2=0x7fc338071ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:21.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 --2- 172.21.15.149:0/765619436 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc338159260 0x7fc338071ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 -- 172.21.15.149:0/765619436 >> v2:172.21.15.184:3300/0 conn(0x7fc3380cc020 msgr2=0x7fc3380cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:21.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 --2- 172.21.15.149:0/765619436 >> v2:172.21.15.184:3300/0 conn(0x7fc3380cc020 0x7fc3380cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 -- 172.21.15.149:0/765619436 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc338159630 con 0x7fc3380ca5f0 2023-06-09T04:37:21.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc33ca44700 1 --2- 172.21.15.149:0/765619436 >> v2:172.21.15.184:3300/0 conn(0x7fc3380cc020 0x7fc3380cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:21.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc3377fe700 1 --2- 172.21.15.149:0/765619436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380ca5f0 0x7fc3380716c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc3380af080 tx=0x7fc328009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc5841cc3b62845 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:21.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc336ffd700 1 -- 172.21.15.149:0/765619436 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800b860 con 0x7fc3380ca5f0 2023-06-09T04:37:21.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc336ffd700 1 -- 172.21.15.149:0/765619436 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800b9c0 con 0x7fc3380ca5f0 2023-06-09T04:37:21.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.664+0000 7fc336ffd700 1 -- 172.21.15.149:0/765619436 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32800bd50 con 0x7fc3380ca5f0 2023-06-09T04:37:21.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 -- 172.21.15.149:0/765619436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380ca5f0 msgr2=0x7fc3380716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:21.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/765619436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380ca5f0 0x7fc3380716c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc3380af080 tx=0x7fc328009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:21.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 -- 172.21.15.149:0/765619436 shutdown_connections 2023-06-09T04:37:21.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/765619436 >> v2:172.21.15.184:3300/0 conn(0x7fc3380cc020 0x7fc3380cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/765619436 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc338159260 0x7fc338071ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/765619436 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380ca5f0 0x7fc3380716c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 -- 172.21.15.149:0/765619436 >> 172.21.15.149:0/765619436 conn(0x7fc33806aec0 msgr2=0x7fc33806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:21.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 -- 172.21.15.149:0/765619436 shutdown_connections 2023-06-09T04:37:21.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.665+0000 7fc33e4a7700 1 -- 172.21.15.149:0/765619436 wait complete. 2023-06-09T04:37:21.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.666+0000 7fc33e4a7700 1 Processor -- start 2023-06-09T04:37:21.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.666+0000 7fc33e4a7700 1 -- start start 2023-06-09T04:37:21.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc33e4a7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3380ca5f0 0x7fc3380c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc33e4a7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380cc020 0x7fc338153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc33e4a7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc338159260 0x7fc3380c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc33e4a7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380c7eb0 con 0x7fc3380cc020 2023-06-09T04:37:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc33e4a7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380c7670 con 0x7fc338159260 2023-06-09T04:37:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc33e4a7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380c78f0 con 0x7fc3380ca5f0 2023-06-09T04:37:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380cc020 0x7fc338153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:21.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380cc020 0x7fc338153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36734/0 (socket says 172.21.15.149:36734) 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 -- 172.21.15.149:0/3854068360 learned_addr learned my addr 172.21.15.149:0/3854068360 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc337fff700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3380ca5f0 0x7fc3380c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc33ca44700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc338159260 0x7fc3380c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 -- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3380ca5f0 msgr2=0x7fc3380c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3380ca5f0 0x7fc3380c7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 -- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc338159260 msgr2=0x7fc3380c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc338159260 0x7fc3380c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.667+0000 7fc3377fe700 1 -- 172.21.15.149:0/3854068360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328009550 con 0x7fc3380cc020 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.668+0000 7fc3377fe700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380cc020 0x7fc338153ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc328000c00 tx=0x7fc328004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.668+0000 7fc334ff9700 1 -- 172.21.15.149:0/3854068360 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc328004450 con 0x7fc3380cc020 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.668+0000 7fc334ff9700 1 -- 172.21.15.149:0/3854068360 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32801e070 con 0x7fc3380cc020 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.668+0000 7fc334ff9700 1 -- 172.21.15.149:0/3854068360 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3280038e0 con 0x7fc3380cc020 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.668+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3380c7bd0 con 0x7fc3380cc020 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.668+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc338159c40 con 0x7fc3380cc020 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.669+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3381597c0 con 0x7fc3380cc020 2023-06-09T04:37:21.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.669+0000 7fc334ff9700 1 -- 172.21.15.149:0/3854068360 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc328003a40 con 0x7fc3380cc020 2023-06-09T04:37:21.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.669+0000 7fc334ff9700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc32406ace0 0x7fc32406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:21.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.670+0000 7fc334ff9700 1 -- 172.21.15.149:0/3854068360 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc328020070 con 0x7fc3380cc020 2023-06-09T04:37:21.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.670+0000 7fc337fff700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc32406ace0 0x7fc32406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:21.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.670+0000 7fc337fff700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc32406ace0 0x7fc32406d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc32c006b20 tx=0x7fc32c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:21.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.674+0000 7fc334ff9700 1 -- 172.21.15.149:0/3854068360 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3381597c0 con 0x7fc3380cc020 2023-06-09T04:37:21.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.863+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc3381597c0 con 0x7fc3380cc020 2023-06-09T04:37:21.864 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.863+0000 7fc334ff9700 1 -- 172.21.15.149:0/3854068360 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3381597c0 con 0x7fc3380cc020 2023-06-09T04:37:21.865 INFO:teuthology.orchestra.run.smithi149.stdout:64424509451 2023-06-09T04:37:21.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc32406ace0 msgr2=0x7fc32406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:21.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc32406ace0 0x7fc32406d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc32c006b20 tx=0x7fc32c008040 comp rx=0 tx=0).stop 2023-06-09T04:37:21.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380cc020 msgr2=0x7fc338153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:21.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380cc020 0x7fc338153ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc328000c00 tx=0x7fc328004750 comp rx=0 tx=0).stop 2023-06-09T04:37:21.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 shutdown_connections 2023-06-09T04:37:21.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc32406ace0 0x7fc32406d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3380ca5f0 0x7fc3380c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc338159260 0x7fc3380c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 --2- 172.21.15.149:0/3854068360 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3380cc020 0x7fc338153ea0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:21.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 >> 172.21.15.149:0/3854068360 conn(0x7fc33806aec0 msgr2=0x7fc3380caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:21.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 shutdown_connections 2023-06-09T04:37:21.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.865+0000 7fc33e4a7700 1 -- 172.21.15.149:0/3854068360 wait complete. 2023-06-09T04:37:21.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2023-06-09T04:37:21.879 DEBUG:teuthology.parallel:result is None 2023-06-09T04:37:21.879 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-09T04:37:21.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:37:21.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.997+0000 7efc273de700 1 Processor -- start 2023-06-09T04:37:21.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.998+0000 7efc273de700 1 -- start start 2023-06-09T04:37:22.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.998+0000 7efc273de700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc2015c590 0x7efc200af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.998+0000 7efc273de700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efc200ccba0 0x7efc200b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.998+0000 7efc273de700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc200af050 con 0x7efc20069db0 2023-06-09T04:37:22.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.998+0000 7efc273de700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200afae0 con 0x7efc2015c590 2023-06-09T04:37:22.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.998+0000 7efc273de700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200af800 con 0x7efc200ccba0 2023-06-09T04:37:22.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2517a700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7efc2015c590 0x7efc200af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2597b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7efc20069db0 0x7efc2015fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60608/0 (socket says 172.21.15.149:60608) 2023-06-09T04:37:22.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2597b700 1 -- 172.21.15.149:0/3572737148 learned_addr learned my addr 172.21.15.149:0/3572737148 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:22.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc24979700 1 --2- 172.21.15.149:0/3572737148 >> v2:172.21.15.184:3300/0 conn(0x7efc200ccba0 0x7efc200b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2517a700 1 -- 172.21.15.149:0/3572737148 >> v2:172.21.15.184:3300/0 conn(0x7efc200ccba0 msgr2=0x7efc200b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:22.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2517a700 1 --2- 172.21.15.149:0/3572737148 >> v2:172.21.15.184:3300/0 conn(0x7efc200ccba0 0x7efc200b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2517a700 1 -- 172.21.15.149:0/3572737148 >> v1:172.21.15.149:6789/0 conn(0x7efc20069db0 legacy=0x7efc2015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2517a700 1 -- 172.21.15.149:0/3572737148 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc200cc0c0 con 0x7efc2015c590 2023-06-09T04:37:22.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc17fff700 1 -- 172.21.15.149:0/3572737148 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476444204 0 0) 0x7efc200af050 con 0x7efc20069db0 2023-06-09T04:37:22.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc24979700 1 --2- 172.21.15.149:0/3572737148 >> v2:172.21.15.184:3300/0 conn(0x7efc200ccba0 0x7efc200b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:22.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc2517a700 1 --2- 172.21.15.149:0/3572737148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2015c590 0x7efc200af220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efc200b21e0 tx=0x7efc10009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1548effcf9e42d9e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc17fff700 1 -- 172.21.15.149:0/3572737148 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10005e30 con 0x7efc2015c590 2023-06-09T04:37:22.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc17fff700 1 -- 172.21.15.149:0/3572737148 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10006030 con 0x7efc2015c590 2023-06-09T04:37:22.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:21.999+0000 7efc17fff700 1 -- 172.21.15.149:0/3572737148 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100063c0 con 0x7efc2015c590 2023-06-09T04:37:22.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 -- 172.21.15.149:0/3572737148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2015c590 msgr2=0x7efc200af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 --2- 172.21.15.149:0/3572737148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2015c590 0x7efc200af220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efc200b21e0 tx=0x7efc10009b00 comp rx=0 tx=0).stop 2023-06-09T04:37:22.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 -- 172.21.15.149:0/3572737148 shutdown_connections 2023-06-09T04:37:22.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 --2- 172.21.15.149:0/3572737148 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc2015c590 0x7efc200af220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 --2- 172.21.15.149:0/3572737148 >> v2:172.21.15.184:3300/0 conn(0x7efc200ccba0 0x7efc200b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 -- 172.21.15.149:0/3572737148 >> 172.21.15.149:0/3572737148 conn(0x7efc2006b7e0 msgr2=0x7efc200cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 -- 172.21.15.149:0/3572737148 shutdown_connections 2023-06-09T04:37:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.000+0000 7efc273de700 1 -- 172.21.15.149:0/3572737148 wait complete. 2023-06-09T04:37:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.001+0000 7efc273de700 1 Processor -- start 2023-06-09T04:37:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.001+0000 7efc273de700 1 -- start start 2023-06-09T04:37:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc273de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc20069db0 0x7efc200b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc273de700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc200ccba0 0x7efc200b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc273de700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc2015c590 0x7efc2014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc273de700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc200b3830 con 0x7efc20069db0 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc273de700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc201594c0 con 0x7efc2015c590 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc273de700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc200b2bb0 con 0x7efc200ccba0 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc20069db0 0x7efc200b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc20069db0 0x7efc200b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36746/0 (socket says 172.21.15.149:36746) 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 -- 172.21.15.149:0/690401970 learned_addr learned my addr 172.21.15.149:0/690401970 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc24979700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc200ccba0 0x7efc200b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 -- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc200ccba0 msgr2=0x7efc200b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc200ccba0 0x7efc200b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2597b700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc2015c590 0x7efc2014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 -- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc2015c590 msgr2=0x7efc2014ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc2015c590 0x7efc2014ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 -- 172.21.15.149:0/690401970 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10009430 con 0x7efc20069db0 2023-06-09T04:37:22.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc2517a700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc20069db0 0x7efc200b3c50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc10000c00 tx=0x7efc10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc15ffb700 1 -- 172.21.15.149:0/690401970 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10004240 con 0x7efc20069db0 2023-06-09T04:37:22.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc15ffb700 1 -- 172.21.15.149:0/690401970 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc100043c0 con 0x7efc20069db0 2023-06-09T04:37:22.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc200b2e90 con 0x7efc20069db0 2023-06-09T04:37:22.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.002+0000 7efc15ffb700 1 -- 172.21.15.149:0/690401970 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100036a0 con 0x7efc20069db0 2023-06-09T04:37:22.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.003+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc200b3450 con 0x7efc20069db0 2023-06-09T04:37:22.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.004+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc20073fa0 con 0x7efc20069db0 2023-06-09T04:37:22.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.005+0000 7efc15ffb700 1 -- 172.21.15.149:0/690401970 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc10022070 con 0x7efc20069db0 2023-06-09T04:37:22.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.005+0000 7efc15ffb700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7efc0406ace0 0x7efc0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.005+0000 7efc15ffb700 1 -- 172.21.15.149:0/690401970 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efc1008b7a0 con 0x7efc20069db0 2023-06-09T04:37:22.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.005+0000 7efc24979700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7efc0406ace0 0x7efc0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.006+0000 7efc24979700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7efc0406ace0 0x7efc0406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006fd0 tx=0x7efc1c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.009+0000 7efc15ffb700 1 -- 172.21.15.149:0/690401970 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efc100565d0 con 0x7efc20069db0 2023-06-09T04:37:22.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.192+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 --> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc200cc680 con 0x7efc0406ace0 2023-06-09T04:37:22.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.201+0000 7efc15ffb700 1 -- 172.21.15.149:0/690401970 <== mgr.4101 v2:172.21.15.149:6832/2920572545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367522 (secure 0 0 0) 0x7efc1c00c040 con 0x7efc0406ace0 2023-06-09T04:37:22.206 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:22.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7efc0406ace0 msgr2=0x7efc0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7efc0406ace0 0x7efc0406d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006fd0 tx=0x7efc1c008040 comp rx=0 tx=0).stop 2023-06-09T04:37:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc20069db0 msgr2=0x7efc200b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc20069db0 0x7efc200b3c50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efc10000c00 tx=0x7efc10004750 comp rx=0 tx=0).stop 2023-06-09T04:37:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 shutdown_connections 2023-06-09T04:37:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7efc0406ace0 0x7efc0406d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc2015c590 0x7efc2014ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc20069db0 0x7efc200b3c50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 --2- 172.21.15.149:0/690401970 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7efc200ccba0 0x7efc200b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 >> 172.21.15.149:0/690401970 conn(0x7efc2006b7e0 msgr2=0x7efc200cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 shutdown_connections 2023-06-09T04:37:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.205+0000 7efc273de700 1 -- 172.21.15.149:0/690401970 wait complete. 2023-06-09T04:37:22.210 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-06-09T04:37:22.219 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-06-09T04:37:20.397644+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218948,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":3411968,"data_stored":2079591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003418"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518193+0000","last_change":"2023-06-09T04:36:53.082985+0000","last_active":"2023-06-09T04:36:57.518193+0000","last_peered":"2023-06-09T04:36:57.518193+0000","last_clean":"2023-06-09T04:36:57.518193+0000","last_became_active":"2023-06-09T04:36:53.082762+0000","last_became_peered":"2023-06-09T04:36:53.082762+0000","last_unstale":"2023-06-09T04:36:57.518193+0000","last_undegraded":"2023-06-09T04:36:57.518193+0000","last_fullsized":"2023-06-09T04:36:57.518193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:52.981825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501460+0000","last_change":"2023-06-09T04:36:53.092173+0000","last_active":"2023-06-09T04:36:57.501460+0000","last_peered":"2023-06-09T04:36:57.501460+0000","last_clean":"2023-06-09T04:36:57.501460+0000","last_became_active":"2023-06-09T04:36:53.091883+0000","last_became_peered":"2023-06-09T04:36:53.091883+0000","last_unstale":"2023-06-09T04:36:57.501460+0000","last_undegraded":"2023-06-09T04:36:57.501460+0000","last_fullsized":"2023-06-09T04:36:57.501460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502629+0000","last_change":"2023-06-09T04:36:53.082161+0000","last_active":"2023-06-09T04:36:57.502629+0000","last_peered":"2023-06-09T04:36:57.502629+0000","last_clean":"2023-06-09T04:36:57.502629+0000","last_became_active":"2023-06-09T04:36:53.081730+0000","last_became_peered":"2023-06-09T04:36:53.081730+0000","last_unstale":"2023-06-09T04:36:57.502629+0000","last_undegraded":"2023-06-09T04:36:57.502629+0000","last_fullsized":"2023-06-09T04:36:57.502629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:27:35.361250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516551+0000","last_change":"2023-06-09T04:36:53.091571+0000","last_active":"2023-06-09T04:36:57.516551+0000","last_peered":"2023-06-09T04:36:57.516551+0000","last_clean":"2023-06-09T04:36:57.516551+0000","last_became_active":"2023-06-09T04:36:53.091231+0000","last_became_peered":"2023-06-09T04:36:53.091231+0000","last_unstale":"2023-06-09T04:36:57.516551+0000","last_undegraded":"2023-06-09T04:36:57.516551+0000","last_fullsized":"2023-06-09T04:36:57.516551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:59:04.716639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500415+0000","last_change":"2023-06-09T04:36:53.080466+0000","last_active":"2023-06-09T04:36:57.500415+0000","last_peered":"2023-06-09T04:36:57.500415+0000","last_clean":"2023-06-09T04:36:57.500415+0000","last_became_active":"2023-06-09T04:36:53.080202+0000","last_became_peered":"2023-06-09T04:36:53.080202+0000","last_unstale":"2023-06-09T04:36:57.500415+0000","last_undegraded":"2023-06-09T04:36:57.500415+0000","last_fullsized":"2023-06-09T04:36:57.500415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:46.590852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502000+0000","last_change":"2023-06-09T04:36:53.085316+0000","last_active":"2023-06-09T04:36:57.502000+0000","last_peered":"2023-06-09T04:36:57.502000+0000","last_clean":"2023-06-09T04:36:57.502000+0000","last_became_active":"2023-06-09T04:36:53.085026+0000","last_became_peered":"2023-06-09T04:36:53.085026+0000","last_unstale":"2023-06-09T04:36:57.502000+0000","last_undegraded":"2023-06-09T04:36:57.502000+0000","last_fullsized":"2023-06-09T04:36:57.502000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:31.842402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516514+0000","last_change":"2023-06-09T04:36:53.095876+0000","last_active":"2023-06-09T04:36:57.516514+0000","last_peered":"2023-06-09T04:36:57.516514+0000","last_clean":"2023-06-09T04:36:57.516514+0000","last_became_active":"2023-06-09T04:36:53.095604+0000","last_became_peered":"2023-06-09T04:36:53.095604+0000","last_unstale":"2023-06-09T04:36:57.516514+0000","last_undegraded":"2023-06-09T04:36:57.516514+0000","last_fullsized":"2023-06-09T04:36:57.516514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:00.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500546+0000","last_change":"2023-06-09T04:36:53.089342+0000","last_active":"2023-06-09T04:36:57.500546+0000","last_peered":"2023-06-09T04:36:57.500546+0000","last_clean":"2023-06-09T04:36:57.500546+0000","last_became_active":"2023-06-09T04:36:53.089039+0000","last_became_peered":"2023-06-09T04:36:53.089039+0000","last_unstale":"2023-06-09T04:36:57.500546+0000","last_undegraded":"2023-06-09T04:36:57.500546+0000","last_fullsized":"2023-06-09T04:36:57.500546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:19.525415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500861+0000","last_change":"2023-06-09T04:36:53.087617+0000","last_active":"2023-06-09T04:36:57.500861+0000","last_peered":"2023-06-09T04:36:57.500861+0000","last_clean":"2023-06-09T04:36:57.500861+0000","last_became_active":"2023-06-09T04:36:53.086962+0000","last_became_peered":"2023-06-09T04:36:53.086962+0000","last_unstale":"2023-06-09T04:36:57.500861+0000","last_undegraded":"2023-06-09T04:36:57.500861+0000","last_fullsized":"2023-06-09T04:36:57.500861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502145+0000","last_change":"2023-06-09T04:36:53.086101+0000","last_active":"2023-06-09T04:36:57.502145+0000","last_peered":"2023-06-09T04:36:57.502145+0000","last_clean":"2023-06-09T04:36:57.502145+0000","last_became_active":"2023-06-09T04:36:53.085845+0000","last_became_peered":"2023-06-09T04:36:53.085845+0000","last_unstale":"2023-06-09T04:36:57.502145+0000","last_undegraded":"2023-06-09T04:36:57.502145+0000","last_fullsized":"2023-06-09T04:36:57.502145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502428+0000","last_change":"2023-06-09T04:36:53.081983+0000","last_active":"2023-06-09T04:36:57.502428+0000","last_peered":"2023-06-09T04:36:57.502428+0000","last_clean":"2023-06-09T04:36:57.502428+0000","last_became_active":"2023-06-09T04:36:53.081436+0000","last_became_peered":"2023-06-09T04:36:53.081436+0000","last_unstale":"2023-06-09T04:36:57.502428+0000","last_undegraded":"2023-06-09T04:36:57.502428+0000","last_fullsized":"2023-06-09T04:36:57.502428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:21:57.284108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517008+0000","last_change":"2023-06-09T04:36:53.091581+0000","last_active":"2023-06-09T04:36:57.517008+0000","last_peered":"2023-06-09T04:36:57.517008+0000","last_clean":"2023-06-09T04:36:57.517008+0000","last_became_active":"2023-06-09T04:36:53.091344+0000","last_became_peered":"2023-06-09T04:36:53.091344+0000","last_unstale":"2023-06-09T04:36:57.517008+0000","last_undegraded":"2023-06-09T04:36:57.517008+0000","last_fullsized":"2023-06-09T04:36:57.517008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:58.932374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516760+0000","last_change":"2023-06-09T04:36:53.079790+0000","last_active":"2023-06-09T04:36:57.516760+0000","last_peered":"2023-06-09T04:36:57.516760+0000","last_clean":"2023-06-09T04:36:57.516760+0000","last_became_active":"2023-06-09T04:36:53.079521+0000","last_became_peered":"2023-06-09T04:36:53.079521+0000","last_unstale":"2023-06-09T04:36:57.516760+0000","last_undegraded":"2023-06-09T04:36:57.516760+0000","last_fullsized":"2023-06-09T04:36:57.516760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:42:47.447288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501345+0000","last_change":"2023-06-09T04:36:53.085801+0000","last_active":"2023-06-09T04:36:57.501345+0000","last_peered":"2023-06-09T04:36:57.501345+0000","last_clean":"2023-06-09T04:36:57.501345+0000","last_became_active":"2023-06-09T04:36:53.085510+0000","last_became_peered":"2023-06-09T04:36:53.085510+0000","last_unstale":"2023-06-09T04:36:57.501345+0000","last_undegraded":"2023-06-09T04:36:57.501345+0000","last_fullsized":"2023-06-09T04:36:57.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516281+0000","last_change":"2023-06-09T04:36:53.095858+0000","last_active":"2023-06-09T04:36:57.516281+0000","last_peered":"2023-06-09T04:36:57.516281+0000","last_clean":"2023-06-09T04:36:57.516281+0000","last_became_active":"2023-06-09T04:36:53.095564+0000","last_became_peered":"2023-06-09T04:36:53.095564+0000","last_unstale":"2023-06-09T04:36:57.516281+0000","last_undegraded":"2023-06-09T04:36:57.516281+0000","last_fullsized":"2023-06-09T04:36:57.516281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502192+0000","last_change":"2023-06-09T04:36:53.087327+0000","last_active":"2023-06-09T04:36:57.502192+0000","last_peered":"2023-06-09T04:36:57.502192+0000","last_clean":"2023-06-09T04:36:57.502192+0000","last_became_active":"2023-06-09T04:36:53.087056+0000","last_became_peered":"2023-06-09T04:36:53.087056+0000","last_unstale":"2023-06-09T04:36:57.502192+0000","last_undegraded":"2023-06-09T04:36:57.502192+0000","last_fullsized":"2023-06-09T04:36:57.502192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:14.334505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500728+0000","last_change":"2023-06-09T04:36:53.087787+0000","last_active":"2023-06-09T04:36:57.500728+0000","last_peered":"2023-06-09T04:36:57.500728+0000","last_clean":"2023-06-09T04:36:57.500728+0000","last_became_active":"2023-06-09T04:36:53.087324+0000","last_became_peered":"2023-06-09T04:36:53.087324+0000","last_unstale":"2023-06-09T04:36:57.500728+0000","last_undegraded":"2023-06-09T04:36:57.500728+0000","last_fullsized":"2023-06-09T04:36:57.500728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502659+0000","last_change":"2023-06-09T04:36:53.087244+0000","last_active":"2023-06-09T04:36:57.502659+0000","last_peered":"2023-06-09T04:36:57.502659+0000","last_clean":"2023-06-09T04:36:57.502659+0000","last_became_active":"2023-06-09T04:36:53.086960+0000","last_became_peered":"2023-06-09T04:36:53.086960+0000","last_unstale":"2023-06-09T04:36:57.502659+0000","last_undegraded":"2023-06-09T04:36:57.502659+0000","last_fullsized":"2023-06-09T04:36:57.502659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:55.924392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517576+0000","last_change":"2023-06-09T04:36:53.093961+0000","last_active":"2023-06-09T04:36:57.517576+0000","last_peered":"2023-06-09T04:36:57.517576+0000","last_clean":"2023-06-09T04:36:57.517576+0000","last_became_active":"2023-06-09T04:36:53.093752+0000","last_became_peered":"2023-06-09T04:36:53.093752+0000","last_unstale":"2023-06-09T04:36:57.517576+0000","last_undegraded":"2023-06-09T04:36:57.517576+0000","last_fullsized":"2023-06-09T04:36:57.517576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:45.981753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501974+0000","last_change":"2023-06-09T04:36:53.080631+0000","last_active":"2023-06-09T04:36:57.501974+0000","last_peered":"2023-06-09T04:36:57.501974+0000","last_clean":"2023-06-09T04:36:57.501974+0000","last_became_active":"2023-06-09T04:36:53.080361+0000","last_became_peered":"2023-06-09T04:36:53.080361+0000","last_unstale":"2023-06-09T04:36:57.501974+0000","last_undegraded":"2023-06-09T04:36:57.501974+0000","last_fullsized":"2023-06-09T04:36:57.501974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:18.986311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516459+0000","last_change":"2023-06-09T04:36:53.093919+0000","last_active":"2023-06-09T04:36:57.516459+0000","last_peered":"2023-06-09T04:36:57.516459+0000","last_clean":"2023-06-09T04:36:57.516459+0000","last_became_active":"2023-06-09T04:36:53.093661+0000","last_became_peered":"2023-06-09T04:36:53.093661+0000","last_unstale":"2023-06-09T04:36:57.516459+0000","last_undegraded":"2023-06-09T04:36:57.516459+0000","last_fullsized":"2023-06-09T04:36:57.516459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500031+0000","last_change":"2023-06-09T04:36:53.088748+0000","last_active":"2023-06-09T04:36:57.500031+0000","last_peered":"2023-06-09T04:36:57.500031+0000","last_clean":"2023-06-09T04:36:57.500031+0000","last_became_active":"2023-06-09T04:36:53.088502+0000","last_became_peered":"2023-06-09T04:36:53.088502+0000","last_unstale":"2023-06-09T04:36:57.500031+0000","last_undegraded":"2023-06-09T04:36:57.500031+0000","last_fullsized":"2023-06-09T04:36:57.500031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517058+0000","last_change":"2023-06-09T04:36:53.083847+0000","last_active":"2023-06-09T04:36:57.517058+0000","last_peered":"2023-06-09T04:36:57.517058+0000","last_clean":"2023-06-09T04:36:57.517058+0000","last_became_active":"2023-06-09T04:36:53.083583+0000","last_became_peered":"2023-06-09T04:36:53.083583+0000","last_unstale":"2023-06-09T04:36:57.517058+0000","last_undegraded":"2023-06-09T04:36:57.517058+0000","last_fullsized":"2023-06-09T04:36:57.517058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:03.284187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516893+0000","last_change":"2023-06-09T04:36:53.095654+0000","last_active":"2023-06-09T04:36:57.516893+0000","last_peered":"2023-06-09T04:36:57.516893+0000","last_clean":"2023-06-09T04:36:57.516893+0000","last_became_active":"2023-06-09T04:36:53.095185+0000","last_became_peered":"2023-06-09T04:36:53.095185+0000","last_unstale":"2023-06-09T04:36:57.516893+0000","last_undegraded":"2023-06-09T04:36:57.516893+0000","last_fullsized":"2023-06-09T04:36:57.516893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:55:22.307750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517490+0000","last_change":"2023-06-09T04:36:53.097881+0000","last_active":"2023-06-09T04:36:57.517490+0000","last_peered":"2023-06-09T04:36:57.517490+0000","last_clean":"2023-06-09T04:36:57.517490+0000","last_became_active":"2023-06-09T04:36:53.097547+0000","last_became_peered":"2023-06-09T04:36:53.097547+0000","last_unstale":"2023-06-09T04:36:57.517490+0000","last_undegraded":"2023-06-09T04:36:57.517490+0000","last_fullsized":"2023-06-09T04:36:57.517490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:04.707925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517800+0000","last_change":"2023-06-09T04:36:53.086120+0000","last_active":"2023-06-09T04:36:57.517800+0000","last_peered":"2023-06-09T04:36:57.517800+0000","last_clean":"2023-06-09T04:36:57.517800+0000","last_became_active":"2023-06-09T04:36:53.084767+0000","last_became_peered":"2023-06-09T04:36:53.084767+0000","last_unstale":"2023-06-09T04:36:57.517800+0000","last_undegraded":"2023-06-09T04:36:57.517800+0000","last_fullsized":"2023-06-09T04:36:57.517800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:21.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501176+0000","last_change":"2023-06-09T04:36:53.097702+0000","last_active":"2023-06-09T04:36:57.501176+0000","last_peered":"2023-06-09T04:36:57.501176+0000","last_clean":"2023-06-09T04:36:57.501176+0000","last_became_active":"2023-06-09T04:36:53.097430+0000","last_became_peered":"2023-06-09T04:36:53.097430+0000","last_unstale":"2023-06-09T04:36:57.501176+0000","last_undegraded":"2023-06-09T04:36:57.501176+0000","last_fullsized":"2023-06-09T04:36:57.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:53.656092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502448+0000","last_change":"2023-06-09T04:36:57.111577+0000","last_active":"2023-06-09T04:36:57.502448+0000","last_peered":"2023-06-09T04:36:57.502448+0000","last_clean":"2023-06-09T04:36:57.502448+0000","last_became_active":"2023-06-09T04:36:57.111245+0000","last_became_peered":"2023-06-09T04:36:57.111245+0000","last_unstale":"2023-06-09T04:36:57.502448+0000","last_undegraded":"2023-06-09T04:36:57.502448+0000","last_fullsized":"2023-06-09T04:36:57.502448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:23:59.825454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501854+0000","last_change":"2023-06-09T04:36:52.689588+0000","last_active":"2023-06-09T04:36:57.501854+0000","last_peered":"2023-06-09T04:36:57.501854+0000","last_clean":"2023-06-09T04:36:57.501854+0000","last_became_active":"2023-06-09T04:36:52.689361+0000","last_became_peered":"2023-06-09T04:36:52.689361+0000","last_unstale":"2023-06-09T04:36:57.501854+0000","last_undegraded":"2023-06-09T04:36:57.501854+0000","last_fullsized":"2023-06-09T04:36:57.501854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:58.398325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518173+0000","last_change":"2023-06-09T04:36:53.091208+0000","last_active":"2023-06-09T04:36:57.518173+0000","last_peered":"2023-06-09T04:36:57.518173+0000","last_clean":"2023-06-09T04:36:57.518173+0000","last_became_active":"2023-06-09T04:36:53.090968+0000","last_became_peered":"2023-06-09T04:36:53.090968+0000","last_unstale":"2023-06-09T04:36:57.518173+0000","last_undegraded":"2023-06-09T04:36:57.518173+0000","last_fullsized":"2023-06-09T04:36:57.518173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:13.600595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517253+0000","last_change":"2023-06-09T04:36:57.119505+0000","last_active":"2023-06-09T04:36:57.517253+0000","last_peered":"2023-06-09T04:36:57.517253+0000","last_clean":"2023-06-09T04:36:57.517253+0000","last_became_active":"2023-06-09T04:36:57.119057+0000","last_became_peered":"2023-06-09T04:36:57.119057+0000","last_unstale":"2023-06-09T04:36:57.517253+0000","last_undegraded":"2023-06-09T04:36:57.517253+0000","last_fullsized":"2023-06-09T04:36:57.517253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:49:47.898866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515849+0000","last_change":"2023-06-09T04:36:52.689176+0000","last_active":"2023-06-09T04:36:57.515849+0000","last_peered":"2023-06-09T04:36:57.515849+0000","last_clean":"2023-06-09T04:36:57.515849+0000","last_became_active":"2023-06-09T04:36:52.688832+0000","last_became_peered":"2023-06-09T04:36:52.688832+0000","last_unstale":"2023-06-09T04:36:57.515849+0000","last_undegraded":"2023-06-09T04:36:57.515849+0000","last_fullsized":"2023-06-09T04:36:57.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:30.392902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500719+0000","last_change":"2023-06-09T04:36:53.084730+0000","last_active":"2023-06-09T04:36:57.500719+0000","last_peered":"2023-06-09T04:36:57.500719+0000","last_clean":"2023-06-09T04:36:57.500719+0000","last_became_active":"2023-06-09T04:36:53.084457+0000","last_became_peered":"2023-06-09T04:36:53.084457+0000","last_unstale":"2023-06-09T04:36:57.500719+0000","last_undegraded":"2023-06-09T04:36:57.500719+0000","last_fullsized":"2023-06-09T04:36:57.500719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:46.230118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500777+0000","last_change":"2023-06-09T04:36:57.115570+0000","last_active":"2023-06-09T04:36:57.500777+0000","last_peered":"2023-06-09T04:36:57.500777+0000","last_clean":"2023-06-09T04:36:57.500777+0000","last_became_active":"2023-06-09T04:36:57.115189+0000","last_became_peered":"2023-06-09T04:36:57.115189+0000","last_unstale":"2023-06-09T04:36:57.500777+0000","last_undegraded":"2023-06-09T04:36:57.500777+0000","last_fullsized":"2023-06-09T04:36:57.500777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:03.834311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516808+0000","last_change":"2023-06-09T04:36:52.687655+0000","last_active":"2023-06-09T04:36:57.516808+0000","last_peered":"2023-06-09T04:36:57.516808+0000","last_clean":"2023-06-09T04:36:57.516808+0000","last_became_active":"2023-06-09T04:36:52.687400+0000","last_became_peered":"2023-06-09T04:36:52.687400+0000","last_unstale":"2023-06-09T04:36:57.516808+0000","last_undegraded":"2023-06-09T04:36:57.516808+0000","last_fullsized":"2023-06-09T04:36:57.516808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:27:37.159215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517354+0000","last_change":"2023-06-09T04:36:53.092476+0000","last_active":"2023-06-09T04:36:57.517354+0000","last_peered":"2023-06-09T04:36:57.517354+0000","last_clean":"2023-06-09T04:36:57.517354+0000","last_became_active":"2023-06-09T04:36:53.091216+0000","last_became_peered":"2023-06-09T04:36:53.091216+0000","last_unstale":"2023-06-09T04:36:57.517354+0000","last_undegraded":"2023-06-09T04:36:57.517354+0000","last_fullsized":"2023-06-09T04:36:57.517354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:18:25.432988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515945+0000","last_change":"2023-06-09T04:36:57.117686+0000","last_active":"2023-06-09T04:36:57.515945+0000","last_peered":"2023-06-09T04:36:57.515945+0000","last_clean":"2023-06-09T04:36:57.515945+0000","last_became_active":"2023-06-09T04:36:57.117316+0000","last_became_peered":"2023-06-09T04:36:57.117316+0000","last_unstale":"2023-06-09T04:36:57.515945+0000","last_undegraded":"2023-06-09T04:36:57.515945+0000","last_fullsized":"2023-06-09T04:36:57.515945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:39:59.205133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500858+0000","last_change":"2023-06-09T04:36:52.680452+0000","last_active":"2023-06-09T04:36:57.500858+0000","last_peered":"2023-06-09T04:36:57.500858+0000","last_clean":"2023-06-09T04:36:57.500858+0000","last_became_active":"2023-06-09T04:36:52.680163+0000","last_became_peered":"2023-06-09T04:36:52.680163+0000","last_unstale":"2023-06-09T04:36:57.500858+0000","last_undegraded":"2023-06-09T04:36:57.500858+0000","last_fullsized":"2023-06-09T04:36:57.500858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516765+0000","last_change":"2023-06-09T04:36:53.082234+0000","last_active":"2023-06-09T04:36:57.516765+0000","last_peered":"2023-06-09T04:36:57.516765+0000","last_clean":"2023-06-09T04:36:57.516765+0000","last_became_active":"2023-06-09T04:36:53.081968+0000","last_became_peered":"2023-06-09T04:36:53.081968+0000","last_unstale":"2023-06-09T04:36:57.516765+0000","last_undegraded":"2023-06-09T04:36:57.516765+0000","last_fullsized":"2023-06-09T04:36:57.516765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:56.517310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515939+0000","last_change":"2023-06-09T04:36:57.124201+0000","last_active":"2023-06-09T04:36:57.515939+0000","last_peered":"2023-06-09T04:36:57.515939+0000","last_clean":"2023-06-09T04:36:57.515939+0000","last_became_active":"2023-06-09T04:36:57.123897+0000","last_became_peered":"2023-06-09T04:36:57.123897+0000","last_unstale":"2023-06-09T04:36:57.515939+0000","last_undegraded":"2023-06-09T04:36:57.515939+0000","last_fullsized":"2023-06-09T04:36:57.515939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:57.073264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501691+0000","last_change":"2023-06-09T04:36:52.685020+0000","last_active":"2023-06-09T04:36:57.501691+0000","last_peered":"2023-06-09T04:36:57.501691+0000","last_clean":"2023-06-09T04:36:57.501691+0000","last_became_active":"2023-06-09T04:36:52.684745+0000","last_became_peered":"2023-06-09T04:36:52.684745+0000","last_unstale":"2023-06-09T04:36:57.501691+0000","last_undegraded":"2023-06-09T04:36:57.501691+0000","last_fullsized":"2023-06-09T04:36:57.501691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:59.409669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516410+0000","last_change":"2023-06-09T04:36:53.087590+0000","last_active":"2023-06-09T04:36:57.516410+0000","last_peered":"2023-06-09T04:36:57.516410+0000","last_clean":"2023-06-09T04:36:57.516410+0000","last_became_active":"2023-06-09T04:36:53.087288+0000","last_became_peered":"2023-06-09T04:36:53.087288+0000","last_unstale":"2023-06-09T04:36:57.516410+0000","last_undegraded":"2023-06-09T04:36:57.516410+0000","last_fullsized":"2023-06-09T04:36:57.516410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:08.176626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517477+0000","last_change":"2023-06-09T04:36:57.117163+0000","last_active":"2023-06-09T04:36:57.517477+0000","last_peered":"2023-06-09T04:36:57.517477+0000","last_clean":"2023-06-09T04:36:57.517477+0000","last_became_active":"2023-06-09T04:36:57.116767+0000","last_became_peered":"2023-06-09T04:36:57.116767+0000","last_unstale":"2023-06-09T04:36:57.517477+0000","last_undegraded":"2023-06-09T04:36:57.517477+0000","last_fullsized":"2023-06-09T04:36:57.517477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:19.081920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516877+0000","last_change":"2023-06-09T04:36:52.688067+0000","last_active":"2023-06-09T04:36:57.516877+0000","last_peered":"2023-06-09T04:36:57.516877+0000","last_clean":"2023-06-09T04:36:57.516877+0000","last_became_active":"2023-06-09T04:36:52.687767+0000","last_became_peered":"2023-06-09T04:36:52.687767+0000","last_unstale":"2023-06-09T04:36:57.516877+0000","last_undegraded":"2023-06-09T04:36:57.516877+0000","last_fullsized":"2023-06-09T04:36:57.516877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516575+0000","last_change":"2023-06-09T04:36:53.094793+0000","last_active":"2023-06-09T04:36:57.516575+0000","last_peered":"2023-06-09T04:36:57.516575+0000","last_clean":"2023-06-09T04:36:57.516575+0000","last_became_active":"2023-06-09T04:36:53.094544+0000","last_became_peered":"2023-06-09T04:36:53.094544+0000","last_unstale":"2023-06-09T04:36:57.516575+0000","last_undegraded":"2023-06-09T04:36:57.516575+0000","last_fullsized":"2023-06-09T04:36:57.516575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:23.171635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516588+0000","last_change":"2023-06-09T04:36:57.115780+0000","last_active":"2023-06-09T04:36:57.516588+0000","last_peered":"2023-06-09T04:36:57.516588+0000","last_clean":"2023-06-09T04:36:57.516588+0000","last_became_active":"2023-06-09T04:36:57.115404+0000","last_became_peered":"2023-06-09T04:36:57.115404+0000","last_unstale":"2023-06-09T04:36:57.516588+0000","last_undegraded":"2023-06-09T04:36:57.516588+0000","last_fullsized":"2023-06-09T04:36:57.516588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:51:48.980218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:37:02.349143+0000","last_change":"2023-06-09T04:36:52.692095+0000","last_active":"2023-06-09T04:37:02.349143+0000","last_peered":"2023-06-09T04:37:02.349143+0000","last_clean":"2023-06-09T04:37:02.349143+0000","last_became_active":"2023-06-09T04:36:52.691784+0000","last_became_peered":"2023-06-09T04:36:52.691784+0000","last_unstale":"2023-06-09T04:37:02.349143+0000","last_undegraded":"2023-06-09T04:37:02.349143+0000","last_fullsized":"2023-06-09T04:37:02.349143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:15.356816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502053+0000","last_change":"2023-06-09T04:36:53.090930+0000","last_active":"2023-06-09T04:36:57.502053+0000","last_peered":"2023-06-09T04:36:57.502053+0000","last_clean":"2023-06-09T04:36:57.502053+0000","last_became_active":"2023-06-09T04:36:53.090657+0000","last_became_peered":"2023-06-09T04:36:53.090657+0000","last_unstale":"2023-06-09T04:36:57.502053+0000","last_undegraded":"2023-06-09T04:36:57.502053+0000","last_fullsized":"2023-06-09T04:36:57.502053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:51.015748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501544+0000","last_change":"2023-06-09T04:36:57.117459+0000","last_active":"2023-06-09T04:36:57.501544+0000","last_peered":"2023-06-09T04:36:57.501544+0000","last_clean":"2023-06-09T04:36:57.501544+0000","last_became_active":"2023-06-09T04:36:57.116484+0000","last_became_peered":"2023-06-09T04:36:57.116484+0000","last_unstale":"2023-06-09T04:36:57.501544+0000","last_undegraded":"2023-06-09T04:36:57.501544+0000","last_fullsized":"2023-06-09T04:36:57.501544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:49.647290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516290+0000","last_change":"2023-06-09T04:36:52.695139+0000","last_active":"2023-06-09T04:36:57.516290+0000","last_peered":"2023-06-09T04:36:57.516290+0000","last_clean":"2023-06-09T04:36:57.516290+0000","last_became_active":"2023-06-09T04:36:52.694827+0000","last_became_peered":"2023-06-09T04:36:52.694827+0000","last_unstale":"2023-06-09T04:36:57.516290+0000","last_undegraded":"2023-06-09T04:36:57.516290+0000","last_fullsized":"2023-06-09T04:36:57.516290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517671+0000","last_change":"2023-06-09T04:36:53.095157+0000","last_active":"2023-06-09T04:36:57.517671+0000","last_peered":"2023-06-09T04:36:57.517671+0000","last_clean":"2023-06-09T04:36:57.517671+0000","last_became_active":"2023-06-09T04:36:53.094875+0000","last_became_peered":"2023-06-09T04:36:53.094875+0000","last_unstale":"2023-06-09T04:36:57.517671+0000","last_undegraded":"2023-06-09T04:36:57.517671+0000","last_fullsized":"2023-06-09T04:36:57.517671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.901417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517856+0000","last_change":"2023-06-09T04:36:57.121242+0000","last_active":"2023-06-09T04:36:57.517856+0000","last_peered":"2023-06-09T04:36:57.517856+0000","last_clean":"2023-06-09T04:36:57.517856+0000","last_became_active":"2023-06-09T04:36:57.120828+0000","last_became_peered":"2023-06-09T04:36:57.120828+0000","last_unstale":"2023-06-09T04:36:57.517856+0000","last_undegraded":"2023-06-09T04:36:57.517856+0000","last_fullsized":"2023-06-09T04:36:57.517856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:34.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500201+0000","last_change":"2023-06-09T04:36:52.685837+0000","last_active":"2023-06-09T04:36:57.500201+0000","last_peered":"2023-06-09T04:36:57.500201+0000","last_clean":"2023-06-09T04:36:57.500201+0000","last_became_active":"2023-06-09T04:36:52.685574+0000","last_became_peered":"2023-06-09T04:36:52.685574+0000","last_unstale":"2023-06-09T04:36:57.500201+0000","last_undegraded":"2023-06-09T04:36:57.500201+0000","last_fullsized":"2023-06-09T04:36:57.500201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:30.615879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501059+0000","last_change":"2023-06-09T04:36:53.097686+0000","last_active":"2023-06-09T04:36:57.501059+0000","last_peered":"2023-06-09T04:36:57.501059+0000","last_clean":"2023-06-09T04:36:57.501059+0000","last_became_active":"2023-06-09T04:36:53.097408+0000","last_became_peered":"2023-06-09T04:36:53.097408+0000","last_unstale":"2023-06-09T04:36:57.501059+0000","last_undegraded":"2023-06-09T04:36:57.501059+0000","last_fullsized":"2023-06-09T04:36:57.501059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517413+0000","last_change":"2023-06-09T04:36:57.121670+0000","last_active":"2023-06-09T04:36:57.517413+0000","last_peered":"2023-06-09T04:36:57.517413+0000","last_clean":"2023-06-09T04:36:57.517413+0000","last_became_active":"2023-06-09T04:36:57.121104+0000","last_became_peered":"2023-06-09T04:36:57.121104+0000","last_unstale":"2023-06-09T04:36:57.517413+0000","last_undegraded":"2023-06-09T04:36:57.517413+0000","last_fullsized":"2023-06-09T04:36:57.517413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:16:39.554269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516432+0000","last_change":"2023-06-09T04:36:52.694081+0000","last_active":"2023-06-09T04:36:57.516432+0000","last_peered":"2023-06-09T04:36:57.516432+0000","last_clean":"2023-06-09T04:36:57.516432+0000","last_became_active":"2023-06-09T04:36:52.693752+0000","last_became_peered":"2023-06-09T04:36:52.693752+0000","last_unstale":"2023-06-09T04:36:57.516432+0000","last_undegraded":"2023-06-09T04:36:57.516432+0000","last_fullsized":"2023-06-09T04:36:57.516432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:45.222648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500883+0000","last_change":"2023-06-09T04:36:53.080447+0000","last_active":"2023-06-09T04:36:57.500883+0000","last_peered":"2023-06-09T04:36:57.500883+0000","last_clean":"2023-06-09T04:36:57.500883+0000","last_became_active":"2023-06-09T04:36:53.080171+0000","last_became_peered":"2023-06-09T04:36:53.080171+0000","last_unstale":"2023-06-09T04:36:57.500883+0000","last_undegraded":"2023-06-09T04:36:57.500883+0000","last_fullsized":"2023-06-09T04:36:57.500883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:42.879671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501651+0000","last_change":"2023-06-09T04:36:57.117032+0000","last_active":"2023-06-09T04:36:57.501651+0000","last_peered":"2023-06-09T04:36:57.501651+0000","last_clean":"2023-06-09T04:36:57.501651+0000","last_became_active":"2023-06-09T04:36:57.116612+0000","last_became_peered":"2023-06-09T04:36:57.116612+0000","last_unstale":"2023-06-09T04:36:57.501651+0000","last_undegraded":"2023-06-09T04:36:57.501651+0000","last_fullsized":"2023-06-09T04:36:57.501651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:28.517085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515881+0000","last_change":"2023-06-09T04:36:52.694818+0000","last_active":"2023-06-09T04:36:57.515881+0000","last_peered":"2023-06-09T04:36:57.515881+0000","last_clean":"2023-06-09T04:36:57.515881+0000","last_became_active":"2023-06-09T04:36:52.694511+0000","last_became_peered":"2023-06-09T04:36:52.694511+0000","last_unstale":"2023-06-09T04:36:57.515881+0000","last_undegraded":"2023-06-09T04:36:57.515881+0000","last_fullsized":"2023-06-09T04:36:57.515881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:03:02.382793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517854+0000","last_change":"2023-06-09T04:36:53.093019+0000","last_active":"2023-06-09T04:36:57.517854+0000","last_peered":"2023-06-09T04:36:57.517854+0000","last_clean":"2023-06-09T04:36:57.517854+0000","last_became_active":"2023-06-09T04:36:53.092732+0000","last_became_peered":"2023-06-09T04:36:53.092732+0000","last_unstale":"2023-06-09T04:36:57.517854+0000","last_undegraded":"2023-06-09T04:36:57.517854+0000","last_fullsized":"2023-06-09T04:36:57.517854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:55.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516764+0000","last_change":"2023-06-09T04:36:57.121228+0000","last_active":"2023-06-09T04:36:57.516764+0000","last_peered":"2023-06-09T04:36:57.516764+0000","last_clean":"2023-06-09T04:36:57.516764+0000","last_became_active":"2023-06-09T04:36:57.120064+0000","last_became_peered":"2023-06-09T04:36:57.120064+0000","last_unstale":"2023-06-09T04:36:57.516764+0000","last_undegraded":"2023-06-09T04:36:57.516764+0000","last_fullsized":"2023-06-09T04:36:57.516764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:46.296844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516944+0000","last_change":"2023-06-09T04:36:52.692512+0000","last_active":"2023-06-09T04:36:57.516944+0000","last_peered":"2023-06-09T04:36:57.516944+0000","last_clean":"2023-06-09T04:36:57.516944+0000","last_became_active":"2023-06-09T04:36:52.692141+0000","last_became_peered":"2023-06-09T04:36:52.692141+0000","last_unstale":"2023-06-09T04:36:57.516944+0000","last_undegraded":"2023-06-09T04:36:57.516944+0000","last_fullsized":"2023-06-09T04:36:57.516944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:53:31.420451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500425+0000","last_change":"2023-06-09T04:36:53.091220+0000","last_active":"2023-06-09T04:36:57.500425+0000","last_peered":"2023-06-09T04:36:57.500425+0000","last_clean":"2023-06-09T04:36:57.500425+0000","last_became_active":"2023-06-09T04:36:53.090754+0000","last_became_peered":"2023-06-09T04:36:53.090754+0000","last_unstale":"2023-06-09T04:36:57.500425+0000","last_undegraded":"2023-06-09T04:36:57.500425+0000","last_fullsized":"2023-06-09T04:36:57.500425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:06.194724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516278+0000","last_change":"2023-06-09T04:36:57.113964+0000","last_active":"2023-06-09T04:36:57.516278+0000","last_peered":"2023-06-09T04:36:57.516278+0000","last_clean":"2023-06-09T04:36:57.516278+0000","last_became_active":"2023-06-09T04:36:57.113569+0000","last_became_peered":"2023-06-09T04:36:57.113569+0000","last_unstale":"2023-06-09T04:36:57.516278+0000","last_undegraded":"2023-06-09T04:36:57.516278+0000","last_fullsized":"2023-06-09T04:36:57.516278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:36.118778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516531+0000","last_change":"2023-06-09T04:36:52.692397+0000","last_active":"2023-06-09T04:36:57.516531+0000","last_peered":"2023-06-09T04:36:57.516531+0000","last_clean":"2023-06-09T04:36:57.516531+0000","last_became_active":"2023-06-09T04:36:52.692131+0000","last_became_peered":"2023-06-09T04:36:52.692131+0000","last_unstale":"2023-06-09T04:36:57.516531+0000","last_undegraded":"2023-06-09T04:36:57.516531+0000","last_fullsized":"2023-06-09T04:36:57.516531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:53.328867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501708+0000","last_change":"2023-06-09T04:36:53.091347+0000","last_active":"2023-06-09T04:36:57.501708+0000","last_peered":"2023-06-09T04:36:57.501708+0000","last_clean":"2023-06-09T04:36:57.501708+0000","last_became_active":"2023-06-09T04:36:53.091096+0000","last_became_peered":"2023-06-09T04:36:53.091096+0000","last_unstale":"2023-06-09T04:36:57.501708+0000","last_undegraded":"2023-06-09T04:36:57.501708+0000","last_fullsized":"2023-06-09T04:36:57.501708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:49:02.631814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516638+0000","last_change":"2023-06-09T04:36:57.119015+0000","last_active":"2023-06-09T04:36:57.516638+0000","last_peered":"2023-06-09T04:36:57.516638+0000","last_clean":"2023-06-09T04:36:57.516638+0000","last_became_active":"2023-06-09T04:36:57.118718+0000","last_became_peered":"2023-06-09T04:36:57.118718+0000","last_unstale":"2023-06-09T04:36:57.516638+0000","last_undegraded":"2023-06-09T04:36:57.516638+0000","last_fullsized":"2023-06-09T04:36:57.516638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:37.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516611+0000","last_change":"2023-06-09T04:36:52.687979+0000","last_active":"2023-06-09T04:36:57.516611+0000","last_peered":"2023-06-09T04:36:57.516611+0000","last_clean":"2023-06-09T04:36:57.516611+0000","last_became_active":"2023-06-09T04:36:52.687674+0000","last_became_peered":"2023-06-09T04:36:52.687674+0000","last_unstale":"2023-06-09T04:36:57.516611+0000","last_undegraded":"2023-06-09T04:36:57.516611+0000","last_fullsized":"2023-06-09T04:36:57.516611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515933+0000","last_change":"2023-06-09T04:36:53.092231+0000","last_active":"2023-06-09T04:36:57.515933+0000","last_peered":"2023-06-09T04:36:57.515933+0000","last_clean":"2023-06-09T04:36:57.515933+0000","last_became_active":"2023-06-09T04:36:53.091964+0000","last_became_peered":"2023-06-09T04:36:53.091964+0000","last_unstale":"2023-06-09T04:36:57.515933+0000","last_undegraded":"2023-06-09T04:36:57.515933+0000","last_fullsized":"2023-06-09T04:36:57.515933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:52.833274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516701+0000","last_change":"2023-06-09T04:36:57.112419+0000","last_active":"2023-06-09T04:36:57.516701+0000","last_peered":"2023-06-09T04:36:57.516701+0000","last_clean":"2023-06-09T04:36:57.516701+0000","last_became_active":"2023-06-09T04:36:57.112077+0000","last_became_peered":"2023-06-09T04:36:57.112077+0000","last_unstale":"2023-06-09T04:36:57.516701+0000","last_undegraded":"2023-06-09T04:36:57.516701+0000","last_fullsized":"2023-06-09T04:36:57.516701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:05.009136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501097+0000","last_change":"2023-06-09T04:36:52.688267+0000","last_active":"2023-06-09T04:36:57.501097+0000","last_peered":"2023-06-09T04:36:57.501097+0000","last_clean":"2023-06-09T04:36:57.501097+0000","last_became_active":"2023-06-09T04:36:52.687992+0000","last_became_peered":"2023-06-09T04:36:52.687992+0000","last_unstale":"2023-06-09T04:36:57.501097+0000","last_undegraded":"2023-06-09T04:36:57.501097+0000","last_fullsized":"2023-06-09T04:36:57.501097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:24.458188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500688+0000","last_change":"2023-06-09T04:36:53.090432+0000","last_active":"2023-06-09T04:36:57.500688+0000","last_peered":"2023-06-09T04:36:57.500688+0000","last_clean":"2023-06-09T04:36:57.500688+0000","last_became_active":"2023-06-09T04:36:53.090048+0000","last_became_peered":"2023-06-09T04:36:53.090048+0000","last_unstale":"2023-06-09T04:36:57.500688+0000","last_undegraded":"2023-06-09T04:36:57.500688+0000","last_fullsized":"2023-06-09T04:36:57.500688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516962+0000","last_change":"2023-06-09T04:36:57.119128+0000","last_active":"2023-06-09T04:36:57.516962+0000","last_peered":"2023-06-09T04:36:57.516962+0000","last_clean":"2023-06-09T04:36:57.516962+0000","last_became_active":"2023-06-09T04:36:57.118804+0000","last_became_peered":"2023-06-09T04:36:57.118804+0000","last_unstale":"2023-06-09T04:36:57.516962+0000","last_undegraded":"2023-06-09T04:36:57.516962+0000","last_fullsized":"2023-06-09T04:36:57.516962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:45:01.621362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517322+0000","last_change":"2023-06-09T04:36:52.687200+0000","last_active":"2023-06-09T04:36:57.517322+0000","last_peered":"2023-06-09T04:36:57.517322+0000","last_clean":"2023-06-09T04:36:57.517322+0000","last_became_active":"2023-06-09T04:36:52.686926+0000","last_became_peered":"2023-06-09T04:36:52.686926+0000","last_unstale":"2023-06-09T04:36:57.517322+0000","last_undegraded":"2023-06-09T04:36:57.517322+0000","last_fullsized":"2023-06-09T04:36:57.517322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:55.176458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501823+0000","last_change":"2023-06-09T04:36:53.087793+0000","last_active":"2023-06-09T04:36:57.501823+0000","last_peered":"2023-06-09T04:36:57.501823+0000","last_clean":"2023-06-09T04:36:57.501823+0000","last_became_active":"2023-06-09T04:36:53.087526+0000","last_became_peered":"2023-06-09T04:36:53.087526+0000","last_unstale":"2023-06-09T04:36:57.501823+0000","last_undegraded":"2023-06-09T04:36:57.501823+0000","last_fullsized":"2023-06-09T04:36:57.501823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:08:25.419479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516970+0000","last_change":"2023-06-09T04:36:57.109316+0000","last_active":"2023-06-09T04:36:57.516970+0000","last_peered":"2023-06-09T04:36:57.516970+0000","last_clean":"2023-06-09T04:36:57.516970+0000","last_became_active":"2023-06-09T04:36:57.108933+0000","last_became_peered":"2023-06-09T04:36:57.108933+0000","last_unstale":"2023-06-09T04:36:57.516970+0000","last_undegraded":"2023-06-09T04:36:57.516970+0000","last_fullsized":"2023-06-09T04:36:57.516970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:37:23.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516752+0000","last_change":"2023-06-09T04:36:52.693014+0000","last_active":"2023-06-09T04:36:57.516752+0000","last_peered":"2023-06-09T04:36:57.516752+0000","last_clean":"2023-06-09T04:36:57.516752+0000","last_became_active":"2023-06-09T04:36:52.692786+0000","last_became_peered":"2023-06-09T04:36:52.692786+0000","last_unstale":"2023-06-09T04:36:57.516752+0000","last_undegraded":"2023-06-09T04:36:57.516752+0000","last_fullsized":"2023-06-09T04:36:57.516752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:37.205136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502190+0000","last_change":"2023-06-09T04:36:53.087658+0000","last_active":"2023-06-09T04:36:57.502190+0000","last_peered":"2023-06-09T04:36:57.502190+0000","last_clean":"2023-06-09T04:36:57.502190+0000","last_became_active":"2023-06-09T04:36:53.087414+0000","last_became_peered":"2023-06-09T04:36:53.087414+0000","last_unstale":"2023-06-09T04:36:57.502190+0000","last_undegraded":"2023-06-09T04:36:57.502190+0000","last_fullsized":"2023-06-09T04:36:57.502190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:43.763282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501165+0000","last_change":"2023-06-09T04:36:57.118582+0000","last_active":"2023-06-09T04:36:57.501165+0000","last_peered":"2023-06-09T04:36:57.501165+0000","last_clean":"2023-06-09T04:36:57.501165+0000","last_became_active":"2023-06-09T04:36:57.118128+0000","last_became_peered":"2023-06-09T04:36:57.118128+0000","last_unstale":"2023-06-09T04:36:57.501165+0000","last_undegraded":"2023-06-09T04:36:57.501165+0000","last_fullsized":"2023-06-09T04:36:57.501165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:35.040521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501455+0000","last_change":"2023-06-09T04:36:52.695510+0000","last_active":"2023-06-09T04:36:57.501455+0000","last_peered":"2023-06-09T04:36:57.501455+0000","last_clean":"2023-06-09T04:36:57.501455+0000","last_became_active":"2023-06-09T04:36:52.695256+0000","last_became_peered":"2023-06-09T04:36:52.695256+0000","last_unstale":"2023-06-09T04:36:57.501455+0000","last_undegraded":"2023-06-09T04:36:57.501455+0000","last_fullsized":"2023-06-09T04:36:57.501455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:35.772477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502738+0000","last_change":"2023-06-09T04:36:53.094151+0000","last_active":"2023-06-09T04:36:57.502738+0000","last_peered":"2023-06-09T04:36:57.502738+0000","last_clean":"2023-06-09T04:36:57.502738+0000","last_became_active":"2023-06-09T04:36:53.093875+0000","last_became_peered":"2023-06-09T04:36:53.093875+0000","last_unstale":"2023-06-09T04:36:57.502738+0000","last_undegraded":"2023-06-09T04:36:57.502738+0000","last_fullsized":"2023-06-09T04:36:57.502738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:31.886725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502450+0000","last_change":"2023-06-09T04:36:57.115949+0000","last_active":"2023-06-09T04:36:57.502450+0000","last_peered":"2023-06-09T04:36:57.502450+0000","last_clean":"2023-06-09T04:36:57.502450+0000","last_became_active":"2023-06-09T04:36:57.115534+0000","last_became_peered":"2023-06-09T04:36:57.115534+0000","last_unstale":"2023-06-09T04:36:57.502450+0000","last_undegraded":"2023-06-09T04:36:57.502450+0000","last_fullsized":"2023-06-09T04:36:57.502450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:19:23.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516691+0000","last_change":"2023-06-09T04:36:52.690632+0000","last_active":"2023-06-09T04:36:57.516691+0000","last_peered":"2023-06-09T04:36:57.516691+0000","last_clean":"2023-06-09T04:36:57.516691+0000","last_became_active":"2023-06-09T04:36:52.690338+0000","last_became_peered":"2023-06-09T04:36:52.690338+0000","last_unstale":"2023-06-09T04:36:57.516691+0000","last_undegraded":"2023-06-09T04:36:57.516691+0000","last_fullsized":"2023-06-09T04:36:57.516691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:15:03.415789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517712+0000","last_change":"2023-06-09T04:36:53.095130+0000","last_active":"2023-06-09T04:36:57.517712+0000","last_peered":"2023-06-09T04:36:57.517712+0000","last_clean":"2023-06-09T04:36:57.517712+0000","last_became_active":"2023-06-09T04:36:53.094805+0000","last_became_peered":"2023-06-09T04:36:53.094805+0000","last_unstale":"2023-06-09T04:36:57.517712+0000","last_undegraded":"2023-06-09T04:36:57.517712+0000","last_fullsized":"2023-06-09T04:36:57.517712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:22.682476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501842+0000","last_change":"2023-06-09T04:36:57.115754+0000","last_active":"2023-06-09T04:36:57.501842+0000","last_peered":"2023-06-09T04:36:57.501842+0000","last_clean":"2023-06-09T04:36:57.501842+0000","last_became_active":"2023-06-09T04:36:57.115330+0000","last_became_peered":"2023-06-09T04:36:57.115330+0000","last_unstale":"2023-06-09T04:36:57.501842+0000","last_undegraded":"2023-06-09T04:36:57.501842+0000","last_fullsized":"2023-06-09T04:36:57.501842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:29.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517666+0000","last_change":"2023-06-09T04:36:52.693950+0000","last_active":"2023-06-09T04:36:57.517666+0000","last_peered":"2023-06-09T04:36:57.517666+0000","last_clean":"2023-06-09T04:36:57.517666+0000","last_became_active":"2023-06-09T04:36:52.691659+0000","last_became_peered":"2023-06-09T04:36:52.691659+0000","last_unstale":"2023-06-09T04:36:57.517666+0000","last_undegraded":"2023-06-09T04:36:57.517666+0000","last_fullsized":"2023-06-09T04:36:57.517666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:44.676469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502189+0000","last_change":"2023-06-09T04:36:47.621971+0000","last_active":"2023-06-09T04:36:57.502189+0000","last_peered":"2023-06-09T04:36:57.502189+0000","last_clean":"2023-06-09T04:36:57.502189+0000","last_became_active":"2023-06-09T04:36:47.621651+0000","last_became_peered":"2023-06-09T04:36:47.621651+0000","last_unstale":"2023-06-09T04:36:57.502189+0000","last_undegraded":"2023-06-09T04:36:57.502189+0000","last_fullsized":"2023-06-09T04:36:57.502189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:37:38.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516574+0000","last_change":"2023-06-09T04:36:53.087151+0000","last_active":"2023-06-09T04:36:57.516574+0000","last_peered":"2023-06-09T04:36:57.516574+0000","last_clean":"2023-06-09T04:36:57.516574+0000","last_became_active":"2023-06-09T04:36:53.086901+0000","last_became_peered":"2023-06-09T04:36:53.086901+0000","last_unstale":"2023-06-09T04:36:57.516574+0000","last_undegraded":"2023-06-09T04:36:57.516574+0000","last_fullsized":"2023-06-09T04:36:57.516574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:45.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516429+0000","last_change":"2023-06-09T04:36:57.124627+0000","last_active":"2023-06-09T04:36:57.516429+0000","last_peered":"2023-06-09T04:36:57.516429+0000","last_clean":"2023-06-09T04:36:57.516429+0000","last_became_active":"2023-06-09T04:36:57.124220+0000","last_became_peered":"2023-06-09T04:36:57.124220+0000","last_unstale":"2023-06-09T04:36:57.516429+0000","last_undegraded":"2023-06-09T04:36:57.516429+0000","last_fullsized":"2023-06-09T04:36:57.516429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:22:55.831089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517546+0000","last_change":"2023-06-09T04:36:47.613976+0000","last_active":"2023-06-09T04:36:57.517546+0000","last_peered":"2023-06-09T04:36:57.517546+0000","last_clean":"2023-06-09T04:36:57.517546+0000","last_became_active":"2023-06-09T04:36:47.613691+0000","last_became_peered":"2023-06-09T04:36:47.613691+0000","last_unstale":"2023-06-09T04:36:57.517546+0000","last_undegraded":"2023-06-09T04:36:57.517546+0000","last_fullsized":"2023-06-09T04:36:57.517546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:59.301853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500484+0000","last_change":"2023-06-09T04:36:52.686932+0000","last_active":"2023-06-09T04:36:57.500484+0000","last_peered":"2023-06-09T04:36:57.500484+0000","last_clean":"2023-06-09T04:36:57.500484+0000","last_became_active":"2023-06-09T04:36:52.686353+0000","last_became_peered":"2023-06-09T04:36:52.686353+0000","last_unstale":"2023-06-09T04:36:57.500484+0000","last_undegraded":"2023-06-09T04:36:57.500484+0000","last_fullsized":"2023-06-09T04:36:57.500484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:24.229634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501505+0000","last_change":"2023-06-09T04:36:53.086408+0000","last_active":"2023-06-09T04:36:57.501505+0000","last_peered":"2023-06-09T04:36:57.501505+0000","last_clean":"2023-06-09T04:36:57.501505+0000","last_became_active":"2023-06-09T04:36:53.086039+0000","last_became_peered":"2023-06-09T04:36:53.086039+0000","last_unstale":"2023-06-09T04:36:57.501505+0000","last_undegraded":"2023-06-09T04:36:57.501505+0000","last_fullsized":"2023-06-09T04:36:57.501505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:20:52.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500834+0000","last_change":"2023-06-09T04:36:57.119321+0000","last_active":"2023-06-09T04:36:57.500834+0000","last_peered":"2023-06-09T04:36:57.500834+0000","last_clean":"2023-06-09T04:36:57.500834+0000","last_became_active":"2023-06-09T04:36:57.118916+0000","last_became_peered":"2023-06-09T04:36:57.118916+0000","last_unstale":"2023-06-09T04:36:57.500834+0000","last_undegraded":"2023-06-09T04:36:57.500834+0000","last_fullsized":"2023-06-09T04:36:57.500834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:50.167224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516431+0000","last_change":"2023-06-09T04:36:47.626414+0000","last_active":"2023-06-09T04:36:57.516431+0000","last_peered":"2023-06-09T04:36:57.516431+0000","last_clean":"2023-06-09T04:36:57.516431+0000","last_became_active":"2023-06-09T04:36:47.626166+0000","last_became_peered":"2023-06-09T04:36:47.626166+0000","last_unstale":"2023-06-09T04:36:57.516431+0000","last_undegraded":"2023-06-09T04:36:57.516431+0000","last_fullsized":"2023-06-09T04:36:57.516431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:57.290510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516988+0000","last_change":"2023-06-09T04:36:47.627673+0000","last_active":"2023-06-09T04:36:57.516988+0000","last_peered":"2023-06-09T04:36:57.516988+0000","last_clean":"2023-06-09T04:36:57.516988+0000","last_became_active":"2023-06-09T04:36:47.626658+0000","last_became_peered":"2023-06-09T04:36:47.626658+0000","last_unstale":"2023-06-09T04:36:57.516988+0000","last_undegraded":"2023-06-09T04:36:57.516988+0000","last_fullsized":"2023-06-09T04:36:57.516988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:59.243942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500010+0000","last_change":"2023-06-09T04:36:52.690886+0000","last_active":"2023-06-09T04:36:57.500010+0000","last_peered":"2023-06-09T04:36:57.500010+0000","last_clean":"2023-06-09T04:36:57.500010+0000","last_became_active":"2023-06-09T04:36:52.690597+0000","last_became_peered":"2023-06-09T04:36:52.690597+0000","last_unstale":"2023-06-09T04:36:57.500010+0000","last_undegraded":"2023-06-09T04:36:57.500010+0000","last_fullsized":"2023-06-09T04:36:57.500010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500874+0000","last_change":"2023-06-09T04:36:53.090386+0000","last_active":"2023-06-09T04:36:57.500874+0000","last_peered":"2023-06-09T04:36:57.500874+0000","last_clean":"2023-06-09T04:36:57.500874+0000","last_became_active":"2023-06-09T04:36:53.081404+0000","last_became_peered":"2023-06-09T04:36:53.081404+0000","last_unstale":"2023-06-09T04:36:57.500874+0000","last_undegraded":"2023-06-09T04:36:57.500874+0000","last_fullsized":"2023-06-09T04:36:57.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:16.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518008+0000","last_change":"2023-06-09T04:36:57.120772+0000","last_active":"2023-06-09T04:36:57.518008+0000","last_peered":"2023-06-09T04:36:57.518008+0000","last_clean":"2023-06-09T04:36:57.518008+0000","last_became_active":"2023-06-09T04:36:57.120404+0000","last_became_peered":"2023-06-09T04:36:57.120404+0000","last_unstale":"2023-06-09T04:36:57.518008+0000","last_undegraded":"2023-06-09T04:36:57.518008+0000","last_fullsized":"2023-06-09T04:36:57.518008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:11.255903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516279+0000","last_change":"2023-06-09T04:36:47.618577+0000","last_active":"2023-06-09T04:36:57.516279+0000","last_peered":"2023-06-09T04:36:57.516279+0000","last_clean":"2023-06-09T04:36:57.516279+0000","last_became_active":"2023-06-09T04:36:47.618339+0000","last_became_peered":"2023-06-09T04:36:47.618339+0000","last_unstale":"2023-06-09T04:36:57.516279+0000","last_undegraded":"2023-06-09T04:36:57.516279+0000","last_fullsized":"2023-06-09T04:36:57.516279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:36.907071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515932+0000","last_change":"2023-06-09T04:36:52.696188+0000","last_active":"2023-06-09T04:36:57.515932+0000","last_peered":"2023-06-09T04:36:57.515932+0000","last_clean":"2023-06-09T04:36:57.515932+0000","last_became_active":"2023-06-09T04:36:52.695918+0000","last_became_peered":"2023-06-09T04:36:52.695918+0000","last_unstale":"2023-06-09T04:36:57.515932+0000","last_undegraded":"2023-06-09T04:36:57.515932+0000","last_fullsized":"2023-06-09T04:36:57.515932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:17:09.723017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517602+0000","last_change":"2023-06-09T04:36:53.096297+0000","last_active":"2023-06-09T04:36:57.517602+0000","last_peered":"2023-06-09T04:36:57.517602+0000","last_clean":"2023-06-09T04:36:57.517602+0000","last_became_active":"2023-06-09T04:36:53.096047+0000","last_became_peered":"2023-06-09T04:36:53.096047+0000","last_unstale":"2023-06-09T04:36:57.517602+0000","last_undegraded":"2023-06-09T04:36:57.517602+0000","last_fullsized":"2023-06-09T04:36:57.517602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:58.427626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516635+0000","last_change":"2023-06-09T04:36:57.120908+0000","last_active":"2023-06-09T04:36:57.516635+0000","last_peered":"2023-06-09T04:36:57.516635+0000","last_clean":"2023-06-09T04:36:57.516635+0000","last_became_active":"2023-06-09T04:36:57.120245+0000","last_became_peered":"2023-06-09T04:36:57.120245+0000","last_unstale":"2023-06-09T04:36:57.516635+0000","last_undegraded":"2023-06-09T04:36:57.516635+0000","last_fullsized":"2023-06-09T04:36:57.516635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:45.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516785+0000","last_change":"2023-06-09T04:36:47.618679+0000","last_active":"2023-06-09T04:36:57.516785+0000","last_peered":"2023-06-09T04:36:57.516785+0000","last_clean":"2023-06-09T04:36:57.516785+0000","last_became_active":"2023-06-09T04:36:47.618391+0000","last_became_peered":"2023-06-09T04:36:47.618391+0000","last_unstale":"2023-06-09T04:36:57.516785+0000","last_undegraded":"2023-06-09T04:36:57.516785+0000","last_fullsized":"2023-06-09T04:36:57.516785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:10.798839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517186+0000","last_change":"2023-06-09T04:36:52.687289+0000","last_active":"2023-06-09T04:36:57.517186+0000","last_peered":"2023-06-09T04:36:57.517186+0000","last_clean":"2023-06-09T04:36:57.517186+0000","last_became_active":"2023-06-09T04:36:52.686981+0000","last_became_peered":"2023-06-09T04:36:52.686981+0000","last_unstale":"2023-06-09T04:36:57.517186+0000","last_undegraded":"2023-06-09T04:36:57.517186+0000","last_fullsized":"2023-06-09T04:36:57.517186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:34.246906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516182+0000","last_change":"2023-06-09T04:36:53.090839+0000","last_active":"2023-06-09T04:36:57.516182+0000","last_peered":"2023-06-09T04:36:57.516182+0000","last_clean":"2023-06-09T04:36:57.516182+0000","last_became_active":"2023-06-09T04:36:53.090549+0000","last_became_peered":"2023-06-09T04:36:53.090549+0000","last_unstale":"2023-06-09T04:36:57.516182+0000","last_undegraded":"2023-06-09T04:36:57.516182+0000","last_fullsized":"2023-06-09T04:36:57.516182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:34.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500518+0000","last_change":"2023-06-09T04:36:57.115365+0000","last_active":"2023-06-09T04:36:57.500518+0000","last_peered":"2023-06-09T04:36:57.500518+0000","last_clean":"2023-06-09T04:36:57.500518+0000","last_became_active":"2023-06-09T04:36:57.114167+0000","last_became_peered":"2023-06-09T04:36:57.114167+0000","last_unstale":"2023-06-09T04:36:57.500518+0000","last_undegraded":"2023-06-09T04:36:57.500518+0000","last_fullsized":"2023-06-09T04:36:57.500518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:52.854459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500766+0000","last_change":"2023-06-09T04:36:47.616483+0000","last_active":"2023-06-09T04:36:57.500766+0000","last_peered":"2023-06-09T04:36:57.500766+0000","last_clean":"2023-06-09T04:36:57.500766+0000","last_became_active":"2023-06-09T04:36:47.616149+0000","last_became_peered":"2023-06-09T04:36:47.616149+0000","last_unstale":"2023-06-09T04:36:57.500766+0000","last_undegraded":"2023-06-09T04:36:57.500766+0000","last_fullsized":"2023-06-09T04:36:57.500766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:05.520144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502042+0000","last_change":"2023-06-09T04:36:52.692599+0000","last_active":"2023-06-09T04:36:57.502042+0000","last_peered":"2023-06-09T04:36:57.502042+0000","last_clean":"2023-06-09T04:36:57.502042+0000","last_became_active":"2023-06-09T04:36:52.692296+0000","last_became_peered":"2023-06-09T04:36:52.692296+0000","last_unstale":"2023-06-09T04:36:57.502042+0000","last_undegraded":"2023-06-09T04:36:57.502042+0000","last_fullsized":"2023-06-09T04:36:57.502042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:21:23.110649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516068+0000","last_change":"2023-06-09T04:36:53.086306+0000","last_active":"2023-06-09T04:36:57.516068+0000","last_peered":"2023-06-09T04:36:57.516068+0000","last_clean":"2023-06-09T04:36:57.516068+0000","last_became_active":"2023-06-09T04:36:53.081070+0000","last_became_peered":"2023-06-09T04:36:53.081070+0000","last_unstale":"2023-06-09T04:36:57.516068+0000","last_undegraded":"2023-06-09T04:36:57.516068+0000","last_fullsized":"2023-06-09T04:36:57.516068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:34.737443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516958+0000","last_change":"2023-06-09T04:36:57.116547+0000","last_active":"2023-06-09T04:36:57.516958+0000","last_peered":"2023-06-09T04:36:57.516958+0000","last_clean":"2023-06-09T04:36:57.516958+0000","last_became_active":"2023-06-09T04:36:57.116187+0000","last_became_peered":"2023-06-09T04:36:57.116187+0000","last_unstale":"2023-06-09T04:36:57.516958+0000","last_undegraded":"2023-06-09T04:36:57.516958+0000","last_fullsized":"2023-06-09T04:36:57.516958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:45:19.560682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517169+0000","last_change":"2023-06-09T04:36:47.616467+0000","last_active":"2023-06-09T04:36:57.517169+0000","last_peered":"2023-06-09T04:36:57.517169+0000","last_clean":"2023-06-09T04:36:57.517169+0000","last_became_active":"2023-06-09T04:36:47.616166+0000","last_became_peered":"2023-06-09T04:36:47.616166+0000","last_unstale":"2023-06-09T04:36:57.517169+0000","last_undegraded":"2023-06-09T04:36:57.517169+0000","last_fullsized":"2023-06-09T04:36:57.517169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:07:04.193240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516221+0000","last_change":"2023-06-09T04:36:52.695847+0000","last_active":"2023-06-09T04:36:57.516221+0000","last_peered":"2023-06-09T04:36:57.516221+0000","last_clean":"2023-06-09T04:36:57.516221+0000","last_became_active":"2023-06-09T04:36:52.695537+0000","last_became_peered":"2023-06-09T04:36:52.695537+0000","last_unstale":"2023-06-09T04:36:57.516221+0000","last_undegraded":"2023-06-09T04:36:57.516221+0000","last_fullsized":"2023-06-09T04:36:57.516221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:29:03.665158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500418+0000","last_change":"2023-06-09T04:36:53.092478+0000","last_active":"2023-06-09T04:36:57.500418+0000","last_peered":"2023-06-09T04:36:57.500418+0000","last_clean":"2023-06-09T04:36:57.500418+0000","last_became_active":"2023-06-09T04:36:53.092205+0000","last_became_peered":"2023-06-09T04:36:53.092205+0000","last_unstale":"2023-06-09T04:36:57.500418+0000","last_undegraded":"2023-06-09T04:36:57.500418+0000","last_fullsized":"2023-06-09T04:36:57.500418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:41.939536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500219+0000","last_change":"2023-06-09T04:36:57.117220+0000","last_active":"2023-06-09T04:36:57.500219+0000","last_peered":"2023-06-09T04:36:57.500219+0000","last_clean":"2023-06-09T04:36:57.500219+0000","last_became_active":"2023-06-09T04:36:57.116782+0000","last_became_peered":"2023-06-09T04:36:57.116782+0000","last_unstale":"2023-06-09T04:36:57.500219+0000","last_undegraded":"2023-06-09T04:36:57.500219+0000","last_fullsized":"2023-06-09T04:36:57.500219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:28.882830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517307+0000","last_change":"2023-06-09T04:36:47.613658+0000","last_active":"2023-06-09T04:36:57.517307+0000","last_peered":"2023-06-09T04:36:57.517307+0000","last_clean":"2023-06-09T04:36:57.517307+0000","last_became_active":"2023-06-09T04:36:47.613327+0000","last_became_peered":"2023-06-09T04:36:47.613327+0000","last_unstale":"2023-06-09T04:36:57.517307+0000","last_undegraded":"2023-06-09T04:36:57.517307+0000","last_fullsized":"2023-06-09T04:36:57.517307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:03.397674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500912+0000","last_change":"2023-06-09T04:36:52.688906+0000","last_active":"2023-06-09T04:36:57.500912+0000","last_peered":"2023-06-09T04:36:57.500912+0000","last_clean":"2023-06-09T04:36:57.500912+0000","last_became_active":"2023-06-09T04:36:52.688407+0000","last_became_peered":"2023-06-09T04:36:52.688407+0000","last_unstale":"2023-06-09T04:36:57.500912+0000","last_undegraded":"2023-06-09T04:36:57.500912+0000","last_fullsized":"2023-06-09T04:36:57.500912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515917+0000","last_change":"2023-06-09T04:36:53.088941+0000","last_active":"2023-06-09T04:36:57.515917+0000","last_peered":"2023-06-09T04:36:57.515917+0000","last_clean":"2023-06-09T04:36:57.515917+0000","last_became_active":"2023-06-09T04:36:53.088714+0000","last_became_peered":"2023-06-09T04:36:53.088714+0000","last_unstale":"2023-06-09T04:36:57.515917+0000","last_undegraded":"2023-06-09T04:36:57.515917+0000","last_fullsized":"2023-06-09T04:36:57.515917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:45:51.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517126+0000","last_change":"2023-06-09T04:36:57.107346+0000","last_active":"2023-06-09T04:36:57.517126+0000","last_peered":"2023-06-09T04:36:57.517126+0000","last_clean":"2023-06-09T04:36:57.517126+0000","last_became_active":"2023-06-09T04:36:57.106951+0000","last_became_peered":"2023-06-09T04:36:57.106951+0000","last_unstale":"2023-06-09T04:36:57.517126+0000","last_undegraded":"2023-06-09T04:36:57.517126+0000","last_fullsized":"2023-06-09T04:36:57.517126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:19:15.561278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500285+0000","last_change":"2023-06-09T04:36:52.690142+0000","last_active":"2023-06-09T04:36:57.500285+0000","last_peered":"2023-06-09T04:36:57.500285+0000","last_clean":"2023-06-09T04:36:57.500285+0000","last_became_active":"2023-06-09T04:36:52.689899+0000","last_became_peered":"2023-06-09T04:36:52.689899+0000","last_unstale":"2023-06-09T04:36:57.500285+0000","last_undegraded":"2023-06-09T04:36:57.500285+0000","last_fullsized":"2023-06-09T04:36:57.500285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:52.648622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516780+0000","last_change":"2023-06-09T04:36:53.090134+0000","last_active":"2023-06-09T04:36:57.516780+0000","last_peered":"2023-06-09T04:36:57.516780+0000","last_clean":"2023-06-09T04:36:57.516780+0000","last_became_active":"2023-06-09T04:36:53.089876+0000","last_became_peered":"2023-06-09T04:36:53.089876+0000","last_unstale":"2023-06-09T04:36:57.516780+0000","last_undegraded":"2023-06-09T04:36:57.516780+0000","last_fullsized":"2023-06-09T04:36:57.516780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:34.780805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516202+0000","last_change":"2023-06-09T04:36:57.119574+0000","last_active":"2023-06-09T04:36:57.516202+0000","last_peered":"2023-06-09T04:36:57.516202+0000","last_clean":"2023-06-09T04:36:57.516202+0000","last_became_active":"2023-06-09T04:36:57.119150+0000","last_became_peered":"2023-06-09T04:36:57.119150+0000","last_unstale":"2023-06-09T04:36:57.516202+0000","last_undegraded":"2023-06-09T04:36:57.516202+0000","last_fullsized":"2023-06-09T04:36:57.516202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500755+0000","last_change":"2023-06-09T04:36:52.690645+0000","last_active":"2023-06-09T04:36:57.500755+0000","last_peered":"2023-06-09T04:36:57.500755+0000","last_clean":"2023-06-09T04:36:57.500755+0000","last_became_active":"2023-06-09T04:36:52.690308+0000","last_became_peered":"2023-06-09T04:36:52.690308+0000","last_unstale":"2023-06-09T04:36:57.500755+0000","last_undegraded":"2023-06-09T04:36:57.500755+0000","last_fullsized":"2023-06-09T04:36:57.500755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:40.932066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502199+0000","last_change":"2023-06-09T04:36:53.081068+0000","last_active":"2023-06-09T04:36:57.502199+0000","last_peered":"2023-06-09T04:36:57.502199+0000","last_clean":"2023-06-09T04:36:57.502199+0000","last_became_active":"2023-06-09T04:36:53.080667+0000","last_became_peered":"2023-06-09T04:36:53.080667+0000","last_unstale":"2023-06-09T04:36:57.502199+0000","last_undegraded":"2023-06-09T04:36:57.502199+0000","last_fullsized":"2023-06-09T04:36:57.502199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:43.978989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501298+0000","last_change":"2023-06-09T04:36:57.122830+0000","last_active":"2023-06-09T04:36:57.501298+0000","last_peered":"2023-06-09T04:36:57.501298+0000","last_clean":"2023-06-09T04:36:57.501298+0000","last_became_active":"2023-06-09T04:36:57.122375+0000","last_became_peered":"2023-06-09T04:36:57.122375+0000","last_unstale":"2023-06-09T04:36:57.501298+0000","last_undegraded":"2023-06-09T04:36:57.501298+0000","last_fullsized":"2023-06-09T04:36:57.501298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501357+0000","last_change":"2023-06-09T04:36:52.690672+0000","last_active":"2023-06-09T04:36:57.501357+0000","last_peered":"2023-06-09T04:36:57.501357+0000","last_clean":"2023-06-09T04:36:57.501357+0000","last_became_active":"2023-06-09T04:36:52.690387+0000","last_became_peered":"2023-06-09T04:36:52.690387+0000","last_unstale":"2023-06-09T04:36:57.501357+0000","last_undegraded":"2023-06-09T04:36:57.501357+0000","last_fullsized":"2023-06-09T04:36:57.501357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501440+0000","last_change":"2023-06-09T04:36:53.087522+0000","last_active":"2023-06-09T04:36:57.501440+0000","last_peered":"2023-06-09T04:36:57.501440+0000","last_clean":"2023-06-09T04:36:57.501440+0000","last_became_active":"2023-06-09T04:36:53.087137+0000","last_became_peered":"2023-06-09T04:36:53.087137+0000","last_unstale":"2023-06-09T04:36:57.501440+0000","last_undegraded":"2023-06-09T04:36:57.501440+0000","last_fullsized":"2023-06-09T04:36:57.501440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:19:08.704227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501282+0000","last_change":"2023-06-09T04:36:57.122912+0000","last_active":"2023-06-09T04:36:57.501282+0000","last_peered":"2023-06-09T04:36:57.501282+0000","last_clean":"2023-06-09T04:36:57.501282+0000","last_became_active":"2023-06-09T04:36:57.122522+0000","last_became_peered":"2023-06-09T04:36:57.122522+0000","last_unstale":"2023-06-09T04:36:57.501282+0000","last_undegraded":"2023-06-09T04:36:57.501282+0000","last_fullsized":"2023-06-09T04:36:57.501282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:55.270027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517342+0000","last_change":"2023-06-09T04:36:52.692799+0000","last_active":"2023-06-09T04:36:57.517342+0000","last_peered":"2023-06-09T04:36:57.517342+0000","last_clean":"2023-06-09T04:36:57.517342+0000","last_became_active":"2023-06-09T04:36:52.692553+0000","last_became_peered":"2023-06-09T04:36:52.692553+0000","last_unstale":"2023-06-09T04:36:57.517342+0000","last_undegraded":"2023-06-09T04:36:57.517342+0000","last_fullsized":"2023-06-09T04:36:57.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:52.314087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516677+0000","last_change":"2023-06-09T04:36:53.080161+0000","last_active":"2023-06-09T04:36:57.516677+0000","last_peered":"2023-06-09T04:36:57.516677+0000","last_clean":"2023-06-09T04:36:57.516677+0000","last_became_active":"2023-06-09T04:36:53.079901+0000","last_became_peered":"2023-06-09T04:36:53.079901+0000","last_unstale":"2023-06-09T04:36:57.516677+0000","last_undegraded":"2023-06-09T04:36:57.516677+0000","last_fullsized":"2023-06-09T04:36:57.516677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:39:27.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516214+0000","last_change":"2023-06-09T04:36:57.115160+0000","last_active":"2023-06-09T04:36:57.516214+0000","last_peered":"2023-06-09T04:36:57.516214+0000","last_clean":"2023-06-09T04:36:57.516214+0000","last_became_active":"2023-06-09T04:36:57.114742+0000","last_became_peered":"2023-06-09T04:36:57.114742+0000","last_unstale":"2023-06-09T04:36:57.516214+0000","last_undegraded":"2023-06-09T04:36:57.516214+0000","last_fullsized":"2023-06-09T04:36:57.516214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:40:15.379010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500994+0000","last_change":"2023-06-09T04:36:52.680891+0000","last_active":"2023-06-09T04:36:57.500994+0000","last_peered":"2023-06-09T04:36:57.500994+0000","last_clean":"2023-06-09T04:36:57.500994+0000","last_became_active":"2023-06-09T04:36:52.680385+0000","last_became_peered":"2023-06-09T04:36:52.680385+0000","last_unstale":"2023-06-09T04:36:57.500994+0000","last_undegraded":"2023-06-09T04:36:57.500994+0000","last_fullsized":"2023-06-09T04:36:57.500994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502005+0000","last_change":"2023-06-09T04:36:53.096473+0000","last_active":"2023-06-09T04:36:57.502005+0000","last_peered":"2023-06-09T04:36:57.502005+0000","last_clean":"2023-06-09T04:36:57.502005+0000","last_became_active":"2023-06-09T04:36:53.096189+0000","last_became_peered":"2023-06-09T04:36:53.096189+0000","last_unstale":"2023-06-09T04:36:57.502005+0000","last_undegraded":"2023-06-09T04:36:57.502005+0000","last_fullsized":"2023-06-09T04:36:57.502005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:34:20.659382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515964+0000","last_change":"2023-06-09T04:36:53.097902+0000","last_active":"2023-06-09T04:36:57.515964+0000","last_peered":"2023-06-09T04:36:57.515964+0000","last_clean":"2023-06-09T04:36:57.515964+0000","last_became_active":"2023-06-09T04:36:53.097382+0000","last_became_peered":"2023-06-09T04:36:53.097382+0000","last_unstale":"2023-06-09T04:36:57.515964+0000","last_undegraded":"2023-06-09T04:36:57.515964+0000","last_fullsized":"2023-06-09T04:36:57.515964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:43.428603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517665+0000","last_change":"2023-06-09T04:36:53.082845+0000","last_active":"2023-06-09T04:36:57.517665+0000","last_peered":"2023-06-09T04:36:57.517665+0000","last_clean":"2023-06-09T04:36:57.517665+0000","last_became_active":"2023-06-09T04:36:53.082622+0000","last_became_peered":"2023-06-09T04:36:53.082622+0000","last_unstale":"2023-06-09T04:36:57.517665+0000","last_undegraded":"2023-06-09T04:36:57.517665+0000","last_fullsized":"2023-06-09T04:36:57.517665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:11:34.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502339+0000","last_change":"2023-06-09T04:36:53.094170+0000","last_active":"2023-06-09T04:36:57.502339+0000","last_peered":"2023-06-09T04:36:57.502339+0000","last_clean":"2023-06-09T04:36:57.502339+0000","last_became_active":"2023-06-09T04:36:53.093889+0000","last_became_peered":"2023-06-09T04:36:53.093889+0000","last_unstale":"2023-06-09T04:36:57.502339+0000","last_undegraded":"2023-06-09T04:36:57.502339+0000","last_fullsized":"2023-06-09T04:36:57.502339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:24.623854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517280+0000","last_change":"2023-06-09T04:36:53.090661+0000","last_active":"2023-06-09T04:36:57.517280+0000","last_peered":"2023-06-09T04:36:57.517280+0000","last_clean":"2023-06-09T04:36:57.517280+0000","last_became_active":"2023-06-09T04:36:53.090014+0000","last_became_peered":"2023-06-09T04:36:53.090014+0000","last_unstale":"2023-06-09T04:36:57.517280+0000","last_undegraded":"2023-06-09T04:36:57.517280+0000","last_fullsized":"2023-06-09T04:36:57.517280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:08.675015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516377+0000","last_change":"2023-06-09T04:36:53.087442+0000","last_active":"2023-06-09T04:36:57.516377+0000","last_peered":"2023-06-09T04:36:57.516377+0000","last_clean":"2023-06-09T04:36:57.516377+0000","last_became_active":"2023-06-09T04:36:53.086525+0000","last_became_peered":"2023-06-09T04:36:53.086525+0000","last_unstale":"2023-06-09T04:36:57.516377+0000","last_undegraded":"2023-06-09T04:36:57.516377+0000","last_fullsized":"2023-06-09T04:36:57.516377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:30:03.858670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":110193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":115204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.133}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2960000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":705732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":112006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":701722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":111354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:37:22.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:37:22.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.377+0000 7f544a52e700 1 Processor -- start 2023-06-09T04:37:22.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.377+0000 7f544a52e700 1 -- start start 2023-06-09T04:37:22.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f544a52e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 0x7f54440ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f544a52e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54440af050 con 0x7f544415c590 2023-06-09T04:37:22.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f544a52e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54440af800 con 0x7f544406a4c0 2023-06-09T04:37:22.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f544a52e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54440afae0 con 0x7f54440af220 2023-06-09T04:37:22.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f5443fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f544415c590 0x7f5444069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60618/0 (socket says 172.21.15.149:60618) 2023-06-09T04:37:22.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f5443fff700 1 -- 172.21.15.149:0/2558018160 learned_addr learned my addr 172.21.15.149:0/2558018160 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:22.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f5448acb700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 0x7f54440ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850631441 0 0) 0x7f54440af050 con 0x7f544415c590 2023-06-09T04:37:22.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.378+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f542c0035b0 con 0x7f544415c590 2023-06-09T04:37:22.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1530096769 0 0) 0x7f542c0035b0 con 0x7f544415c590 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 msgr2=0x7f54440ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 0x7f54440ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 >> v1:172.21.15.184:6789/0 conn(0x7f544406a4c0 legacy=0x7f54440ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54440cc0c0 con 0x7f544415c590 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f54380017f0 con 0x7f544415c590 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 >> v1:172.21.15.149:6789/0 conn(0x7f544415c590 legacy=0x7f5444069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 0x7f542c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f542c003fb0 0x7f542c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f542c004d90 0x7f542c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54440afae0 con 0x7f542c004d90 2023-06-09T04:37:22.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c00baf0 con 0x7f542c003fb0 2023-06-09T04:37:22.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c00bcb0 con 0x7f54440af220 2023-06-09T04:37:22.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5448acb700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f542c004d90 0x7f542c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5443fff700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 0x7f542c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f54437fe700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f542c003fb0 0x7f542c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5448acb700 1 -- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 msgr2=0x7f542c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5448acb700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 0x7f542c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5448acb700 1 -- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f542c003fb0 msgr2=0x7f542c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5448acb700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f542c003fb0 0x7f542c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5448acb700 1 -- 172.21.15.149:0/2558018160 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0035b0 con 0x7f542c004d90 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5443fff700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440af220 0x7f542c003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5448acb700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f542c004d90 0x7f542c005200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f543c009f90 tx=0x7f542c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfccbb9f357074 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c00ec30 con 0x7f542c004d90 2023-06-09T04:37:22.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c00f040 con 0x7f542c004d90 2023-06-09T04:37:22.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.379+0000 7f5442ffd700 1 -- 172.21.15.149:0/2558018160 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c014480 con 0x7f542c004d90 2023-06-09T04:37:22.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.380+0000 7f544a52e700 1 -- 172.21.15.149:0/2558018160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f542c004d90 msgr2=0x7f542c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.380+0000 7f544a52e700 1 --2- 172.21.15.149:0/2558018160 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f542c004d90 0x7f542c005200 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f543c009f90 tx=0x7f542c005880 comp rx=0 tx=0).stop 2023-06-09T04:37:22.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.380+0000 7f5448acb700 1 -- 172.21.15.149:0/2558018160 reap_dead start 2023-06-09T04:37:22.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.380+0000 7f544a52e700 1 -- 172.21.15.149:0/2558018160 shutdown_connections 2023-06-09T04:37:22.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.380+0000 7f544a52e700 1 -- 172.21.15.149:0/2558018160 >> 172.21.15.149:0/2558018160 conn(0x7f544406b7e0 msgr2=0x7f54440cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:22.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.380+0000 7f544a52e700 1 -- 172.21.15.149:0/2558018160 shutdown_connections 2023-06-09T04:37:22.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.380+0000 7f544a52e700 1 -- 172.21.15.149:0/2558018160 wait complete. 2023-06-09T04:37:22.388 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.381+0000 7f544a52e700 1 Processor -- start 2023-06-09T04:37:22.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.381+0000 7f544a52e700 1 -- start start 2023-06-09T04:37:22.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f544a52e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54440b44b0 0x7f54440c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f544a52e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440c5fa0 0x7f544414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f544a52e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54440b4880 0x7f544414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f544a52e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54440c4920 con 0x7f54440b44b0 2023-06-09T04:37:22.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f544a52e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54440c3d10 con 0x7f54440b4880 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f544a52e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54440c3ff0 con 0x7f54440c5fa0 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f5443fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54440b44b0 0x7f54440c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f5443fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54440b44b0 0x7f54440c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36764/0 (socket says 172.21.15.149:36764) 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f5443fff700 1 -- 172.21.15.149:0/777070633 learned_addr learned my addr 172.21.15.149:0/777070633 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f54437fe700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440c5fa0 0x7f544414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f5448acb700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54440b4880 0x7f544414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.382+0000 7f5443fff700 1 -- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440c5fa0 msgr2=0x7f544414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5443fff700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440c5fa0 0x7f544414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5443fff700 1 -- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54440b4880 msgr2=0x7f544414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5443fff700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54440b4880 0x7f544414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5443fff700 1 -- 172.21.15.149:0/777070633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54440c42d0 con 0x7f54440b44b0 2023-06-09T04:37:22.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5443fff700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54440b44b0 0x7f54440c5a60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f543800eb20 tx=0x7f543800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5440ff9700 1 -- 172.21.15.149:0/777070633 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800eea0 con 0x7f54440b44b0 2023-06-09T04:37:22.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5440ff9700 1 -- 172.21.15.149:0/777070633 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438007e30 con 0x7f54440b44b0 2023-06-09T04:37:22.391 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54440c45b0 con 0x7f54440b44b0 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f5440ff9700 1 -- 172.21.15.149:0/777070633 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438007500 con 0x7f54440b44b0 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.383+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54440b24d0 con 0x7f54440b44b0 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.384+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5444073fa0 con 0x7f54440b44b0 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.384+0000 7f5440ff9700 1 -- 172.21.15.149:0/777070633 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5438005830 con 0x7f54440b44b0 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.385+0000 7f5440ff9700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f543006ace0 0x7f543006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.385+0000 7f5440ff9700 1 -- 172.21.15.149:0/777070633 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5438089620 con 0x7f54440b44b0 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.385+0000 7f54437fe700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f543006ace0 0x7f543006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.385+0000 7f54437fe700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f543006ace0 0x7f543006d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f544409d5f0 tx=0x7f5434009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.389+0000 7f5440ff9700 1 -- 172.21.15.149:0/777070633 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54380543e0 con 0x7f54440b44b0 2023-06-09T04:37:22.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.573+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 --> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54440cc680 con 0x7f543006ace0 2023-06-09T04:37:22.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.583+0000 7f5440ff9700 1 -- 172.21.15.149:0/777070633 <== mgr.4101 v2:172.21.15.149:6832/2920572545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367478 (secure 0 0 0) 0x7f5434001660 con 0x7f543006ace0 2023-06-09T04:37:22.587 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:22.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f543006ace0 msgr2=0x7f543006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f543006ace0 0x7f543006d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f544409d5f0 tx=0x7f5434009040 comp rx=0 tx=0).stop 2023-06-09T04:37:22.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54440b44b0 msgr2=0x7f54440c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54440b44b0 0x7f54440c5a60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f543800eb20 tx=0x7f543800ee30 comp rx=0 tx=0).stop 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 shutdown_connections 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f543006ace0 0x7f543006d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f54440b4880 0x7f544414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54440b44b0 0x7f54440c5a60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 --2- 172.21.15.149:0/777070633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f54440c5fa0 0x7f544414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 >> 172.21.15.149:0/777070633 conn(0x7f544406b7e0 msgr2=0x7f54440b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 shutdown_connections 2023-06-09T04:37:22.590 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.586+0000 7f544a52e700 1 -- 172.21.15.149:0/777070633 wait complete. 2023-06-09T04:37:22.591 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-06-09T04:37:22.600 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-06-09T04:37:22.398167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218948,"kb_used_data":3332,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":3411968,"data_stored":2079591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003188"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518193+0000","last_change":"2023-06-09T04:36:53.082985+0000","last_active":"2023-06-09T04:36:57.518193+0000","last_peered":"2023-06-09T04:36:57.518193+0000","last_clean":"2023-06-09T04:36:57.518193+0000","last_became_active":"2023-06-09T04:36:53.082762+0000","last_became_peered":"2023-06-09T04:36:53.082762+0000","last_unstale":"2023-06-09T04:36:57.518193+0000","last_undegraded":"2023-06-09T04:36:57.518193+0000","last_fullsized":"2023-06-09T04:36:57.518193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:52.981825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501460+0000","last_change":"2023-06-09T04:36:53.092173+0000","last_active":"2023-06-09T04:36:57.501460+0000","last_peered":"2023-06-09T04:36:57.501460+0000","last_clean":"2023-06-09T04:36:57.501460+0000","last_became_active":"2023-06-09T04:36:53.091883+0000","last_became_peered":"2023-06-09T04:36:53.091883+0000","last_unstale":"2023-06-09T04:36:57.501460+0000","last_undegraded":"2023-06-09T04:36:57.501460+0000","last_fullsized":"2023-06-09T04:36:57.501460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502629+0000","last_change":"2023-06-09T04:36:53.082161+0000","last_active":"2023-06-09T04:36:57.502629+0000","last_peered":"2023-06-09T04:36:57.502629+0000","last_clean":"2023-06-09T04:36:57.502629+0000","last_became_active":"2023-06-09T04:36:53.081730+0000","last_became_peered":"2023-06-09T04:36:53.081730+0000","last_unstale":"2023-06-09T04:36:57.502629+0000","last_undegraded":"2023-06-09T04:36:57.502629+0000","last_fullsized":"2023-06-09T04:36:57.502629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:27:35.361250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516551+0000","last_change":"2023-06-09T04:36:53.091571+0000","last_active":"2023-06-09T04:36:57.516551+0000","last_peered":"2023-06-09T04:36:57.516551+0000","last_clean":"2023-06-09T04:36:57.516551+0000","last_became_active":"2023-06-09T04:36:53.091231+0000","last_became_peered":"2023-06-09T04:36:53.091231+0000","last_unstale":"2023-06-09T04:36:57.516551+0000","last_undegraded":"2023-06-09T04:36:57.516551+0000","last_fullsized":"2023-06-09T04:36:57.516551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:59:04.716639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500415+0000","last_change":"2023-06-09T04:36:53.080466+0000","last_active":"2023-06-09T04:36:57.500415+0000","last_peered":"2023-06-09T04:36:57.500415+0000","last_clean":"2023-06-09T04:36:57.500415+0000","last_became_active":"2023-06-09T04:36:53.080202+0000","last_became_peered":"2023-06-09T04:36:53.080202+0000","last_unstale":"2023-06-09T04:36:57.500415+0000","last_undegraded":"2023-06-09T04:36:57.500415+0000","last_fullsized":"2023-06-09T04:36:57.500415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:46.590852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502000+0000","last_change":"2023-06-09T04:36:53.085316+0000","last_active":"2023-06-09T04:36:57.502000+0000","last_peered":"2023-06-09T04:36:57.502000+0000","last_clean":"2023-06-09T04:36:57.502000+0000","last_became_active":"2023-06-09T04:36:53.085026+0000","last_became_peered":"2023-06-09T04:36:53.085026+0000","last_unstale":"2023-06-09T04:36:57.502000+0000","last_undegraded":"2023-06-09T04:36:57.502000+0000","last_fullsized":"2023-06-09T04:36:57.502000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:31.842402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516514+0000","last_change":"2023-06-09T04:36:53.095876+0000","last_active":"2023-06-09T04:36:57.516514+0000","last_peered":"2023-06-09T04:36:57.516514+0000","last_clean":"2023-06-09T04:36:57.516514+0000","last_became_active":"2023-06-09T04:36:53.095604+0000","last_became_peered":"2023-06-09T04:36:53.095604+0000","last_unstale":"2023-06-09T04:36:57.516514+0000","last_undegraded":"2023-06-09T04:36:57.516514+0000","last_fullsized":"2023-06-09T04:36:57.516514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:00.417139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500546+0000","last_change":"2023-06-09T04:36:53.089342+0000","last_active":"2023-06-09T04:36:57.500546+0000","last_peered":"2023-06-09T04:36:57.500546+0000","last_clean":"2023-06-09T04:36:57.500546+0000","last_became_active":"2023-06-09T04:36:53.089039+0000","last_became_peered":"2023-06-09T04:36:53.089039+0000","last_unstale":"2023-06-09T04:36:57.500546+0000","last_undegraded":"2023-06-09T04:36:57.500546+0000","last_fullsized":"2023-06-09T04:36:57.500546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:19.525415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500861+0000","last_change":"2023-06-09T04:36:53.087617+0000","last_active":"2023-06-09T04:36:57.500861+0000","last_peered":"2023-06-09T04:36:57.500861+0000","last_clean":"2023-06-09T04:36:57.500861+0000","last_became_active":"2023-06-09T04:36:53.086962+0000","last_became_peered":"2023-06-09T04:36:53.086962+0000","last_unstale":"2023-06-09T04:36:57.500861+0000","last_undegraded":"2023-06-09T04:36:57.500861+0000","last_fullsized":"2023-06-09T04:36:57.500861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502145+0000","last_change":"2023-06-09T04:36:53.086101+0000","last_active":"2023-06-09T04:36:57.502145+0000","last_peered":"2023-06-09T04:36:57.502145+0000","last_clean":"2023-06-09T04:36:57.502145+0000","last_became_active":"2023-06-09T04:36:53.085845+0000","last_became_peered":"2023-06-09T04:36:53.085845+0000","last_unstale":"2023-06-09T04:36:57.502145+0000","last_undegraded":"2023-06-09T04:36:57.502145+0000","last_fullsized":"2023-06-09T04:36:57.502145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:54.336337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502428+0000","last_change":"2023-06-09T04:36:53.081983+0000","last_active":"2023-06-09T04:36:57.502428+0000","last_peered":"2023-06-09T04:36:57.502428+0000","last_clean":"2023-06-09T04:36:57.502428+0000","last_became_active":"2023-06-09T04:36:53.081436+0000","last_became_peered":"2023-06-09T04:36:53.081436+0000","last_unstale":"2023-06-09T04:36:57.502428+0000","last_undegraded":"2023-06-09T04:36:57.502428+0000","last_fullsized":"2023-06-09T04:36:57.502428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:21:57.284108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517008+0000","last_change":"2023-06-09T04:36:53.091581+0000","last_active":"2023-06-09T04:36:57.517008+0000","last_peered":"2023-06-09T04:36:57.517008+0000","last_clean":"2023-06-09T04:36:57.517008+0000","last_became_active":"2023-06-09T04:36:53.091344+0000","last_became_peered":"2023-06-09T04:36:53.091344+0000","last_unstale":"2023-06-09T04:36:57.517008+0000","last_undegraded":"2023-06-09T04:36:57.517008+0000","last_fullsized":"2023-06-09T04:36:57.517008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:29:58.932374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516760+0000","last_change":"2023-06-09T04:36:53.079790+0000","last_active":"2023-06-09T04:36:57.516760+0000","last_peered":"2023-06-09T04:36:57.516760+0000","last_clean":"2023-06-09T04:36:57.516760+0000","last_became_active":"2023-06-09T04:36:53.079521+0000","last_became_peered":"2023-06-09T04:36:53.079521+0000","last_unstale":"2023-06-09T04:36:57.516760+0000","last_undegraded":"2023-06-09T04:36:57.516760+0000","last_fullsized":"2023-06-09T04:36:57.516760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:42:47.447288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501345+0000","last_change":"2023-06-09T04:36:53.085801+0000","last_active":"2023-06-09T04:36:57.501345+0000","last_peered":"2023-06-09T04:36:57.501345+0000","last_clean":"2023-06-09T04:36:57.501345+0000","last_became_active":"2023-06-09T04:36:53.085510+0000","last_became_peered":"2023-06-09T04:36:53.085510+0000","last_unstale":"2023-06-09T04:36:57.501345+0000","last_undegraded":"2023-06-09T04:36:57.501345+0000","last_fullsized":"2023-06-09T04:36:57.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516281+0000","last_change":"2023-06-09T04:36:53.095858+0000","last_active":"2023-06-09T04:36:57.516281+0000","last_peered":"2023-06-09T04:36:57.516281+0000","last_clean":"2023-06-09T04:36:57.516281+0000","last_became_active":"2023-06-09T04:36:53.095564+0000","last_became_peered":"2023-06-09T04:36:53.095564+0000","last_unstale":"2023-06-09T04:36:57.516281+0000","last_undegraded":"2023-06-09T04:36:57.516281+0000","last_fullsized":"2023-06-09T04:36:57.516281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:25.237104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502192+0000","last_change":"2023-06-09T04:36:53.087327+0000","last_active":"2023-06-09T04:36:57.502192+0000","last_peered":"2023-06-09T04:36:57.502192+0000","last_clean":"2023-06-09T04:36:57.502192+0000","last_became_active":"2023-06-09T04:36:53.087056+0000","last_became_peered":"2023-06-09T04:36:53.087056+0000","last_unstale":"2023-06-09T04:36:57.502192+0000","last_undegraded":"2023-06-09T04:36:57.502192+0000","last_fullsized":"2023-06-09T04:36:57.502192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:14.334505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500728+0000","last_change":"2023-06-09T04:36:53.087787+0000","last_active":"2023-06-09T04:36:57.500728+0000","last_peered":"2023-06-09T04:36:57.500728+0000","last_clean":"2023-06-09T04:36:57.500728+0000","last_became_active":"2023-06-09T04:36:53.087324+0000","last_became_peered":"2023-06-09T04:36:53.087324+0000","last_unstale":"2023-06-09T04:36:57.500728+0000","last_undegraded":"2023-06-09T04:36:57.500728+0000","last_fullsized":"2023-06-09T04:36:57.500728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502659+0000","last_change":"2023-06-09T04:36:53.087244+0000","last_active":"2023-06-09T04:36:57.502659+0000","last_peered":"2023-06-09T04:36:57.502659+0000","last_clean":"2023-06-09T04:36:57.502659+0000","last_became_active":"2023-06-09T04:36:53.086960+0000","last_became_peered":"2023-06-09T04:36:53.086960+0000","last_unstale":"2023-06-09T04:36:57.502659+0000","last_undegraded":"2023-06-09T04:36:57.502659+0000","last_fullsized":"2023-06-09T04:36:57.502659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:55.924392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517576+0000","last_change":"2023-06-09T04:36:53.093961+0000","last_active":"2023-06-09T04:36:57.517576+0000","last_peered":"2023-06-09T04:36:57.517576+0000","last_clean":"2023-06-09T04:36:57.517576+0000","last_became_active":"2023-06-09T04:36:53.093752+0000","last_became_peered":"2023-06-09T04:36:53.093752+0000","last_unstale":"2023-06-09T04:36:57.517576+0000","last_undegraded":"2023-06-09T04:36:57.517576+0000","last_fullsized":"2023-06-09T04:36:57.517576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:49:45.981753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501974+0000","last_change":"2023-06-09T04:36:53.080631+0000","last_active":"2023-06-09T04:36:57.501974+0000","last_peered":"2023-06-09T04:36:57.501974+0000","last_clean":"2023-06-09T04:36:57.501974+0000","last_became_active":"2023-06-09T04:36:53.080361+0000","last_became_peered":"2023-06-09T04:36:53.080361+0000","last_unstale":"2023-06-09T04:36:57.501974+0000","last_undegraded":"2023-06-09T04:36:57.501974+0000","last_fullsized":"2023-06-09T04:36:57.501974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:18.986311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516459+0000","last_change":"2023-06-09T04:36:53.093919+0000","last_active":"2023-06-09T04:36:57.516459+0000","last_peered":"2023-06-09T04:36:57.516459+0000","last_clean":"2023-06-09T04:36:57.516459+0000","last_became_active":"2023-06-09T04:36:53.093661+0000","last_became_peered":"2023-06-09T04:36:53.093661+0000","last_unstale":"2023-06-09T04:36:57.516459+0000","last_undegraded":"2023-06-09T04:36:57.516459+0000","last_fullsized":"2023-06-09T04:36:57.516459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:25.099912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500031+0000","last_change":"2023-06-09T04:36:53.088748+0000","last_active":"2023-06-09T04:36:57.500031+0000","last_peered":"2023-06-09T04:36:57.500031+0000","last_clean":"2023-06-09T04:36:57.500031+0000","last_became_active":"2023-06-09T04:36:53.088502+0000","last_became_peered":"2023-06-09T04:36:53.088502+0000","last_unstale":"2023-06-09T04:36:57.500031+0000","last_undegraded":"2023-06-09T04:36:57.500031+0000","last_fullsized":"2023-06-09T04:36:57.500031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517058+0000","last_change":"2023-06-09T04:36:53.083847+0000","last_active":"2023-06-09T04:36:57.517058+0000","last_peered":"2023-06-09T04:36:57.517058+0000","last_clean":"2023-06-09T04:36:57.517058+0000","last_became_active":"2023-06-09T04:36:53.083583+0000","last_became_peered":"2023-06-09T04:36:53.083583+0000","last_unstale":"2023-06-09T04:36:57.517058+0000","last_undegraded":"2023-06-09T04:36:57.517058+0000","last_fullsized":"2023-06-09T04:36:57.517058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:03.284187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516893+0000","last_change":"2023-06-09T04:36:53.095654+0000","last_active":"2023-06-09T04:36:57.516893+0000","last_peered":"2023-06-09T04:36:57.516893+0000","last_clean":"2023-06-09T04:36:57.516893+0000","last_became_active":"2023-06-09T04:36:53.095185+0000","last_became_peered":"2023-06-09T04:36:53.095185+0000","last_unstale":"2023-06-09T04:36:57.516893+0000","last_undegraded":"2023-06-09T04:36:57.516893+0000","last_fullsized":"2023-06-09T04:36:57.516893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:55:22.307750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517490+0000","last_change":"2023-06-09T04:36:53.097881+0000","last_active":"2023-06-09T04:36:57.517490+0000","last_peered":"2023-06-09T04:36:57.517490+0000","last_clean":"2023-06-09T04:36:57.517490+0000","last_became_active":"2023-06-09T04:36:53.097547+0000","last_became_peered":"2023-06-09T04:36:53.097547+0000","last_unstale":"2023-06-09T04:36:57.517490+0000","last_undegraded":"2023-06-09T04:36:57.517490+0000","last_fullsized":"2023-06-09T04:36:57.517490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:04.707925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517800+0000","last_change":"2023-06-09T04:36:53.086120+0000","last_active":"2023-06-09T04:36:57.517800+0000","last_peered":"2023-06-09T04:36:57.517800+0000","last_clean":"2023-06-09T04:36:57.517800+0000","last_became_active":"2023-06-09T04:36:53.084767+0000","last_became_peered":"2023-06-09T04:36:53.084767+0000","last_unstale":"2023-06-09T04:36:57.517800+0000","last_undegraded":"2023-06-09T04:36:57.517800+0000","last_fullsized":"2023-06-09T04:36:57.517800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:41:21.417006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501176+0000","last_change":"2023-06-09T04:36:53.097702+0000","last_active":"2023-06-09T04:36:57.501176+0000","last_peered":"2023-06-09T04:36:57.501176+0000","last_clean":"2023-06-09T04:36:57.501176+0000","last_became_active":"2023-06-09T04:36:53.097430+0000","last_became_peered":"2023-06-09T04:36:53.097430+0000","last_unstale":"2023-06-09T04:36:57.501176+0000","last_undegraded":"2023-06-09T04:36:57.501176+0000","last_fullsized":"2023-06-09T04:36:57.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:53.656092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502448+0000","last_change":"2023-06-09T04:36:57.111577+0000","last_active":"2023-06-09T04:36:57.502448+0000","last_peered":"2023-06-09T04:36:57.502448+0000","last_clean":"2023-06-09T04:36:57.502448+0000","last_became_active":"2023-06-09T04:36:57.111245+0000","last_became_peered":"2023-06-09T04:36:57.111245+0000","last_unstale":"2023-06-09T04:36:57.502448+0000","last_undegraded":"2023-06-09T04:36:57.502448+0000","last_fullsized":"2023-06-09T04:36:57.502448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:23:59.825454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501854+0000","last_change":"2023-06-09T04:36:52.689588+0000","last_active":"2023-06-09T04:36:57.501854+0000","last_peered":"2023-06-09T04:36:57.501854+0000","last_clean":"2023-06-09T04:36:57.501854+0000","last_became_active":"2023-06-09T04:36:52.689361+0000","last_became_peered":"2023-06-09T04:36:52.689361+0000","last_unstale":"2023-06-09T04:36:57.501854+0000","last_undegraded":"2023-06-09T04:36:57.501854+0000","last_fullsized":"2023-06-09T04:36:57.501854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:58.398325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518173+0000","last_change":"2023-06-09T04:36:53.091208+0000","last_active":"2023-06-09T04:36:57.518173+0000","last_peered":"2023-06-09T04:36:57.518173+0000","last_clean":"2023-06-09T04:36:57.518173+0000","last_became_active":"2023-06-09T04:36:53.090968+0000","last_became_peered":"2023-06-09T04:36:53.090968+0000","last_unstale":"2023-06-09T04:36:57.518173+0000","last_undegraded":"2023-06-09T04:36:57.518173+0000","last_fullsized":"2023-06-09T04:36:57.518173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:42:13.600595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517253+0000","last_change":"2023-06-09T04:36:57.119505+0000","last_active":"2023-06-09T04:36:57.517253+0000","last_peered":"2023-06-09T04:36:57.517253+0000","last_clean":"2023-06-09T04:36:57.517253+0000","last_became_active":"2023-06-09T04:36:57.119057+0000","last_became_peered":"2023-06-09T04:36:57.119057+0000","last_unstale":"2023-06-09T04:36:57.517253+0000","last_undegraded":"2023-06-09T04:36:57.517253+0000","last_fullsized":"2023-06-09T04:36:57.517253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:49:47.898866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515849+0000","last_change":"2023-06-09T04:36:52.689176+0000","last_active":"2023-06-09T04:36:57.515849+0000","last_peered":"2023-06-09T04:36:57.515849+0000","last_clean":"2023-06-09T04:36:57.515849+0000","last_became_active":"2023-06-09T04:36:52.688832+0000","last_became_peered":"2023-06-09T04:36:52.688832+0000","last_unstale":"2023-06-09T04:36:57.515849+0000","last_undegraded":"2023-06-09T04:36:57.515849+0000","last_fullsized":"2023-06-09T04:36:57.515849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:21:30.392902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500719+0000","last_change":"2023-06-09T04:36:53.084730+0000","last_active":"2023-06-09T04:36:57.500719+0000","last_peered":"2023-06-09T04:36:57.500719+0000","last_clean":"2023-06-09T04:36:57.500719+0000","last_became_active":"2023-06-09T04:36:53.084457+0000","last_became_peered":"2023-06-09T04:36:53.084457+0000","last_unstale":"2023-06-09T04:36:57.500719+0000","last_undegraded":"2023-06-09T04:36:57.500719+0000","last_fullsized":"2023-06-09T04:36:57.500719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:46.230118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500777+0000","last_change":"2023-06-09T04:36:57.115570+0000","last_active":"2023-06-09T04:36:57.500777+0000","last_peered":"2023-06-09T04:36:57.500777+0000","last_clean":"2023-06-09T04:36:57.500777+0000","last_became_active":"2023-06-09T04:36:57.115189+0000","last_became_peered":"2023-06-09T04:36:57.115189+0000","last_unstale":"2023-06-09T04:36:57.500777+0000","last_undegraded":"2023-06-09T04:36:57.500777+0000","last_fullsized":"2023-06-09T04:36:57.500777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:03.834311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516808+0000","last_change":"2023-06-09T04:36:52.687655+0000","last_active":"2023-06-09T04:36:57.516808+0000","last_peered":"2023-06-09T04:36:57.516808+0000","last_clean":"2023-06-09T04:36:57.516808+0000","last_became_active":"2023-06-09T04:36:52.687400+0000","last_became_peered":"2023-06-09T04:36:52.687400+0000","last_unstale":"2023-06-09T04:36:57.516808+0000","last_undegraded":"2023-06-09T04:36:57.516808+0000","last_fullsized":"2023-06-09T04:36:57.516808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:27:37.159215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517354+0000","last_change":"2023-06-09T04:36:53.092476+0000","last_active":"2023-06-09T04:36:57.517354+0000","last_peered":"2023-06-09T04:36:57.517354+0000","last_clean":"2023-06-09T04:36:57.517354+0000","last_became_active":"2023-06-09T04:36:53.091216+0000","last_became_peered":"2023-06-09T04:36:53.091216+0000","last_unstale":"2023-06-09T04:36:57.517354+0000","last_undegraded":"2023-06-09T04:36:57.517354+0000","last_fullsized":"2023-06-09T04:36:57.517354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:18:25.432988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515945+0000","last_change":"2023-06-09T04:36:57.117686+0000","last_active":"2023-06-09T04:36:57.515945+0000","last_peered":"2023-06-09T04:36:57.515945+0000","last_clean":"2023-06-09T04:36:57.515945+0000","last_became_active":"2023-06-09T04:36:57.117316+0000","last_became_peered":"2023-06-09T04:36:57.117316+0000","last_unstale":"2023-06-09T04:36:57.515945+0000","last_undegraded":"2023-06-09T04:36:57.515945+0000","last_fullsized":"2023-06-09T04:36:57.515945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:39:59.205133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500858+0000","last_change":"2023-06-09T04:36:52.680452+0000","last_active":"2023-06-09T04:36:57.500858+0000","last_peered":"2023-06-09T04:36:57.500858+0000","last_clean":"2023-06-09T04:36:57.500858+0000","last_became_active":"2023-06-09T04:36:52.680163+0000","last_became_peered":"2023-06-09T04:36:52.680163+0000","last_unstale":"2023-06-09T04:36:57.500858+0000","last_undegraded":"2023-06-09T04:36:57.500858+0000","last_fullsized":"2023-06-09T04:36:57.500858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516765+0000","last_change":"2023-06-09T04:36:53.082234+0000","last_active":"2023-06-09T04:36:57.516765+0000","last_peered":"2023-06-09T04:36:57.516765+0000","last_clean":"2023-06-09T04:36:57.516765+0000","last_became_active":"2023-06-09T04:36:53.081968+0000","last_became_peered":"2023-06-09T04:36:53.081968+0000","last_unstale":"2023-06-09T04:36:57.516765+0000","last_undegraded":"2023-06-09T04:36:57.516765+0000","last_fullsized":"2023-06-09T04:36:57.516765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:56.517310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515939+0000","last_change":"2023-06-09T04:36:57.124201+0000","last_active":"2023-06-09T04:36:57.515939+0000","last_peered":"2023-06-09T04:36:57.515939+0000","last_clean":"2023-06-09T04:36:57.515939+0000","last_became_active":"2023-06-09T04:36:57.123897+0000","last_became_peered":"2023-06-09T04:36:57.123897+0000","last_unstale":"2023-06-09T04:36:57.515939+0000","last_undegraded":"2023-06-09T04:36:57.515939+0000","last_fullsized":"2023-06-09T04:36:57.515939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:57.073264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501691+0000","last_change":"2023-06-09T04:36:52.685020+0000","last_active":"2023-06-09T04:36:57.501691+0000","last_peered":"2023-06-09T04:36:57.501691+0000","last_clean":"2023-06-09T04:36:57.501691+0000","last_became_active":"2023-06-09T04:36:52.684745+0000","last_became_peered":"2023-06-09T04:36:52.684745+0000","last_unstale":"2023-06-09T04:36:57.501691+0000","last_undegraded":"2023-06-09T04:36:57.501691+0000","last_fullsized":"2023-06-09T04:36:57.501691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:39:59.409669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516410+0000","last_change":"2023-06-09T04:36:53.087590+0000","last_active":"2023-06-09T04:36:57.516410+0000","last_peered":"2023-06-09T04:36:57.516410+0000","last_clean":"2023-06-09T04:36:57.516410+0000","last_became_active":"2023-06-09T04:36:53.087288+0000","last_became_peered":"2023-06-09T04:36:53.087288+0000","last_unstale":"2023-06-09T04:36:57.516410+0000","last_undegraded":"2023-06-09T04:36:57.516410+0000","last_fullsized":"2023-06-09T04:36:57.516410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:36:08.176626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517477+0000","last_change":"2023-06-09T04:36:57.117163+0000","last_active":"2023-06-09T04:36:57.517477+0000","last_peered":"2023-06-09T04:36:57.517477+0000","last_clean":"2023-06-09T04:36:57.517477+0000","last_became_active":"2023-06-09T04:36:57.116767+0000","last_became_peered":"2023-06-09T04:36:57.116767+0000","last_unstale":"2023-06-09T04:36:57.517477+0000","last_undegraded":"2023-06-09T04:36:57.517477+0000","last_fullsized":"2023-06-09T04:36:57.517477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:21:19.081920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516877+0000","last_change":"2023-06-09T04:36:52.688067+0000","last_active":"2023-06-09T04:36:57.516877+0000","last_peered":"2023-06-09T04:36:57.516877+0000","last_clean":"2023-06-09T04:36:57.516877+0000","last_became_active":"2023-06-09T04:36:52.687767+0000","last_became_peered":"2023-06-09T04:36:52.687767+0000","last_unstale":"2023-06-09T04:36:57.516877+0000","last_undegraded":"2023-06-09T04:36:57.516877+0000","last_fullsized":"2023-06-09T04:36:57.516877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516575+0000","last_change":"2023-06-09T04:36:53.094793+0000","last_active":"2023-06-09T04:36:57.516575+0000","last_peered":"2023-06-09T04:36:57.516575+0000","last_clean":"2023-06-09T04:36:57.516575+0000","last_became_active":"2023-06-09T04:36:53.094544+0000","last_became_peered":"2023-06-09T04:36:53.094544+0000","last_unstale":"2023-06-09T04:36:57.516575+0000","last_undegraded":"2023-06-09T04:36:57.516575+0000","last_fullsized":"2023-06-09T04:36:57.516575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:23.171635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516588+0000","last_change":"2023-06-09T04:36:57.115780+0000","last_active":"2023-06-09T04:36:57.516588+0000","last_peered":"2023-06-09T04:36:57.516588+0000","last_clean":"2023-06-09T04:36:57.516588+0000","last_became_active":"2023-06-09T04:36:57.115404+0000","last_became_peered":"2023-06-09T04:36:57.115404+0000","last_unstale":"2023-06-09T04:36:57.516588+0000","last_undegraded":"2023-06-09T04:36:57.516588+0000","last_fullsized":"2023-06-09T04:36:57.516588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:51:48.980218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'9","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:37:02.349143+0000","last_change":"2023-06-09T04:36:52.692095+0000","last_active":"2023-06-09T04:37:02.349143+0000","last_peered":"2023-06-09T04:37:02.349143+0000","last_clean":"2023-06-09T04:37:02.349143+0000","last_became_active":"2023-06-09T04:36:52.691784+0000","last_became_peered":"2023-06-09T04:36:52.691784+0000","last_unstale":"2023-06-09T04:37:02.349143+0000","last_undegraded":"2023-06-09T04:37:02.349143+0000","last_fullsized":"2023-06-09T04:37:02.349143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:18:15.356816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502053+0000","last_change":"2023-06-09T04:36:53.090930+0000","last_active":"2023-06-09T04:36:57.502053+0000","last_peered":"2023-06-09T04:36:57.502053+0000","last_clean":"2023-06-09T04:36:57.502053+0000","last_became_active":"2023-06-09T04:36:53.090657+0000","last_became_peered":"2023-06-09T04:36:53.090657+0000","last_unstale":"2023-06-09T04:36:57.502053+0000","last_undegraded":"2023-06-09T04:36:57.502053+0000","last_fullsized":"2023-06-09T04:36:57.502053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:51.015748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501544+0000","last_change":"2023-06-09T04:36:57.117459+0000","last_active":"2023-06-09T04:36:57.501544+0000","last_peered":"2023-06-09T04:36:57.501544+0000","last_clean":"2023-06-09T04:36:57.501544+0000","last_became_active":"2023-06-09T04:36:57.116484+0000","last_became_peered":"2023-06-09T04:36:57.116484+0000","last_unstale":"2023-06-09T04:36:57.501544+0000","last_undegraded":"2023-06-09T04:36:57.501544+0000","last_fullsized":"2023-06-09T04:36:57.501544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:49.647290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516290+0000","last_change":"2023-06-09T04:36:52.695139+0000","last_active":"2023-06-09T04:36:57.516290+0000","last_peered":"2023-06-09T04:36:57.516290+0000","last_clean":"2023-06-09T04:36:57.516290+0000","last_became_active":"2023-06-09T04:36:52.694827+0000","last_became_peered":"2023-06-09T04:36:52.694827+0000","last_unstale":"2023-06-09T04:36:57.516290+0000","last_undegraded":"2023-06-09T04:36:57.516290+0000","last_fullsized":"2023-06-09T04:36:57.516290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517671+0000","last_change":"2023-06-09T04:36:53.095157+0000","last_active":"2023-06-09T04:36:57.517671+0000","last_peered":"2023-06-09T04:36:57.517671+0000","last_clean":"2023-06-09T04:36:57.517671+0000","last_became_active":"2023-06-09T04:36:53.094875+0000","last_became_peered":"2023-06-09T04:36:53.094875+0000","last_unstale":"2023-06-09T04:36:57.517671+0000","last_undegraded":"2023-06-09T04:36:57.517671+0000","last_fullsized":"2023-06-09T04:36:57.517671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:09:41.901417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517856+0000","last_change":"2023-06-09T04:36:57.121242+0000","last_active":"2023-06-09T04:36:57.517856+0000","last_peered":"2023-06-09T04:36:57.517856+0000","last_clean":"2023-06-09T04:36:57.517856+0000","last_became_active":"2023-06-09T04:36:57.120828+0000","last_became_peered":"2023-06-09T04:36:57.120828+0000","last_unstale":"2023-06-09T04:36:57.517856+0000","last_undegraded":"2023-06-09T04:36:57.517856+0000","last_fullsized":"2023-06-09T04:36:57.517856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:46:34.091463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500201+0000","last_change":"2023-06-09T04:36:52.685837+0000","last_active":"2023-06-09T04:36:57.500201+0000","last_peered":"2023-06-09T04:36:57.500201+0000","last_clean":"2023-06-09T04:36:57.500201+0000","last_became_active":"2023-06-09T04:36:52.685574+0000","last_became_peered":"2023-06-09T04:36:52.685574+0000","last_unstale":"2023-06-09T04:36:57.500201+0000","last_undegraded":"2023-06-09T04:36:57.500201+0000","last_fullsized":"2023-06-09T04:36:57.500201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:30.615879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501059+0000","last_change":"2023-06-09T04:36:53.097686+0000","last_active":"2023-06-09T04:36:57.501059+0000","last_peered":"2023-06-09T04:36:57.501059+0000","last_clean":"2023-06-09T04:36:57.501059+0000","last_became_active":"2023-06-09T04:36:53.097408+0000","last_became_peered":"2023-06-09T04:36:53.097408+0000","last_unstale":"2023-06-09T04:36:57.501059+0000","last_undegraded":"2023-06-09T04:36:57.501059+0000","last_fullsized":"2023-06-09T04:36:57.501059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:19.733618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517413+0000","last_change":"2023-06-09T04:36:57.121670+0000","last_active":"2023-06-09T04:36:57.517413+0000","last_peered":"2023-06-09T04:36:57.517413+0000","last_clean":"2023-06-09T04:36:57.517413+0000","last_became_active":"2023-06-09T04:36:57.121104+0000","last_became_peered":"2023-06-09T04:36:57.121104+0000","last_unstale":"2023-06-09T04:36:57.517413+0000","last_undegraded":"2023-06-09T04:36:57.517413+0000","last_fullsized":"2023-06-09T04:36:57.517413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:16:39.554269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516432+0000","last_change":"2023-06-09T04:36:52.694081+0000","last_active":"2023-06-09T04:36:57.516432+0000","last_peered":"2023-06-09T04:36:57.516432+0000","last_clean":"2023-06-09T04:36:57.516432+0000","last_became_active":"2023-06-09T04:36:52.693752+0000","last_became_peered":"2023-06-09T04:36:52.693752+0000","last_unstale":"2023-06-09T04:36:57.516432+0000","last_undegraded":"2023-06-09T04:36:57.516432+0000","last_fullsized":"2023-06-09T04:36:57.516432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:19:45.222648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500883+0000","last_change":"2023-06-09T04:36:53.080447+0000","last_active":"2023-06-09T04:36:57.500883+0000","last_peered":"2023-06-09T04:36:57.500883+0000","last_clean":"2023-06-09T04:36:57.500883+0000","last_became_active":"2023-06-09T04:36:53.080171+0000","last_became_peered":"2023-06-09T04:36:53.080171+0000","last_unstale":"2023-06-09T04:36:57.500883+0000","last_undegraded":"2023-06-09T04:36:57.500883+0000","last_fullsized":"2023-06-09T04:36:57.500883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:42.879671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501651+0000","last_change":"2023-06-09T04:36:57.117032+0000","last_active":"2023-06-09T04:36:57.501651+0000","last_peered":"2023-06-09T04:36:57.501651+0000","last_clean":"2023-06-09T04:36:57.501651+0000","last_became_active":"2023-06-09T04:36:57.116612+0000","last_became_peered":"2023-06-09T04:36:57.116612+0000","last_unstale":"2023-06-09T04:36:57.501651+0000","last_undegraded":"2023-06-09T04:36:57.501651+0000","last_fullsized":"2023-06-09T04:36:57.501651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:28.517085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"21'8","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515881+0000","last_change":"2023-06-09T04:36:52.694818+0000","last_active":"2023-06-09T04:36:57.515881+0000","last_peered":"2023-06-09T04:36:57.515881+0000","last_clean":"2023-06-09T04:36:57.515881+0000","last_became_active":"2023-06-09T04:36:52.694511+0000","last_became_peered":"2023-06-09T04:36:52.694511+0000","last_unstale":"2023-06-09T04:36:57.515881+0000","last_undegraded":"2023-06-09T04:36:57.515881+0000","last_fullsized":"2023-06-09T04:36:57.515881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:03:02.382793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517854+0000","last_change":"2023-06-09T04:36:53.093019+0000","last_active":"2023-06-09T04:36:57.517854+0000","last_peered":"2023-06-09T04:36:57.517854+0000","last_clean":"2023-06-09T04:36:57.517854+0000","last_became_active":"2023-06-09T04:36:53.092732+0000","last_became_peered":"2023-06-09T04:36:53.092732+0000","last_unstale":"2023-06-09T04:36:57.517854+0000","last_undegraded":"2023-06-09T04:36:57.517854+0000","last_fullsized":"2023-06-09T04:36:57.517854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:27:55.655270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516764+0000","last_change":"2023-06-09T04:36:57.121228+0000","last_active":"2023-06-09T04:36:57.516764+0000","last_peered":"2023-06-09T04:36:57.516764+0000","last_clean":"2023-06-09T04:36:57.516764+0000","last_became_active":"2023-06-09T04:36:57.120064+0000","last_became_peered":"2023-06-09T04:36:57.120064+0000","last_unstale":"2023-06-09T04:36:57.516764+0000","last_undegraded":"2023-06-09T04:36:57.516764+0000","last_fullsized":"2023-06-09T04:36:57.516764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:46.296844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516944+0000","last_change":"2023-06-09T04:36:52.692512+0000","last_active":"2023-06-09T04:36:57.516944+0000","last_peered":"2023-06-09T04:36:57.516944+0000","last_clean":"2023-06-09T04:36:57.516944+0000","last_became_active":"2023-06-09T04:36:52.692141+0000","last_became_peered":"2023-06-09T04:36:52.692141+0000","last_unstale":"2023-06-09T04:36:57.516944+0000","last_undegraded":"2023-06-09T04:36:57.516944+0000","last_fullsized":"2023-06-09T04:36:57.516944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:53:31.420451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500425+0000","last_change":"2023-06-09T04:36:53.091220+0000","last_active":"2023-06-09T04:36:57.500425+0000","last_peered":"2023-06-09T04:36:57.500425+0000","last_clean":"2023-06-09T04:36:57.500425+0000","last_became_active":"2023-06-09T04:36:53.090754+0000","last_became_peered":"2023-06-09T04:36:53.090754+0000","last_unstale":"2023-06-09T04:36:57.500425+0000","last_undegraded":"2023-06-09T04:36:57.500425+0000","last_fullsized":"2023-06-09T04:36:57.500425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:06.194724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516278+0000","last_change":"2023-06-09T04:36:57.113964+0000","last_active":"2023-06-09T04:36:57.516278+0000","last_peered":"2023-06-09T04:36:57.516278+0000","last_clean":"2023-06-09T04:36:57.516278+0000","last_became_active":"2023-06-09T04:36:57.113569+0000","last_became_peered":"2023-06-09T04:36:57.113569+0000","last_unstale":"2023-06-09T04:36:57.516278+0000","last_undegraded":"2023-06-09T04:36:57.516278+0000","last_fullsized":"2023-06-09T04:36:57.516278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:36.118778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516531+0000","last_change":"2023-06-09T04:36:52.692397+0000","last_active":"2023-06-09T04:36:57.516531+0000","last_peered":"2023-06-09T04:36:57.516531+0000","last_clean":"2023-06-09T04:36:57.516531+0000","last_became_active":"2023-06-09T04:36:52.692131+0000","last_became_peered":"2023-06-09T04:36:52.692131+0000","last_unstale":"2023-06-09T04:36:57.516531+0000","last_undegraded":"2023-06-09T04:36:57.516531+0000","last_fullsized":"2023-06-09T04:36:57.516531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:53.328867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501708+0000","last_change":"2023-06-09T04:36:53.091347+0000","last_active":"2023-06-09T04:36:57.501708+0000","last_peered":"2023-06-09T04:36:57.501708+0000","last_clean":"2023-06-09T04:36:57.501708+0000","last_became_active":"2023-06-09T04:36:53.091096+0000","last_became_peered":"2023-06-09T04:36:53.091096+0000","last_unstale":"2023-06-09T04:36:57.501708+0000","last_undegraded":"2023-06-09T04:36:57.501708+0000","last_fullsized":"2023-06-09T04:36:57.501708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:49:02.631814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516638+0000","last_change":"2023-06-09T04:36:57.119015+0000","last_active":"2023-06-09T04:36:57.516638+0000","last_peered":"2023-06-09T04:36:57.516638+0000","last_clean":"2023-06-09T04:36:57.516638+0000","last_became_active":"2023-06-09T04:36:57.118718+0000","last_became_peered":"2023-06-09T04:36:57.118718+0000","last_unstale":"2023-06-09T04:36:57.516638+0000","last_undegraded":"2023-06-09T04:36:57.516638+0000","last_fullsized":"2023-06-09T04:36:57.516638+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:55:37.273193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516611+0000","last_change":"2023-06-09T04:36:52.687979+0000","last_active":"2023-06-09T04:36:57.516611+0000","last_peered":"2023-06-09T04:36:57.516611+0000","last_clean":"2023-06-09T04:36:57.516611+0000","last_became_active":"2023-06-09T04:36:52.687674+0000","last_became_peered":"2023-06-09T04:36:52.687674+0000","last_unstale":"2023-06-09T04:36:57.516611+0000","last_undegraded":"2023-06-09T04:36:57.516611+0000","last_fullsized":"2023-06-09T04:36:57.516611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:04:10.829163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515933+0000","last_change":"2023-06-09T04:36:53.092231+0000","last_active":"2023-06-09T04:36:57.515933+0000","last_peered":"2023-06-09T04:36:57.515933+0000","last_clean":"2023-06-09T04:36:57.515933+0000","last_became_active":"2023-06-09T04:36:53.091964+0000","last_became_peered":"2023-06-09T04:36:53.091964+0000","last_unstale":"2023-06-09T04:36:57.515933+0000","last_undegraded":"2023-06-09T04:36:57.515933+0000","last_fullsized":"2023-06-09T04:36:57.515933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:52.833274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516701+0000","last_change":"2023-06-09T04:36:57.112419+0000","last_active":"2023-06-09T04:36:57.516701+0000","last_peered":"2023-06-09T04:36:57.516701+0000","last_clean":"2023-06-09T04:36:57.516701+0000","last_became_active":"2023-06-09T04:36:57.112077+0000","last_became_peered":"2023-06-09T04:36:57.112077+0000","last_unstale":"2023-06-09T04:36:57.516701+0000","last_undegraded":"2023-06-09T04:36:57.516701+0000","last_fullsized":"2023-06-09T04:36:57.516701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:05.009136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501097+0000","last_change":"2023-06-09T04:36:52.688267+0000","last_active":"2023-06-09T04:36:57.501097+0000","last_peered":"2023-06-09T04:36:57.501097+0000","last_clean":"2023-06-09T04:36:57.501097+0000","last_became_active":"2023-06-09T04:36:52.687992+0000","last_became_peered":"2023-06-09T04:36:52.687992+0000","last_unstale":"2023-06-09T04:36:57.501097+0000","last_undegraded":"2023-06-09T04:36:57.501097+0000","last_fullsized":"2023-06-09T04:36:57.501097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:24.458188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500688+0000","last_change":"2023-06-09T04:36:53.090432+0000","last_active":"2023-06-09T04:36:57.500688+0000","last_peered":"2023-06-09T04:36:57.500688+0000","last_clean":"2023-06-09T04:36:57.500688+0000","last_became_active":"2023-06-09T04:36:53.090048+0000","last_became_peered":"2023-06-09T04:36:53.090048+0000","last_unstale":"2023-06-09T04:36:57.500688+0000","last_undegraded":"2023-06-09T04:36:57.500688+0000","last_fullsized":"2023-06-09T04:36:57.500688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:42.971394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516962+0000","last_change":"2023-06-09T04:36:57.119128+0000","last_active":"2023-06-09T04:36:57.516962+0000","last_peered":"2023-06-09T04:36:57.516962+0000","last_clean":"2023-06-09T04:36:57.516962+0000","last_became_active":"2023-06-09T04:36:57.118804+0000","last_became_peered":"2023-06-09T04:36:57.118804+0000","last_unstale":"2023-06-09T04:36:57.516962+0000","last_undegraded":"2023-06-09T04:36:57.516962+0000","last_fullsized":"2023-06-09T04:36:57.516962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:45:01.621362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517322+0000","last_change":"2023-06-09T04:36:52.687200+0000","last_active":"2023-06-09T04:36:57.517322+0000","last_peered":"2023-06-09T04:36:57.517322+0000","last_clean":"2023-06-09T04:36:57.517322+0000","last_became_active":"2023-06-09T04:36:52.686926+0000","last_became_peered":"2023-06-09T04:36:52.686926+0000","last_unstale":"2023-06-09T04:36:57.517322+0000","last_undegraded":"2023-06-09T04:36:57.517322+0000","last_fullsized":"2023-06-09T04:36:57.517322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:38:55.176458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501823+0000","last_change":"2023-06-09T04:36:53.087793+0000","last_active":"2023-06-09T04:36:57.501823+0000","last_peered":"2023-06-09T04:36:57.501823+0000","last_clean":"2023-06-09T04:36:57.501823+0000","last_became_active":"2023-06-09T04:36:53.087526+0000","last_became_peered":"2023-06-09T04:36:53.087526+0000","last_unstale":"2023-06-09T04:36:57.501823+0000","last_undegraded":"2023-06-09T04:36:57.501823+0000","last_fullsized":"2023-06-09T04:36:57.501823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:08:25.419479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516970+0000","last_change":"2023-06-09T04:36:57.109316+0000","last_active":"2023-06-09T04:36:57.516970+0000","last_peered":"2023-06-09T04:36:57.516970+0000","last_clean":"2023-06-09T04:36:57.516970+0000","last_became_active":"2023-06-09T04:36:57.108933+0000","last_became_peered":"2023-06-09T04:36:57.108933+0000","last_unstale":"2023-06-09T04:36:57.516970+0000","last_undegraded":"2023-06-09T04:36:57.516970+0000","last_fullsized":"2023-06-09T04:36:57.516970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:37:23.542540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516752+0000","last_change":"2023-06-09T04:36:52.693014+0000","last_active":"2023-06-09T04:36:57.516752+0000","last_peered":"2023-06-09T04:36:57.516752+0000","last_clean":"2023-06-09T04:36:57.516752+0000","last_became_active":"2023-06-09T04:36:52.692786+0000","last_became_peered":"2023-06-09T04:36:52.692786+0000","last_unstale":"2023-06-09T04:36:57.516752+0000","last_undegraded":"2023-06-09T04:36:57.516752+0000","last_fullsized":"2023-06-09T04:36:57.516752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:56:37.205136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502190+0000","last_change":"2023-06-09T04:36:53.087658+0000","last_active":"2023-06-09T04:36:57.502190+0000","last_peered":"2023-06-09T04:36:57.502190+0000","last_clean":"2023-06-09T04:36:57.502190+0000","last_became_active":"2023-06-09T04:36:53.087414+0000","last_became_peered":"2023-06-09T04:36:53.087414+0000","last_unstale":"2023-06-09T04:36:57.502190+0000","last_undegraded":"2023-06-09T04:36:57.502190+0000","last_fullsized":"2023-06-09T04:36:57.502190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:51:43.763282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501165+0000","last_change":"2023-06-09T04:36:57.118582+0000","last_active":"2023-06-09T04:36:57.501165+0000","last_peered":"2023-06-09T04:36:57.501165+0000","last_clean":"2023-06-09T04:36:57.501165+0000","last_became_active":"2023-06-09T04:36:57.118128+0000","last_became_peered":"2023-06-09T04:36:57.118128+0000","last_unstale":"2023-06-09T04:36:57.501165+0000","last_undegraded":"2023-06-09T04:36:57.501165+0000","last_fullsized":"2023-06-09T04:36:57.501165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:28:35.040521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501455+0000","last_change":"2023-06-09T04:36:52.695510+0000","last_active":"2023-06-09T04:36:57.501455+0000","last_peered":"2023-06-09T04:36:57.501455+0000","last_clean":"2023-06-09T04:36:57.501455+0000","last_became_active":"2023-06-09T04:36:52.695256+0000","last_became_peered":"2023-06-09T04:36:52.695256+0000","last_unstale":"2023-06-09T04:36:57.501455+0000","last_undegraded":"2023-06-09T04:36:57.501455+0000","last_fullsized":"2023-06-09T04:36:57.501455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:06:35.772477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502738+0000","last_change":"2023-06-09T04:36:53.094151+0000","last_active":"2023-06-09T04:36:57.502738+0000","last_peered":"2023-06-09T04:36:57.502738+0000","last_clean":"2023-06-09T04:36:57.502738+0000","last_became_active":"2023-06-09T04:36:53.093875+0000","last_became_peered":"2023-06-09T04:36:53.093875+0000","last_unstale":"2023-06-09T04:36:57.502738+0000","last_undegraded":"2023-06-09T04:36:57.502738+0000","last_fullsized":"2023-06-09T04:36:57.502738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:28:31.886725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502450+0000","last_change":"2023-06-09T04:36:57.115949+0000","last_active":"2023-06-09T04:36:57.502450+0000","last_peered":"2023-06-09T04:36:57.502450+0000","last_clean":"2023-06-09T04:36:57.502450+0000","last_became_active":"2023-06-09T04:36:57.115534+0000","last_became_peered":"2023-06-09T04:36:57.115534+0000","last_unstale":"2023-06-09T04:36:57.502450+0000","last_undegraded":"2023-06-09T04:36:57.502450+0000","last_fullsized":"2023-06-09T04:36:57.502450+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:19:23.721200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516691+0000","last_change":"2023-06-09T04:36:52.690632+0000","last_active":"2023-06-09T04:36:57.516691+0000","last_peered":"2023-06-09T04:36:57.516691+0000","last_clean":"2023-06-09T04:36:57.516691+0000","last_became_active":"2023-06-09T04:36:52.690338+0000","last_became_peered":"2023-06-09T04:36:52.690338+0000","last_unstale":"2023-06-09T04:36:57.516691+0000","last_undegraded":"2023-06-09T04:36:57.516691+0000","last_fullsized":"2023-06-09T04:36:57.516691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:15:03.415789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517712+0000","last_change":"2023-06-09T04:36:53.095130+0000","last_active":"2023-06-09T04:36:57.517712+0000","last_peered":"2023-06-09T04:36:57.517712+0000","last_clean":"2023-06-09T04:36:57.517712+0000","last_became_active":"2023-06-09T04:36:53.094805+0000","last_became_peered":"2023-06-09T04:36:53.094805+0000","last_unstale":"2023-06-09T04:36:57.517712+0000","last_undegraded":"2023-06-09T04:36:57.517712+0000","last_fullsized":"2023-06-09T04:36:57.517712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:22.682476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501842+0000","last_change":"2023-06-09T04:36:57.115754+0000","last_active":"2023-06-09T04:36:57.501842+0000","last_peered":"2023-06-09T04:36:57.501842+0000","last_clean":"2023-06-09T04:36:57.501842+0000","last_became_active":"2023-06-09T04:36:57.115330+0000","last_became_peered":"2023-06-09T04:36:57.115330+0000","last_unstale":"2023-06-09T04:36:57.501842+0000","last_undegraded":"2023-06-09T04:36:57.501842+0000","last_fullsized":"2023-06-09T04:36:57.501842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:29.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517666+0000","last_change":"2023-06-09T04:36:52.693950+0000","last_active":"2023-06-09T04:36:57.517666+0000","last_peered":"2023-06-09T04:36:57.517666+0000","last_clean":"2023-06-09T04:36:57.517666+0000","last_became_active":"2023-06-09T04:36:52.691659+0000","last_became_peered":"2023-06-09T04:36:52.691659+0000","last_unstale":"2023-06-09T04:36:57.517666+0000","last_undegraded":"2023-06-09T04:36:57.517666+0000","last_fullsized":"2023-06-09T04:36:57.517666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:44.676469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502189+0000","last_change":"2023-06-09T04:36:47.621971+0000","last_active":"2023-06-09T04:36:57.502189+0000","last_peered":"2023-06-09T04:36:57.502189+0000","last_clean":"2023-06-09T04:36:57.502189+0000","last_became_active":"2023-06-09T04:36:47.621651+0000","last_became_peered":"2023-06-09T04:36:47.621651+0000","last_unstale":"2023-06-09T04:36:57.502189+0000","last_undegraded":"2023-06-09T04:36:57.502189+0000","last_fullsized":"2023-06-09T04:36:57.502189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:37:38.794916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516574+0000","last_change":"2023-06-09T04:36:53.087151+0000","last_active":"2023-06-09T04:36:57.516574+0000","last_peered":"2023-06-09T04:36:57.516574+0000","last_clean":"2023-06-09T04:36:57.516574+0000","last_became_active":"2023-06-09T04:36:53.086901+0000","last_became_peered":"2023-06-09T04:36:53.086901+0000","last_unstale":"2023-06-09T04:36:57.516574+0000","last_undegraded":"2023-06-09T04:36:57.516574+0000","last_fullsized":"2023-06-09T04:36:57.516574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:45.321905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516429+0000","last_change":"2023-06-09T04:36:57.124627+0000","last_active":"2023-06-09T04:36:57.516429+0000","last_peered":"2023-06-09T04:36:57.516429+0000","last_clean":"2023-06-09T04:36:57.516429+0000","last_became_active":"2023-06-09T04:36:57.124220+0000","last_became_peered":"2023-06-09T04:36:57.124220+0000","last_unstale":"2023-06-09T04:36:57.516429+0000","last_undegraded":"2023-06-09T04:36:57.516429+0000","last_fullsized":"2023-06-09T04:36:57.516429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:22:55.831089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517546+0000","last_change":"2023-06-09T04:36:47.613976+0000","last_active":"2023-06-09T04:36:57.517546+0000","last_peered":"2023-06-09T04:36:57.517546+0000","last_clean":"2023-06-09T04:36:57.517546+0000","last_became_active":"2023-06-09T04:36:47.613691+0000","last_became_peered":"2023-06-09T04:36:47.613691+0000","last_unstale":"2023-06-09T04:36:57.517546+0000","last_undegraded":"2023-06-09T04:36:57.517546+0000","last_fullsized":"2023-06-09T04:36:57.517546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:59.301853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500484+0000","last_change":"2023-06-09T04:36:52.686932+0000","last_active":"2023-06-09T04:36:57.500484+0000","last_peered":"2023-06-09T04:36:57.500484+0000","last_clean":"2023-06-09T04:36:57.500484+0000","last_became_active":"2023-06-09T04:36:52.686353+0000","last_became_peered":"2023-06-09T04:36:52.686353+0000","last_unstale":"2023-06-09T04:36:57.500484+0000","last_undegraded":"2023-06-09T04:36:57.500484+0000","last_fullsized":"2023-06-09T04:36:57.500484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:24.229634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501505+0000","last_change":"2023-06-09T04:36:53.086408+0000","last_active":"2023-06-09T04:36:57.501505+0000","last_peered":"2023-06-09T04:36:57.501505+0000","last_clean":"2023-06-09T04:36:57.501505+0000","last_became_active":"2023-06-09T04:36:53.086039+0000","last_became_peered":"2023-06-09T04:36:53.086039+0000","last_unstale":"2023-06-09T04:36:57.501505+0000","last_undegraded":"2023-06-09T04:36:57.501505+0000","last_fullsized":"2023-06-09T04:36:57.501505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:20:52.845660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500834+0000","last_change":"2023-06-09T04:36:57.119321+0000","last_active":"2023-06-09T04:36:57.500834+0000","last_peered":"2023-06-09T04:36:57.500834+0000","last_clean":"2023-06-09T04:36:57.500834+0000","last_became_active":"2023-06-09T04:36:57.118916+0000","last_became_peered":"2023-06-09T04:36:57.118916+0000","last_unstale":"2023-06-09T04:36:57.500834+0000","last_undegraded":"2023-06-09T04:36:57.500834+0000","last_fullsized":"2023-06-09T04:36:57.500834+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:50.167224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516431+0000","last_change":"2023-06-09T04:36:47.626414+0000","last_active":"2023-06-09T04:36:57.516431+0000","last_peered":"2023-06-09T04:36:57.516431+0000","last_clean":"2023-06-09T04:36:57.516431+0000","last_became_active":"2023-06-09T04:36:47.626166+0000","last_became_peered":"2023-06-09T04:36:47.626166+0000","last_unstale":"2023-06-09T04:36:57.516431+0000","last_undegraded":"2023-06-09T04:36:57.516431+0000","last_fullsized":"2023-06-09T04:36:57.516431+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:57.290510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":177,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516988+0000","last_change":"2023-06-09T04:36:47.627673+0000","last_active":"2023-06-09T04:36:57.516988+0000","last_peered":"2023-06-09T04:36:57.516988+0000","last_clean":"2023-06-09T04:36:57.516988+0000","last_became_active":"2023-06-09T04:36:47.626658+0000","last_became_peered":"2023-06-09T04:36:47.626658+0000","last_unstale":"2023-06-09T04:36:57.516988+0000","last_undegraded":"2023-06-09T04:36:57.516988+0000","last_fullsized":"2023-06-09T04:36:57.516988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:08:59.243942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500010+0000","last_change":"2023-06-09T04:36:52.690886+0000","last_active":"2023-06-09T04:36:57.500010+0000","last_peered":"2023-06-09T04:36:57.500010+0000","last_clean":"2023-06-09T04:36:57.500010+0000","last_became_active":"2023-06-09T04:36:52.690597+0000","last_became_peered":"2023-06-09T04:36:52.690597+0000","last_unstale":"2023-06-09T04:36:57.500010+0000","last_undegraded":"2023-06-09T04:36:57.500010+0000","last_fullsized":"2023-06-09T04:36:57.500010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500874+0000","last_change":"2023-06-09T04:36:53.090386+0000","last_active":"2023-06-09T04:36:57.500874+0000","last_peered":"2023-06-09T04:36:57.500874+0000","last_clean":"2023-06-09T04:36:57.500874+0000","last_became_active":"2023-06-09T04:36:53.081404+0000","last_became_peered":"2023-06-09T04:36:53.081404+0000","last_unstale":"2023-06-09T04:36:57.500874+0000","last_undegraded":"2023-06-09T04:36:57.500874+0000","last_fullsized":"2023-06-09T04:36:57.500874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:16.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.518008+0000","last_change":"2023-06-09T04:36:57.120772+0000","last_active":"2023-06-09T04:36:57.518008+0000","last_peered":"2023-06-09T04:36:57.518008+0000","last_clean":"2023-06-09T04:36:57.518008+0000","last_became_active":"2023-06-09T04:36:57.120404+0000","last_became_peered":"2023-06-09T04:36:57.120404+0000","last_unstale":"2023-06-09T04:36:57.518008+0000","last_undegraded":"2023-06-09T04:36:57.518008+0000","last_fullsized":"2023-06-09T04:36:57.518008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:48:11.255903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516279+0000","last_change":"2023-06-09T04:36:47.618577+0000","last_active":"2023-06-09T04:36:57.516279+0000","last_peered":"2023-06-09T04:36:57.516279+0000","last_clean":"2023-06-09T04:36:57.516279+0000","last_became_active":"2023-06-09T04:36:47.618339+0000","last_became_peered":"2023-06-09T04:36:47.618339+0000","last_unstale":"2023-06-09T04:36:57.516279+0000","last_undegraded":"2023-06-09T04:36:57.516279+0000","last_fullsized":"2023-06-09T04:36:57.516279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:57:36.907071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515932+0000","last_change":"2023-06-09T04:36:52.696188+0000","last_active":"2023-06-09T04:36:57.515932+0000","last_peered":"2023-06-09T04:36:57.515932+0000","last_clean":"2023-06-09T04:36:57.515932+0000","last_became_active":"2023-06-09T04:36:52.695918+0000","last_became_peered":"2023-06-09T04:36:52.695918+0000","last_unstale":"2023-06-09T04:36:57.515932+0000","last_undegraded":"2023-06-09T04:36:57.515932+0000","last_fullsized":"2023-06-09T04:36:57.515932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:17:09.723017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517602+0000","last_change":"2023-06-09T04:36:53.096297+0000","last_active":"2023-06-09T04:36:57.517602+0000","last_peered":"2023-06-09T04:36:57.517602+0000","last_clean":"2023-06-09T04:36:57.517602+0000","last_became_active":"2023-06-09T04:36:53.096047+0000","last_became_peered":"2023-06-09T04:36:53.096047+0000","last_unstale":"2023-06-09T04:36:57.517602+0000","last_undegraded":"2023-06-09T04:36:57.517602+0000","last_fullsized":"2023-06-09T04:36:57.517602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:58.427626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516635+0000","last_change":"2023-06-09T04:36:57.120908+0000","last_active":"2023-06-09T04:36:57.516635+0000","last_peered":"2023-06-09T04:36:57.516635+0000","last_clean":"2023-06-09T04:36:57.516635+0000","last_became_active":"2023-06-09T04:36:57.120245+0000","last_became_peered":"2023-06-09T04:36:57.120245+0000","last_unstale":"2023-06-09T04:36:57.516635+0000","last_undegraded":"2023-06-09T04:36:57.516635+0000","last_fullsized":"2023-06-09T04:36:57.516635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:45.356708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516785+0000","last_change":"2023-06-09T04:36:47.618679+0000","last_active":"2023-06-09T04:36:57.516785+0000","last_peered":"2023-06-09T04:36:57.516785+0000","last_clean":"2023-06-09T04:36:57.516785+0000","last_became_active":"2023-06-09T04:36:47.618391+0000","last_became_peered":"2023-06-09T04:36:47.618391+0000","last_unstale":"2023-06-09T04:36:57.516785+0000","last_undegraded":"2023-06-09T04:36:57.516785+0000","last_fullsized":"2023-06-09T04:36:57.516785+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:40:10.798839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517186+0000","last_change":"2023-06-09T04:36:52.687289+0000","last_active":"2023-06-09T04:36:57.517186+0000","last_peered":"2023-06-09T04:36:57.517186+0000","last_clean":"2023-06-09T04:36:57.517186+0000","last_became_active":"2023-06-09T04:36:52.686981+0000","last_became_peered":"2023-06-09T04:36:52.686981+0000","last_unstale":"2023-06-09T04:36:57.517186+0000","last_undegraded":"2023-06-09T04:36:57.517186+0000","last_fullsized":"2023-06-09T04:36:57.517186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:34.246906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516182+0000","last_change":"2023-06-09T04:36:53.090839+0000","last_active":"2023-06-09T04:36:57.516182+0000","last_peered":"2023-06-09T04:36:57.516182+0000","last_clean":"2023-06-09T04:36:57.516182+0000","last_became_active":"2023-06-09T04:36:53.090549+0000","last_became_peered":"2023-06-09T04:36:53.090549+0000","last_unstale":"2023-06-09T04:36:57.516182+0000","last_undegraded":"2023-06-09T04:36:57.516182+0000","last_fullsized":"2023-06-09T04:36:57.516182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:35:34.025990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500518+0000","last_change":"2023-06-09T04:36:57.115365+0000","last_active":"2023-06-09T04:36:57.500518+0000","last_peered":"2023-06-09T04:36:57.500518+0000","last_clean":"2023-06-09T04:36:57.500518+0000","last_became_active":"2023-06-09T04:36:57.114167+0000","last_became_peered":"2023-06-09T04:36:57.114167+0000","last_unstale":"2023-06-09T04:36:57.500518+0000","last_undegraded":"2023-06-09T04:36:57.500518+0000","last_fullsized":"2023-06-09T04:36:57.500518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:52.854459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500766+0000","last_change":"2023-06-09T04:36:47.616483+0000","last_active":"2023-06-09T04:36:57.500766+0000","last_peered":"2023-06-09T04:36:57.500766+0000","last_clean":"2023-06-09T04:36:57.500766+0000","last_became_active":"2023-06-09T04:36:47.616149+0000","last_became_peered":"2023-06-09T04:36:47.616149+0000","last_unstale":"2023-06-09T04:36:57.500766+0000","last_undegraded":"2023-06-09T04:36:57.500766+0000","last_fullsized":"2023-06-09T04:36:57.500766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:05.520144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502042+0000","last_change":"2023-06-09T04:36:52.692599+0000","last_active":"2023-06-09T04:36:57.502042+0000","last_peered":"2023-06-09T04:36:57.502042+0000","last_clean":"2023-06-09T04:36:57.502042+0000","last_became_active":"2023-06-09T04:36:52.692296+0000","last_became_peered":"2023-06-09T04:36:52.692296+0000","last_unstale":"2023-06-09T04:36:57.502042+0000","last_undegraded":"2023-06-09T04:36:57.502042+0000","last_fullsized":"2023-06-09T04:36:57.502042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:21:23.110649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516068+0000","last_change":"2023-06-09T04:36:53.086306+0000","last_active":"2023-06-09T04:36:57.516068+0000","last_peered":"2023-06-09T04:36:57.516068+0000","last_clean":"2023-06-09T04:36:57.516068+0000","last_became_active":"2023-06-09T04:36:53.081070+0000","last_became_peered":"2023-06-09T04:36:53.081070+0000","last_unstale":"2023-06-09T04:36:57.516068+0000","last_undegraded":"2023-06-09T04:36:57.516068+0000","last_fullsized":"2023-06-09T04:36:57.516068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:34.737443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516958+0000","last_change":"2023-06-09T04:36:57.116547+0000","last_active":"2023-06-09T04:36:57.516958+0000","last_peered":"2023-06-09T04:36:57.516958+0000","last_clean":"2023-06-09T04:36:57.516958+0000","last_became_active":"2023-06-09T04:36:57.116187+0000","last_became_peered":"2023-06-09T04:36:57.116187+0000","last_unstale":"2023-06-09T04:36:57.516958+0000","last_undegraded":"2023-06-09T04:36:57.516958+0000","last_fullsized":"2023-06-09T04:36:57.516958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:45:19.560682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517169+0000","last_change":"2023-06-09T04:36:47.616467+0000","last_active":"2023-06-09T04:36:57.517169+0000","last_peered":"2023-06-09T04:36:57.517169+0000","last_clean":"2023-06-09T04:36:57.517169+0000","last_became_active":"2023-06-09T04:36:47.616166+0000","last_became_peered":"2023-06-09T04:36:47.616166+0000","last_unstale":"2023-06-09T04:36:57.517169+0000","last_undegraded":"2023-06-09T04:36:57.517169+0000","last_fullsized":"2023-06-09T04:36:57.517169+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:07:04.193240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516221+0000","last_change":"2023-06-09T04:36:52.695847+0000","last_active":"2023-06-09T04:36:57.516221+0000","last_peered":"2023-06-09T04:36:57.516221+0000","last_clean":"2023-06-09T04:36:57.516221+0000","last_became_active":"2023-06-09T04:36:52.695537+0000","last_became_peered":"2023-06-09T04:36:52.695537+0000","last_unstale":"2023-06-09T04:36:57.516221+0000","last_undegraded":"2023-06-09T04:36:57.516221+0000","last_fullsized":"2023-06-09T04:36:57.516221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:29:03.665158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500418+0000","last_change":"2023-06-09T04:36:53.092478+0000","last_active":"2023-06-09T04:36:57.500418+0000","last_peered":"2023-06-09T04:36:57.500418+0000","last_clean":"2023-06-09T04:36:57.500418+0000","last_became_active":"2023-06-09T04:36:53.092205+0000","last_became_peered":"2023-06-09T04:36:53.092205+0000","last_unstale":"2023-06-09T04:36:57.500418+0000","last_undegraded":"2023-06-09T04:36:57.500418+0000","last_fullsized":"2023-06-09T04:36:57.500418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:41.939536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500219+0000","last_change":"2023-06-09T04:36:57.117220+0000","last_active":"2023-06-09T04:36:57.500219+0000","last_peered":"2023-06-09T04:36:57.500219+0000","last_clean":"2023-06-09T04:36:57.500219+0000","last_became_active":"2023-06-09T04:36:57.116782+0000","last_became_peered":"2023-06-09T04:36:57.116782+0000","last_unstale":"2023-06-09T04:36:57.500219+0000","last_undegraded":"2023-06-09T04:36:57.500219+0000","last_fullsized":"2023-06-09T04:36:57.500219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:54:28.882830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517307+0000","last_change":"2023-06-09T04:36:47.613658+0000","last_active":"2023-06-09T04:36:57.517307+0000","last_peered":"2023-06-09T04:36:57.517307+0000","last_clean":"2023-06-09T04:36:57.517307+0000","last_became_active":"2023-06-09T04:36:47.613327+0000","last_became_peered":"2023-06-09T04:36:47.613327+0000","last_unstale":"2023-06-09T04:36:57.517307+0000","last_undegraded":"2023-06-09T04:36:57.517307+0000","last_fullsized":"2023-06-09T04:36:57.517307+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:03.397674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500912+0000","last_change":"2023-06-09T04:36:52.688906+0000","last_active":"2023-06-09T04:36:57.500912+0000","last_peered":"2023-06-09T04:36:57.500912+0000","last_clean":"2023-06-09T04:36:57.500912+0000","last_became_active":"2023-06-09T04:36:52.688407+0000","last_became_peered":"2023-06-09T04:36:52.688407+0000","last_unstale":"2023-06-09T04:36:57.500912+0000","last_undegraded":"2023-06-09T04:36:57.500912+0000","last_fullsized":"2023-06-09T04:36:57.500912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:51:55.347687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515917+0000","last_change":"2023-06-09T04:36:53.088941+0000","last_active":"2023-06-09T04:36:57.515917+0000","last_peered":"2023-06-09T04:36:57.515917+0000","last_clean":"2023-06-09T04:36:57.515917+0000","last_became_active":"2023-06-09T04:36:53.088714+0000","last_became_peered":"2023-06-09T04:36:53.088714+0000","last_unstale":"2023-06-09T04:36:57.515917+0000","last_undegraded":"2023-06-09T04:36:57.515917+0000","last_fullsized":"2023-06-09T04:36:57.515917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:45:51.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517126+0000","last_change":"2023-06-09T04:36:57.107346+0000","last_active":"2023-06-09T04:36:57.517126+0000","last_peered":"2023-06-09T04:36:57.517126+0000","last_clean":"2023-06-09T04:36:57.517126+0000","last_became_active":"2023-06-09T04:36:57.106951+0000","last_became_peered":"2023-06-09T04:36:57.106951+0000","last_unstale":"2023-06-09T04:36:57.517126+0000","last_undegraded":"2023-06-09T04:36:57.517126+0000","last_fullsized":"2023-06-09T04:36:57.517126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:19:15.561278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500285+0000","last_change":"2023-06-09T04:36:52.690142+0000","last_active":"2023-06-09T04:36:57.500285+0000","last_peered":"2023-06-09T04:36:57.500285+0000","last_clean":"2023-06-09T04:36:57.500285+0000","last_became_active":"2023-06-09T04:36:52.689899+0000","last_became_peered":"2023-06-09T04:36:52.689899+0000","last_unstale":"2023-06-09T04:36:57.500285+0000","last_undegraded":"2023-06-09T04:36:57.500285+0000","last_fullsized":"2023-06-09T04:36:57.500285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:28:52.648622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516780+0000","last_change":"2023-06-09T04:36:53.090134+0000","last_active":"2023-06-09T04:36:57.516780+0000","last_peered":"2023-06-09T04:36:57.516780+0000","last_clean":"2023-06-09T04:36:57.516780+0000","last_became_active":"2023-06-09T04:36:53.089876+0000","last_became_peered":"2023-06-09T04:36:53.089876+0000","last_unstale":"2023-06-09T04:36:57.516780+0000","last_undegraded":"2023-06-09T04:36:57.516780+0000","last_fullsized":"2023-06-09T04:36:57.516780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:34.780805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516202+0000","last_change":"2023-06-09T04:36:57.119574+0000","last_active":"2023-06-09T04:36:57.516202+0000","last_peered":"2023-06-09T04:36:57.516202+0000","last_clean":"2023-06-09T04:36:57.516202+0000","last_became_active":"2023-06-09T04:36:57.119150+0000","last_became_peered":"2023-06-09T04:36:57.119150+0000","last_unstale":"2023-06-09T04:36:57.516202+0000","last_undegraded":"2023-06-09T04:36:57.516202+0000","last_fullsized":"2023-06-09T04:36:57.516202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500755+0000","last_change":"2023-06-09T04:36:52.690645+0000","last_active":"2023-06-09T04:36:57.500755+0000","last_peered":"2023-06-09T04:36:57.500755+0000","last_clean":"2023-06-09T04:36:57.500755+0000","last_became_active":"2023-06-09T04:36:52.690308+0000","last_became_peered":"2023-06-09T04:36:52.690308+0000","last_unstale":"2023-06-09T04:36:57.500755+0000","last_undegraded":"2023-06-09T04:36:57.500755+0000","last_fullsized":"2023-06-09T04:36:57.500755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:27:40.932066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502199+0000","last_change":"2023-06-09T04:36:53.081068+0000","last_active":"2023-06-09T04:36:57.502199+0000","last_peered":"2023-06-09T04:36:57.502199+0000","last_clean":"2023-06-09T04:36:57.502199+0000","last_became_active":"2023-06-09T04:36:53.080667+0000","last_became_peered":"2023-06-09T04:36:53.080667+0000","last_unstale":"2023-06-09T04:36:57.502199+0000","last_undegraded":"2023-06-09T04:36:57.502199+0000","last_fullsized":"2023-06-09T04:36:57.502199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:32:43.978989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501298+0000","last_change":"2023-06-09T04:36:57.122830+0000","last_active":"2023-06-09T04:36:57.501298+0000","last_peered":"2023-06-09T04:36:57.501298+0000","last_clean":"2023-06-09T04:36:57.501298+0000","last_became_active":"2023-06-09T04:36:57.122375+0000","last_became_peered":"2023-06-09T04:36:57.122375+0000","last_unstale":"2023-06-09T04:36:57.501298+0000","last_undegraded":"2023-06-09T04:36:57.501298+0000","last_fullsized":"2023-06-09T04:36:57.501298+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:06:50.008025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501357+0000","last_change":"2023-06-09T04:36:52.690672+0000","last_active":"2023-06-09T04:36:57.501357+0000","last_peered":"2023-06-09T04:36:57.501357+0000","last_clean":"2023-06-09T04:36:57.501357+0000","last_became_active":"2023-06-09T04:36:52.690387+0000","last_became_peered":"2023-06-09T04:36:52.690387+0000","last_unstale":"2023-06-09T04:36:57.501357+0000","last_undegraded":"2023-06-09T04:36:57.501357+0000","last_fullsized":"2023-06-09T04:36:57.501357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:54:48.429817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501440+0000","last_change":"2023-06-09T04:36:53.087522+0000","last_active":"2023-06-09T04:36:57.501440+0000","last_peered":"2023-06-09T04:36:57.501440+0000","last_clean":"2023-06-09T04:36:57.501440+0000","last_became_active":"2023-06-09T04:36:53.087137+0000","last_became_peered":"2023-06-09T04:36:53.087137+0000","last_unstale":"2023-06-09T04:36:57.501440+0000","last_undegraded":"2023-06-09T04:36:57.501440+0000","last_fullsized":"2023-06-09T04:36:57.501440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:19:08.704227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.501282+0000","last_change":"2023-06-09T04:36:57.122912+0000","last_active":"2023-06-09T04:36:57.501282+0000","last_peered":"2023-06-09T04:36:57.501282+0000","last_clean":"2023-06-09T04:36:57.501282+0000","last_became_active":"2023-06-09T04:36:57.122522+0000","last_became_peered":"2023-06-09T04:36:57.122522+0000","last_unstale":"2023-06-09T04:36:57.501282+0000","last_undegraded":"2023-06-09T04:36:57.501282+0000","last_fullsized":"2023-06-09T04:36:57.501282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:55.270027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517342+0000","last_change":"2023-06-09T04:36:52.692799+0000","last_active":"2023-06-09T04:36:57.517342+0000","last_peered":"2023-06-09T04:36:57.517342+0000","last_clean":"2023-06-09T04:36:57.517342+0000","last_became_active":"2023-06-09T04:36:52.692553+0000","last_became_peered":"2023-06-09T04:36:52.692553+0000","last_unstale":"2023-06-09T04:36:57.517342+0000","last_undegraded":"2023-06-09T04:36:57.517342+0000","last_fullsized":"2023-06-09T04:36:57.517342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:52.314087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516677+0000","last_change":"2023-06-09T04:36:53.080161+0000","last_active":"2023-06-09T04:36:57.516677+0000","last_peered":"2023-06-09T04:36:57.516677+0000","last_clean":"2023-06-09T04:36:57.516677+0000","last_became_active":"2023-06-09T04:36:53.079901+0000","last_became_peered":"2023-06-09T04:36:53.079901+0000","last_unstale":"2023-06-09T04:36:57.516677+0000","last_undegraded":"2023-06-09T04:36:57.516677+0000","last_fullsized":"2023-06-09T04:36:57.516677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:39:27.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516214+0000","last_change":"2023-06-09T04:36:57.115160+0000","last_active":"2023-06-09T04:36:57.516214+0000","last_peered":"2023-06-09T04:36:57.516214+0000","last_clean":"2023-06-09T04:36:57.516214+0000","last_became_active":"2023-06-09T04:36:57.114742+0000","last_became_peered":"2023-06-09T04:36:57.114742+0000","last_unstale":"2023-06-09T04:36:57.516214+0000","last_undegraded":"2023-06-09T04:36:57.516214+0000","last_fullsized":"2023-06-09T04:36:57.516214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:56.080458+0000","last_clean_scrub_stamp":"2023-06-09T04:36:56.080458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:40:15.379010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"21'4","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.500994+0000","last_change":"2023-06-09T04:36:52.680891+0000","last_active":"2023-06-09T04:36:57.500994+0000","last_peered":"2023-06-09T04:36:57.500994+0000","last_clean":"2023-06-09T04:36:57.500994+0000","last_became_active":"2023-06-09T04:36:52.680385+0000","last_became_peered":"2023-06-09T04:36:52.680385+0000","last_unstale":"2023-06-09T04:36:57.500994+0000","last_undegraded":"2023-06-09T04:36:57.500994+0000","last_fullsized":"2023-06-09T04:36:57.500994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:51.655816+0000","last_clean_scrub_stamp":"2023-06-09T04:36:51.655816+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:32:44.403350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502005+0000","last_change":"2023-06-09T04:36:53.096473+0000","last_active":"2023-06-09T04:36:57.502005+0000","last_peered":"2023-06-09T04:36:57.502005+0000","last_clean":"2023-06-09T04:36:57.502005+0000","last_became_active":"2023-06-09T04:36:53.096189+0000","last_became_peered":"2023-06-09T04:36:53.096189+0000","last_unstale":"2023-06-09T04:36:57.502005+0000","last_undegraded":"2023-06-09T04:36:57.502005+0000","last_fullsized":"2023-06-09T04:36:57.502005+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:34:20.659382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.515964+0000","last_change":"2023-06-09T04:36:53.097902+0000","last_active":"2023-06-09T04:36:57.515964+0000","last_peered":"2023-06-09T04:36:57.515964+0000","last_clean":"2023-06-09T04:36:57.515964+0000","last_became_active":"2023-06-09T04:36:53.097382+0000","last_became_peered":"2023-06-09T04:36:53.097382+0000","last_unstale":"2023-06-09T04:36:57.515964+0000","last_undegraded":"2023-06-09T04:36:57.515964+0000","last_fullsized":"2023-06-09T04:36:57.515964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:43.428603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517665+0000","last_change":"2023-06-09T04:36:53.082845+0000","last_active":"2023-06-09T04:36:57.517665+0000","last_peered":"2023-06-09T04:36:57.517665+0000","last_clean":"2023-06-09T04:36:57.517665+0000","last_became_active":"2023-06-09T04:36:53.082622+0000","last_became_peered":"2023-06-09T04:36:53.082622+0000","last_unstale":"2023-06-09T04:36:57.517665+0000","last_undegraded":"2023-06-09T04:36:57.517665+0000","last_fullsized":"2023-06-09T04:36:57.517665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:11:34.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.502339+0000","last_change":"2023-06-09T04:36:53.094170+0000","last_active":"2023-06-09T04:36:57.502339+0000","last_peered":"2023-06-09T04:36:57.502339+0000","last_clean":"2023-06-09T04:36:57.502339+0000","last_became_active":"2023-06-09T04:36:53.093889+0000","last_became_peered":"2023-06-09T04:36:53.093889+0000","last_unstale":"2023-06-09T04:36:57.502339+0000","last_undegraded":"2023-06-09T04:36:57.502339+0000","last_fullsized":"2023-06-09T04:36:57.502339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:54:24.623854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.517280+0000","last_change":"2023-06-09T04:36:53.090661+0000","last_active":"2023-06-09T04:36:57.517280+0000","last_peered":"2023-06-09T04:36:57.517280+0000","last_clean":"2023-06-09T04:36:57.517280+0000","last_became_active":"2023-06-09T04:36:53.090014+0000","last_became_peered":"2023-06-09T04:36:53.090014+0000","last_unstale":"2023-06-09T04:36:57.517280+0000","last_undegraded":"2023-06-09T04:36:57.517280+0000","last_fullsized":"2023-06-09T04:36:57.517280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:08.675015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-09T04:36:57.516377+0000","last_change":"2023-06-09T04:36:53.087442+0000","last_active":"2023-06-09T04:36:57.516377+0000","last_peered":"2023-06-09T04:36:57.516377+0000","last_clean":"2023-06-09T04:36:57.516377+0000","last_became_active":"2023-06-09T04:36:53.086525+0000","last_became_peered":"2023-06-09T04:36:53.086525+0000","last_unstale":"2023-06-09T04:36:57.516377+0000","last_undegraded":"2023-06-09T04:36:57.516377+0000","last_fullsized":"2023-06-09T04:36:57.516377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:52.663285+0000","last_clean_scrub_stamp":"2023-06-09T04:36:52.663285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:30:03.858670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":110193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6179999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.532}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.515000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.556}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.548}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":115204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.133}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2960000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":111936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.223}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":705732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":112006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":701722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":111354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:37:22.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-09T04:37:22.608 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-09T04:37:22.608 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-09T04:37:22.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-09T04:37:22.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.758+0000 7fa3cd001700 1 Processor -- start 2023-06-09T04:37:22.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.759+0000 7fa3cd001700 1 -- start start 2023-06-09T04:37:22.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.759+0000 7fa3cd001700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 0x7fa3c80ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.759+0000 7fa3cd001700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c80b0fc0 con 0x7fa3c80b1ac0 2023-06-09T04:37:22.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.759+0000 7fa3cd001700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c815a480 con 0x7fa3c80ae6d0 2023-06-09T04:37:22.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.759+0000 7fa3cd001700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80b0720 con 0x7fa3c80d04f0 2023-06-09T04:37:22.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.759+0000 7fa3c659c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa3c80b1ac0 0x7fa3c80d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60636/0 (socket says 172.21.15.149:60636) 2023-06-09T04:37:22.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.759+0000 7fa3c659c700 1 -- 172.21.15.149:0/223170296 learned_addr learned my addr 172.21.15.149:0/223170296 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:22.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c6d9d700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 0x7fa3c80ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521918289 0 0) 0x7fa3c80b0fc0 con 0x7fa3c80b1ac0 2023-06-09T04:37:22.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b00035b0 con 0x7fa3c80b1ac0 2023-06-09T04:37:22.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3392067425 0 0) 0x7fa3b00035b0 con 0x7fa3c80b1ac0 2023-06-09T04:37:22.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 msgr2=0x7fa3c80ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:22.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 0x7fa3c80ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 >> v1:172.21.15.184:6789/0 conn(0x7fa3c80ae6d0 legacy=0x7fa3c8163bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c80b0a00 con 0x7fa3c80b1ac0 2023-06-09T04:37:22.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7fa3b8001670 con 0x7fa3c80b1ac0 2023-06-09T04:37:22.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 >> v1:172.21.15.149:6789/0 conn(0x7fa3c80b1ac0 legacy=0x7fa3c80d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0003a30 0x7fa3b0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0004850 0x7fa3b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 0x7fa3b0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80b0720 con 0x7fa3b0004850 2023-06-09T04:37:22.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b000bb10 con 0x7fa3b0003a30 2023-06-09T04:37:22.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b000bcd0 con 0x7fa3c80d04f0 2023-06-09T04:37:22.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c659c700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0004850 0x7fa3b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c6d9d700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0003a30 0x7fa3b0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c759e700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 0x7fa3b0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c659c700 1 -- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 msgr2=0x7fa3b0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c659c700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c80d04f0 0x7fa3b0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c659c700 1 -- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0003a30 msgr2=0x7fa3b0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c659c700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0003a30 0x7fa3b0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.760+0000 7fa3c659c700 1 -- 172.21.15.149:0/223170296 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00035b0 con 0x7fa3b0004850 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3c659c700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0004850 0x7fa3b0004cc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c240 tx=0x7fa3b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf29e265d0f90879 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8007c10 con 0x7fa3b0004850 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800cde0 con 0x7fa3b0004850 2023-06-09T04:37:22.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3c5d9b700 1 -- 172.21.15.149:0/223170296 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8005ba0 con 0x7fa3b0004850 2023-06-09T04:37:22.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3cd001700 1 -- 172.21.15.149:0/223170296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0004850 msgr2=0x7fa3b0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3cd001700 1 --2- 172.21.15.149:0/223170296 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3b0004850 0x7fa3b0004cc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800c240 tx=0x7fa3b0005880 comp rx=0 tx=0).stop 2023-06-09T04:37:22.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3c759e700 1 -- 172.21.15.149:0/223170296 reap_dead start 2023-06-09T04:37:22.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3cd001700 1 -- 172.21.15.149:0/223170296 shutdown_connections 2023-06-09T04:37:22.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3cd001700 1 -- 172.21.15.149:0/223170296 >> 172.21.15.149:0/223170296 conn(0x7fa3c806a6d0 msgr2=0x7fa3c80999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:22.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3cd001700 1 -- 172.21.15.149:0/223170296 shutdown_connections 2023-06-09T04:37:22.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.761+0000 7fa3cd001700 1 -- 172.21.15.149:0/223170296 wait complete. 2023-06-09T04:37:22.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.763+0000 7fa3cd001700 1 Processor -- start 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.763+0000 7fa3cd001700 1 -- start start 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3cd001700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0004850 0x7fa3c80c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3cd001700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c81f2ec0 0x7fa3c8155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3cd001700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3c81e3280 0x7fa3c81e0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3cd001700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c80b51a0 con 0x7fa3c81e3280 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3cd001700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c81e3b80 con 0x7fa3b0004850 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3cd001700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c81e3e60 con 0x7fa3c81f2ec0 2023-06-09T04:37:22.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3c81e3280 0x7fa3c81e0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c759e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3c81e3280 0x7fa3c81e0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36788/0 (socket says 172.21.15.149:36788) 2023-06-09T04:37:22.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c759e700 1 -- 172.21.15.149:0/2162175891 learned_addr learned my addr 172.21.15.149:0/2162175891 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:22.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c659c700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c81f2ec0 0x7fa3c8155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c6d9d700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0004850 0x7fa3c80c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c759e700 1 -- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c81f2ec0 msgr2=0x7fa3c8155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c759e700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c81f2ec0 0x7fa3c8155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c759e700 1 -- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0004850 msgr2=0x7fa3c80c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.764+0000 7fa3c759e700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0004850 0x7fa3c80c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.765+0000 7fa3c759e700 1 -- 172.21.15.149:0/2162175891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c81e4140 con 0x7fa3c81e3280 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.765+0000 7fa3c759e700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3c81e3280 0x7fa3c81e0860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b3230 tx=0x7fa3c000d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.765+0000 7fa3af7fe700 1 -- 172.21.15.149:0/2162175891 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0003c10 con 0x7fa3c81e3280 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.765+0000 7fa3af7fe700 1 -- 172.21.15.149:0/2162175891 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0003d90 con 0x7fa3c81e3280 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.765+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c81e4420 con 0x7fa3c81e3280 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.765+0000 7fa3af7fe700 1 -- 172.21.15.149:0/2162175891 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000d950 con 0x7fa3c81e3280 2023-06-09T04:37:22.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.765+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c81e38e0 con 0x7fa3c81e3280 2023-06-09T04:37:22.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.766+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c80b4f70 con 0x7fa3c81e3280 2023-06-09T04:37:22.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.766+0000 7fa3af7fe700 1 -- 172.21.15.149:0/2162175891 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3c000dab0 con 0x7fa3c81e3280 2023-06-09T04:37:22.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.766+0000 7fa3af7fe700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa3b406ace0 0x7fa3b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:22.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.767+0000 7fa3af7fe700 1 -- 172.21.15.149:0/2162175891 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa3c00898e0 con 0x7fa3c81e3280 2023-06-09T04:37:22.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.767+0000 7fa3c6d9d700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa3b406ace0 0x7fa3b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:22.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.767+0000 7fa3c6d9d700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa3b406ace0 0x7fa3b406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3c815a170 tx=0x7fa3bc0091c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:22.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:22.771+0000 7fa3af7fe700 1 -- 172.21.15.149:0/2162175891 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa3c80b4f70 con 0x7fa3c81e3280 2023-06-09T04:37:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.002+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa3c80b4f70 con 0x7fa3c81e3280 2023-06-09T04:37:23.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.002+0000 7fa3af7fe700 1 -- 172.21.15.149:0/2162175891 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa3c80b4f70 con 0x7fa3c81e3280 2023-06-09T04:37:23.004 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:23.004 INFO:teuthology.orchestra.run.smithi149.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-09T04:37:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa3b406ace0 msgr2=0x7fa3b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa3b406ace0 0x7fa3b406d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa3c815a170 tx=0x7fa3bc0091c0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3c81e3280 msgr2=0x7fa3c81e0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3c81e3280 0x7fa3c81e0860 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b3230 tx=0x7fa3c000d150 comp rx=0 tx=0).stop 2023-06-09T04:37:23.006 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 shutdown_connections 2023-06-09T04:37:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa3b406ace0 0x7fa3b406d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3c81e3280 0x7fa3c81e0860 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3b0004850 0x7fa3c80c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 --2- 172.21.15.149:0/2162175891 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa3c81f2ec0 0x7fa3c8155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.004+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 >> 172.21.15.149:0/2162175891 conn(0x7fa3c806a6d0 msgr2=0x7fa3c806f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.005+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 shutdown_connections 2023-06-09T04:37:23.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.005+0000 7fa3cd001700 1 -- 172.21.15.149:0/2162175891 wait complete. 2023-06-09T04:37:23.018 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-09T04:37:23.018 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:23.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.137+0000 7f289b101700 1 Processor -- start 2023-06-09T04:37:23.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.137+0000 7f289b101700 1 -- start start 2023-06-09T04:37:23.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f289b101700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f289415c590 0x7f28940af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f289b101700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28940ccba0 0x7f28940b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f289b101700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2894069db0 0x7f289406a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f289b101700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28940afae0 con 0x7f289415c590 2023-06-09T04:37:23.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f289b101700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28940ccff0 con 0x7f2894069db0 2023-06-09T04:37:23.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f289b101700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289406a770 con 0x7f28940ccba0 2023-06-09T04:37:23.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f289415c590 0x7f28940af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f289415c590 0x7f28940af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36792/0 (socket says 172.21.15.149:36792) 2023-06-09T04:37:23.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 -- 172.21.15.149:0/46594588 learned_addr learned my addr 172.21.15.149:0/46594588 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:23.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2893fff700 1 --2- 172.21.15.149:0/46594588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28940ccba0 0x7f28940b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f289969e700 1 --2- 172.21.15.149:0/46594588 >> v2:172.21.15.184:3300/0 conn(0x7f2894069db0 0x7f289406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 -- 172.21.15.149:0/46594588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28940ccba0 msgr2=0x7f28940b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 --2- 172.21.15.149:0/46594588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28940ccba0 0x7f28940b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.142 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 -- 172.21.15.149:0/46594588 >> v2:172.21.15.184:3300/0 conn(0x7f2894069db0 msgr2=0x7f289406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 --2- 172.21.15.149:0/46594588 >> v2:172.21.15.184:3300/0 conn(0x7f2894069db0 0x7f289406a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 -- 172.21.15.149:0/46594588 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28940af050 con 0x7f289415c590 2023-06-09T04:37:23.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f2898e9d700 1 --2- 172.21.15.149:0/46594588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f289415c590 0x7f28940af220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28940711f0 tx=0x7f2888009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3302ef683f5c6555 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.138+0000 7f28937fe700 1 -- 172.21.15.149:0/46594588 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888005e30 con 0x7f289415c590 2023-06-09T04:37:23.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f28937fe700 1 -- 172.21.15.149:0/46594588 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888004030 con 0x7f289415c590 2023-06-09T04:37:23.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f28937fe700 1 -- 172.21.15.149:0/46594588 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28880043e0 con 0x7f289415c590 2023-06-09T04:37:23.143 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 -- 172.21.15.149:0/46594588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f289415c590 msgr2=0x7f28940af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 --2- 172.21.15.149:0/46594588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f289415c590 0x7f28940af220 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f28940711f0 tx=0x7f2888009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 -- 172.21.15.149:0/46594588 shutdown_connections 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 --2- 172.21.15.149:0/46594588 >> v2:172.21.15.184:3300/0 conn(0x7f2894069db0 0x7f289406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 --2- 172.21.15.149:0/46594588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f289415c590 0x7f28940af220 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 --2- 172.21.15.149:0/46594588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f28940ccba0 0x7f28940b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 -- 172.21.15.149:0/46594588 >> 172.21.15.149:0/46594588 conn(0x7f289406b7e0 msgr2=0x7f28940cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 -- 172.21.15.149:0/46594588 shutdown_connections 2023-06-09T04:37:23.144 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.139+0000 7f289b101700 1 -- 172.21.15.149:0/46594588 wait complete. 2023-06-09T04:37:23.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.140+0000 7f289b101700 1 Processor -- start 2023-06-09T04:37:23.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.140+0000 7f289b101700 1 -- start start 2023-06-09T04:37:23.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f289b101700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2894069db0 0x7f28940b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f289b101700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28940ccba0 0x7f28940c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f289b101700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f289415c590 0x7f2894155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f289b101700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28940c6cb0 con 0x7f2894069db0 2023-06-09T04:37:23.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f289b101700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2894156270 con 0x7f28940ccba0 2023-06-09T04:37:23.147 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f289b101700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28940c7760 con 0x7f289415c590 2023-06-09T04:37:23.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f2898e9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2894069db0 0x7f28940b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f2898e9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2894069db0 0x7f28940b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36796/0 (socket says 172.21.15.149:36796) 2023-06-09T04:37:23.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f2898e9d700 1 -- 172.21.15.149:0/3984474750 learned_addr learned my addr 172.21.15.149:0/3984474750 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:23.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f289969e700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f289415c590 0x7f2894155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.141+0000 7f2893fff700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28940ccba0 0x7f28940c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f2898e9d700 1 -- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f289415c590 msgr2=0x7f2894155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.148 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f2898e9d700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f289415c590 0x7f2894155d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f2898e9d700 1 -- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28940ccba0 msgr2=0x7f28940c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f2898e9d700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28940ccba0 0x7f28940c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f2898e9d700 1 -- 172.21.15.149:0/3984474750 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888009500 con 0x7f2894069db0 2023-06-09T04:37:23.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f2893fff700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28940ccba0 0x7f28940c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:23.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f2898e9d700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2894069db0 0x7f28940b4130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2888009130 tx=0x7f2888004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f28917fa700 1 -- 172.21.15.149:0/3984474750 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888003dd0 con 0x7f2894069db0 2023-06-09T04:37:23.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f28917fa700 1 -- 172.21.15.149:0/3984474750 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888011420 con 0x7f2894069db0 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f28917fa700 1 -- 172.21.15.149:0/3984474750 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28880117d0 con 0x7f2894069db0 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28940c6ec0 con 0x7f2894069db0 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.142+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28940c7480 con 0x7f2894069db0 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.143+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2894073fa0 con 0x7f2894069db0 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.143+0000 7f28917fa700 1 -- 172.21.15.149:0/3984474750 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2888011930 con 0x7f2894069db0 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.144+0000 7f28917fa700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f287806ace0 0x7f287806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.144+0000 7f28917fa700 1 -- 172.21.15.149:0/3984474750 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f288808a9d0 con 0x7f2894069db0 2023-06-09T04:37:23.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.144+0000 7f2893fff700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f287806ace0 0x7f287806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.144+0000 7f2893fff700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f287806ace0 0x7f287806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28940cdc10 tx=0x7f2880008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.148+0000 7f28917fa700 1 -- 172.21.15.149:0/3984474750 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2888055820 con 0x7f2894069db0 2023-06-09T04:37:23.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.334+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2894071dc0 con 0x7f2894069db0 2023-06-09T04:37:23.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.336+0000 7f28917fa700 1 -- 172.21.15.149:0/3984474750 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f2888058e40 con 0x7f2894069db0 2023-06-09T04:37:23.338 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:23.338 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:23.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f287806ace0 msgr2=0x7f287806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f287806ace0 0x7f287806d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f28940cdc10 tx=0x7f2880008040 comp rx=0 tx=0).stop 2023-06-09T04:37:23.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2894069db0 msgr2=0x7f28940b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2894069db0 0x7f28940b4130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2888009130 tx=0x7f2888004750 comp rx=0 tx=0).stop 2023-06-09T04:37:23.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 shutdown_connections 2023-06-09T04:37:23.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f287806ace0 0x7f287806d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.340 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f289415c590 0x7f2894155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2894069db0 0x7f28940b4130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 --2- 172.21.15.149:0/3984474750 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28940ccba0 0x7f28940c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 >> 172.21.15.149:0/3984474750 conn(0x7f289406b7e0 msgr2=0x7f289415bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:23.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 shutdown_connections 2023-06-09T04:37:23.341 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.338+0000 7f289b101700 1 -- 172.21.15.149:0/3984474750 wait complete. 2023-06-09T04:37:23.353 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:23.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:23.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.476+0000 7f4b9691e700 1 Processor -- start 2023-06-09T04:37:23.477 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.476+0000 7f4b9691e700 1 -- start start 2023-06-09T04:37:23.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b9691e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 0x7f4b900cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b9691e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4b9015e340 0x7f4b900cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b9691e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900cda20 con 0x7f4b900b60a0 2023-06-09T04:37:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b9691e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b900b6470 con 0x7f4b9015e340 2023-06-09T04:37:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b9691e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015e7c0 con 0x7f4b900cf5b0 2023-06-09T04:37:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8ffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4b900b60a0 0x7f4b9015dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60668/0 (socket says 172.21.15.149:60668) 2023-06-09T04:37:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8ffff700 1 -- 172.21.15.149:0/2975784676 learned_addr learned my addr 172.21.15.149:0/2975784676 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 0x7f4b900cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b94ebb700 1 --2- 172.21.15.149:0/2975784676 >> v2:172.21.15.184:3300/0 conn(0x7f4b9015e340 0x7f4b900cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657053020 0 0) 0x7f4b900cda20 con 0x7f4b900b60a0 2023-06-09T04:37:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b780035b0 con 0x7f4b900b60a0 2023-06-09T04:37:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531563926 0 0) 0x7f4b780035b0 con 0x7f4b900b60a0 2023-06-09T04:37:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 msgr2=0x7f4b900cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 0x7f4b900cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 >> v2:172.21.15.184:3300/0 conn(0x7f4b9015e340 msgr2=0x7f4b900cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 --2- 172.21.15.149:0/2975784676 >> v2:172.21.15.184:3300/0 conn(0x7f4b9015e340 0x7f4b900cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9015a520 con 0x7f4b900b60a0 2023-06-09T04:37:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f4b84001670 con 0x7f4b900b60a0 2023-06-09T04:37:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.477+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 >> v1:172.21.15.149:6789/0 conn(0x7f4b900b60a0 legacy=0x7f4b9015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 0x7f4b78003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b78003f80 0x7f4b78004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b78004d90 0x7f4b78005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b6470 con 0x7f4b78003f80 2023-06-09T04:37:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9015e7c0 con 0x7f4b78004d90 2023-06-09T04:37:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7800ba40 con 0x7f4b900cf5b0 2023-06-09T04:37:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b78003f80 0x7f4b78004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8ffff700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 0x7f4b78003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b94ebb700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b78004d90 0x7f4b78005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8f7fe700 1 -- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 msgr2=0x7f4b78003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b900cf5b0 0x7f4b78003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8f7fe700 1 -- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b78004d90 msgr2=0x7f4b78005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b78004d90 0x7f4b78005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8f7fe700 1 -- 172.21.15.149:0/2975784676 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780035b0 con 0x7f4b78003f80 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b94ebb700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b78004d90 0x7f4b78005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b78003f80 0x7f4b78004850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009b60 tx=0x7f4b78005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23051901bb6f72e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000e660 con 0x7f4b78003f80 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000e7c0 con 0x7f4b78003f80 2023-06-09T04:37:23.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.478+0000 7f4b8effd700 1 -- 172.21.15.149:0/2975784676 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000eb30 con 0x7f4b78003f80 2023-06-09T04:37:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.479+0000 7f4b9691e700 1 -- 172.21.15.149:0/2975784676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b78003f80 msgr2=0x7f4b78004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.479+0000 7f4b9691e700 1 --2- 172.21.15.149:0/2975784676 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b78003f80 0x7f4b78004850 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009b60 tx=0x7f4b78005880 comp rx=0 tx=0).stop 2023-06-09T04:37:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.479+0000 7f4b94ebb700 1 -- 172.21.15.149:0/2975784676 reap_dead start 2023-06-09T04:37:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.479+0000 7f4b9691e700 1 -- 172.21.15.149:0/2975784676 shutdown_connections 2023-06-09T04:37:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.479+0000 7f4b9691e700 1 -- 172.21.15.149:0/2975784676 >> 172.21.15.149:0/2975784676 conn(0x7f4b90069db0 msgr2=0x7f4b9006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.479+0000 7f4b9691e700 1 -- 172.21.15.149:0/2975784676 shutdown_connections 2023-06-09T04:37:23.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.479+0000 7f4b9691e700 1 -- 172.21.15.149:0/2975784676 wait complete. 2023-06-09T04:37:23.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.480+0000 7f4b9691e700 1 Processor -- start 2023-06-09T04:37:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.480+0000 7f4b9691e700 1 -- start start 2023-06-09T04:37:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b9691e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b78003f80 0x7f4b9015a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b9691e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b90151d00 0x7f4b90147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b9691e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b90155000 0x7f4b900b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b9691e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90154b70 con 0x7f4b90151d00 2023-06-09T04:37:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b9691e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90147f60 con 0x7f4b90155000 2023-06-09T04:37:23.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b9691e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90153f60 con 0x7f4b78003f80 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b90151d00 0x7f4b90147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b90151d00 0x7f4b90147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36816/0 (socket says 172.21.15.149:36816) 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 -- 172.21.15.149:0/2917121675 learned_addr learned my addr 172.21.15.149:0/2917121675 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b94ebb700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b90155000 0x7f4b900b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8ffff700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b78003f80 0x7f4b9015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 -- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b78003f80 msgr2=0x7f4b9015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b78003f80 0x7f4b9015a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 -- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b90155000 msgr2=0x7f4b900b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b90155000 0x7f4b900b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 -- 172.21.15.149:0/2917121675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90154240 con 0x7f4b90151d00 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8f7fe700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b90151d00 0x7f4b90147a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b80000c00 tx=0x7f4b800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.481+0000 7f4b8cff9700 1 -- 172.21.15.149:0/2917121675 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80021070 con 0x7f4b90151d00 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.482+0000 7f4b8cff9700 1 -- 172.21.15.149:0/2917121675 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80004430 con 0x7f4b90151d00 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.482+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b90154520 con 0x7f4b90151d00 2023-06-09T04:37:23.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.482+0000 7f4b8cff9700 1 -- 172.21.15.149:0/2917121675 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000e660 con 0x7f4b90151d00 2023-06-09T04:37:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.482+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b90153b80 con 0x7f4b90151d00 2023-06-09T04:37:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.482+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b90153d10 con 0x7f4b90151d00 2023-06-09T04:37:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.483+0000 7f4b8cff9700 1 -- 172.21.15.149:0/2917121675 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b80025070 con 0x7f4b90151d00 2023-06-09T04:37:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.483+0000 7f4b8cff9700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b7c06ace0 0x7f4b7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.483+0000 7f4b8ffff700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b7c06ace0 0x7f4b7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.483+0000 7f4b8cff9700 1 -- 172.21.15.149:0/2917121675 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b8008a6a0 con 0x7f4b90151d00 2023-06-09T04:37:23.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.484+0000 7f4b8ffff700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b7c06ace0 0x7f4b7c06d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b84000c00 tx=0x7f4b84007980 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.488+0000 7f4b8cff9700 1 -- 172.21.15.149:0/2917121675 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b800554f0 con 0x7f4b90151d00 2023-06-09T04:37:23.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.676+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b90073fa0 con 0x7f4b90151d00 2023-06-09T04:37:23.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.677+0000 7f4b8cff9700 1 -- 172.21.15.149:0/2917121675 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b80058b10 con 0x7f4b90151d00 2023-06-09T04:37:23.678 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:23.680 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b7c06ace0 msgr2=0x7f4b7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b7c06ace0 0x7f4b7c06d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b84000c00 tx=0x7f4b84007980 comp rx=0 tx=0).stop 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b90151d00 msgr2=0x7f4b90147a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b90151d00 0x7f4b90147a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4b80000c00 tx=0x7f4b800047c0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 shutdown_connections 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b7c06ace0 0x7f4b7c06d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b78003f80 0x7f4b9015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b90155000 0x7f4b900b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 --2- 172.21.15.149:0/2917121675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b90151d00 0x7f4b90147a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 >> 172.21.15.149:0/2917121675 conn(0x7f4b90069db0 msgr2=0x7f4b900cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:23.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 shutdown_connections 2023-06-09T04:37:23.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.679+0000 7f4b9691e700 1 -- 172.21.15.149:0/2917121675 wait complete. 2023-06-09T04:37:23.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:23.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.815+0000 7feb6a8ae700 1 Processor -- start 2023-06-09T04:37:23.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.815+0000 7feb6a8ae700 1 -- start start 2023-06-09T04:37:23.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb6a8ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 0x7feb640716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb6a8ae700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6406f480 con 0x7feb64159380 2023-06-09T04:37:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb6a8ae700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6406f760 con 0x7feb640b1dc0 2023-06-09T04:37:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb6a8ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb640b10d0 con 0x7feb640cd930 2023-06-09T04:37:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb63fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7feb64159380 0x7feb640cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60688/0 (socket says 172.21.15.149:60688) 2023-06-09T04:37:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb63fff700 1 -- 172.21.15.149:0/1813671098 learned_addr learned my addr 172.21.15.149:0/1813671098 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb637fe700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 0x7feb640716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380743558 0 0) 0x7feb6406f480 con 0x7feb64159380 2023-06-09T04:37:23.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb4c0035b0 con 0x7feb64159380 2023-06-09T04:37:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728368618 0 0) 0x7feb6406f760 con 0x7feb640b1dc0 2023-06-09T04:37:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb6406f480 con 0x7feb640b1dc0 2023-06-09T04:37:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1486506109 0 0) 0x7feb4c0035b0 con 0x7feb64159380 2023-06-09T04:37:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 msgr2=0x7feb640716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 0x7feb640716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 >> v1:172.21.15.184:6789/0 conn(0x7feb640b1dc0 legacy=0x7feb640ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb640b12e0 con 0x7feb64159380 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7feb58001670 con 0x7feb64159380 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.816+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 >> v1:172.21.15.149:6789/0 conn(0x7feb64159380 legacy=0x7feb640cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 0x7feb4c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c004170 0x7feb4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004d90 0x7feb4c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb640b10d0 con 0x7feb4c004170 2023-06-09T04:37:23.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c00bba0 con 0x7feb4c004d90 2023-06-09T04:37:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c00bd60 con 0x7feb640cd930 2023-06-09T04:37:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb637fe700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c004170 0x7feb4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb63fff700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 0x7feb4c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb68e4b700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004d90 0x7feb4c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb637fe700 1 -- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 msgr2=0x7feb4c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb637fe700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb640cd930 0x7feb4c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb637fe700 1 -- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004d90 msgr2=0x7feb4c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb637fe700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004d90 0x7feb4c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb637fe700 1 -- 172.21.15.149:0/1813671098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0035b0 con 0x7feb4c004170 2023-06-09T04:37:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb68e4b700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004d90 0x7feb4c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb637fe700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c004170 0x7feb4c004850 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb54009b30 tx=0x7feb4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eef8702c3555a51 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400e6c0 con 0x7feb4c004170 2023-06-09T04:37:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400e820 con 0x7feb4c004170 2023-06-09T04:37:23.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.817+0000 7feb62ffd700 1 -- 172.21.15.149:0/1813671098 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400eb90 con 0x7feb4c004170 2023-06-09T04:37:23.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.818+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1813671098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c004170 msgr2=0x7feb4c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.818+0000 7feb6a8ae700 1 --2- 172.21.15.149:0/1813671098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb4c004170 0x7feb4c004850 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feb54009b30 tx=0x7feb4c005880 comp rx=0 tx=0).stop 2023-06-09T04:37:23.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.818+0000 7feb68e4b700 1 -- 172.21.15.149:0/1813671098 reap_dead start 2023-06-09T04:37:23.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.818+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1813671098 shutdown_connections 2023-06-09T04:37:23.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.818+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1813671098 >> 172.21.15.149:0/1813671098 conn(0x7feb6406aec0 msgr2=0x7feb6406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:23.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.818+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1813671098 shutdown_connections 2023-06-09T04:37:23.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.818+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1813671098 wait complete. 2023-06-09T04:37:23.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.819+0000 7feb6a8ae700 1 Processor -- start 2023-06-09T04:37:23.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.819+0000 7feb6a8ae700 1 -- start start 2023-06-09T04:37:23.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb6a8ae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004170 0x7feb640c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb6a8ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb641f5f60 0x7feb64155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb6a8ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb640c83b0 0x7feb640c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb6a8ae700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb640c8060 con 0x7feb640c83b0 2023-06-09T04:37:23.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb6a8ae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb641f2eb0 con 0x7feb4c004170 2023-06-09T04:37:23.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb6a8ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb641f2330 con 0x7feb641f5f60 2023-06-09T04:37:23.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb640c83b0 0x7feb640c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb63fff700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004170 0x7feb640c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb637fe700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb641f5f60 0x7feb64155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb640c83b0 0x7feb640c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36840/0 (socket says 172.21.15.149:36840) 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 -- 172.21.15.149:0/1774847459 learned_addr learned my addr 172.21.15.149:0/1774847459 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 -- 172.21.15.149:0/1774847459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb641f5f60 msgr2=0x7feb64155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb641f5f60 0x7feb64155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 -- 172.21.15.149:0/1774847459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004170 msgr2=0x7feb640c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:23.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004170 0x7feb640c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.820+0000 7feb68e4b700 1 -- 172.21.15.149:0/1774847459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb641f2610 con 0x7feb640c83b0 2023-06-09T04:37:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.821+0000 7feb68e4b700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb640c83b0 0x7feb640c8820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feb64070fa0 tx=0x7feb5c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.821+0000 7feb60ff9700 1 -- 172.21.15.149:0/1774847459 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c003c10 con 0x7feb640c83b0 2023-06-09T04:37:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.821+0000 7feb60ff9700 1 -- 172.21.15.149:0/1774847459 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c003d70 con 0x7feb640c83b0 2023-06-09T04:37:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.821+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb641f28f0 con 0x7feb640c83b0 2023-06-09T04:37:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.821+0000 7feb60ff9700 1 -- 172.21.15.149:0/1774847459 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c005310 con 0x7feb640c83b0 2023-06-09T04:37:23.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.821+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb640c5ee0 con 0x7feb640c83b0 2023-06-09T04:37:23.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.822+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb64159aa0 con 0x7feb640c83b0 2023-06-09T04:37:23.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.822+0000 7feb60ff9700 1 -- 172.21.15.149:0/1774847459 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb5c005470 con 0x7feb640c83b0 2023-06-09T04:37:23.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.823+0000 7feb60ff9700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feb5006ace0 0x7feb5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:23.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.823+0000 7feb63fff700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feb5006ace0 0x7feb5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:23.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.823+0000 7feb60ff9700 1 -- 172.21.15.149:0/1774847459 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb5c0897c0 con 0x7feb640c83b0 2023-06-09T04:37:23.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.823+0000 7feb63fff700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feb5006ace0 0x7feb5006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb58001eb0 tx=0x7feb58000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:23.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:23.827+0000 7feb60ff9700 1 -- 172.21.15.149:0/1774847459 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb64159aa0 con 0x7feb640c83b0 2023-06-09T04:37:24.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.011+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb64159aa0 con 0x7feb640c83b0 2023-06-09T04:37:24.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.011+0000 7feb60ff9700 1 -- 172.21.15.149:0/1774847459 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb64159aa0 con 0x7feb640c83b0 2023-06-09T04:37:24.013 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:24.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feb5006ace0 msgr2=0x7feb5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feb5006ace0 0x7feb5006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7feb58001eb0 tx=0x7feb58000f80 comp rx=0 tx=0).stop 2023-06-09T04:37:24.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb640c83b0 msgr2=0x7feb640c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb640c83b0 0x7feb640c8820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feb64070fa0 tx=0x7feb5c00ef20 comp rx=0 tx=0).stop 2023-06-09T04:37:24.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 shutdown_connections 2023-06-09T04:37:24.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feb5006ace0 0x7feb5006d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feb640c83b0 0x7feb640c8820 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb4c004170 0x7feb640c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 --2- 172.21.15.149:0/1774847459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feb641f5f60 0x7feb64155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.013+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 >> 172.21.15.149:0/1774847459 conn(0x7feb6406aec0 msgr2=0x7feb6414a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:24.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.014+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 shutdown_connections 2023-06-09T04:37:24.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.014+0000 7feb6a8ae700 1 -- 172.21.15.149:0/1774847459 wait complete. 2023-06-09T04:37:24.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:24.149 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.148+0000 7f1693d4d700 1 Processor -- start 2023-06-09T04:37:24.150 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f1693d4d700 1 -- start start 2023-06-09T04:37:24.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f1693d4d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c071560 0x7f168c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.151 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f1693d4d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f168c06a2f0 0x7f168c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f1693d4d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c15c8f0 con 0x7f168c15c520 2023-06-09T04:37:24.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f1693d4d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c0cd940 con 0x7f168c06a2f0 2023-06-09T04:37:24.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f1693d4d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c06a770 con 0x7f168c071560 2023-06-09T04:37:24.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f16922ea700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f168c06a2f0 0x7f168c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.149+0000 7f16922ea700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f168c06a2f0 0x7f168c0b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36848/0 (socket says 172.21.15.149:36848) 2023-06-09T04:37:24.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f16922ea700 1 -- 172.21.15.149:0/3646994100 learned_addr learned my addr 172.21.15.149:0/3646994100 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:24.152 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f16912e8700 1 --2- 172.21.15.149:0/3646994100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c071560 0x7f168c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f16922ea700 1 -- 172.21.15.149:0/3646994100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c071560 msgr2=0x7f168c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:24.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f16922ea700 1 --2- 172.21.15.149:0/3646994100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c071560 0x7f168c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f16922ea700 1 -- 172.21.15.149:0/3646994100 >> v1:172.21.15.184:6789/0 conn(0x7f168c15c520 legacy=0x7f168c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f16922ea700 1 -- 172.21.15.149:0/3646994100 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0719b0 con 0x7f168c06a2f0 2023-06-09T04:37:24.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f16922ea700 1 --2- 172.21.15.149:0/3646994100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c06a2f0 0x7f168c0b24a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1684009e50 tx=0x7f168400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8bb9e41686250f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f1690ae7700 1 -- 172.21.15.149:0/3646994100 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400e070 con 0x7f168c06a2f0 2023-06-09T04:37:24.153 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f1690ae7700 1 -- 172.21.15.149:0/3646994100 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400b9c0 con 0x7f168c06a2f0 2023-06-09T04:37:24.154 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.150+0000 7f1690ae7700 1 -- 172.21.15.149:0/3646994100 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400bd70 con 0x7f168c06a2f0 2023-06-09T04:37:24.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 -- 172.21.15.149:0/3646994100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c06a2f0 msgr2=0x7f168c0b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 --2- 172.21.15.149:0/3646994100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c06a2f0 0x7f168c0b24a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1684009e50 tx=0x7f168400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:24.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 -- 172.21.15.149:0/3646994100 shutdown_connections 2023-06-09T04:37:24.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 --2- 172.21.15.149:0/3646994100 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c06a2f0 0x7f168c0b24a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 --2- 172.21.15.149:0/3646994100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c071560 0x7f168c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 -- 172.21.15.149:0/3646994100 >> 172.21.15.149:0/3646994100 conn(0x7f168c06aec0 msgr2=0x7f168c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:24.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 -- 172.21.15.149:0/3646994100 shutdown_connections 2023-06-09T04:37:24.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.151+0000 7f1693d4d700 1 -- 172.21.15.149:0/3646994100 wait complete. 2023-06-09T04:37:24.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.152+0000 7f1693d4d700 1 Processor -- start 2023-06-09T04:37:24.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.152+0000 7f1693d4d700 1 -- start start 2023-06-09T04:37:24.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c06a2f0 0x7f168c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c071560 0x7f168c152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c15c520 0x7f168c0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0b29c0 con 0x7f168c15c520 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0b2c40 con 0x7f168c071560 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c0b2f20 con 0x7f168c06a2f0 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c15c520 0x7f168c0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c15c520 0x7f168c0b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36854/0 (socket says 172.21.15.149:36854) 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 -- 172.21.15.149:0/849138061 learned_addr learned my addr 172.21.15.149:0/849138061 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16912e8700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c071560 0x7f168c152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1691ae9700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c06a2f0 0x7f168c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 -- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c06a2f0 msgr2=0x7f168c0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c06a2f0 0x7f168c0b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 -- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c071560 msgr2=0x7f168c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c071560 0x7f168c152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 -- 172.21.15.149:0/849138061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1684009b30 con 0x7f168c15c520 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16922ea700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c15c520 0x7f168c0b2480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f168c0cd1d0 tx=0x7f1684004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16827fc700 1 -- 172.21.15.149:0/849138061 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684004800 con 0x7f168c15c520 2023-06-09T04:37:24.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16827fc700 1 -- 172.21.15.149:0/849138061 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684004960 con 0x7f168c15c520 2023-06-09T04:37:24.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c0b3200 con 0x7f168c15c520 2023-06-09T04:37:24.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f16827fc700 1 -- 172.21.15.149:0/849138061 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168401c680 con 0x7f168c15c520 2023-06-09T04:37:24.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.153+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c0b37c0 con 0x7f168c15c520 2023-06-09T04:37:24.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.154+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c073fa0 con 0x7f168c15c520 2023-06-09T04:37:24.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.155+0000 7f16827fc700 1 -- 172.21.15.149:0/849138061 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f168401c7e0 con 0x7f168c15c520 2023-06-09T04:37:24.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.155+0000 7f16827fc700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f167006ace0 0x7f167006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.155+0000 7f16827fc700 1 -- 172.21.15.149:0/849138061 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f168408b3c0 con 0x7f168c15c520 2023-06-09T04:37:24.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.155+0000 7f1691ae9700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f167006ace0 0x7f167006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.156+0000 7f1691ae9700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f167006ace0 0x7f167006d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f167c007fd0 tx=0x7f167c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.160+0000 7f16827fc700 1 -- 172.21.15.149:0/849138061 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1684056170 con 0x7f168c15c520 2023-06-09T04:37:24.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.346+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f168c1598d0 con 0x7f168c15c520 2023-06-09T04:37:24.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.347+0000 7f16827fc700 1 -- 172.21.15.149:0/849138061 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1684059790 con 0x7f168c15c520 2023-06-09T04:37:24.348 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:24.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f167006ace0 msgr2=0x7f167006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f167006ace0 0x7f167006d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f167c007fd0 tx=0x7f167c009040 comp rx=0 tx=0).stop 2023-06-09T04:37:24.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c15c520 msgr2=0x7f168c0b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.350 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c15c520 0x7f168c0b2480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f168c0cd1d0 tx=0x7f1684004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 shutdown_connections 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f167006ace0 0x7f167006d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f168c06a2f0 0x7f168c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f168c15c520 0x7f168c0b2480 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 --2- 172.21.15.149:0/849138061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f168c071560 0x7f168c152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 >> 172.21.15.149:0/849138061 conn(0x7f168c06aec0 msgr2=0x7f168c1534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 shutdown_connections 2023-06-09T04:37:24.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.349+0000 7f1693d4d700 1 -- 172.21.15.149:0/849138061 wait complete. 2023-06-09T04:37:24.362 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:24.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.484+0000 7f09b0308700 1 Processor -- start 2023-06-09T04:37:24.485 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.484+0000 7f09b0308700 1 -- start start 2023-06-09T04:37:24.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09b0308700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8159380 0x7f09a80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09b0308700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f09a80b1dc0 0x7f09a80cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09b0308700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f09a8071d50 0x7f09a80cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09b0308700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a80b10d0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09b0308700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a806f480 con 0x7f09a8071d50 2023-06-09T04:37:24.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09b0308700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a806f760 con 0x7f09a8159380 2023-06-09T04:37:24.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f09a80b1dc0 0x7f09a80cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f09a80b1dc0 0x7f09a80cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36858/0 (socket says 172.21.15.149:36858) 2023-06-09T04:37:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 -- 172.21.15.149:0/1952237095 learned_addr learned my addr 172.21.15.149:0/1952237095 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ae8a5700 1 --2- 172.21.15.149:0/1952237095 >> v2:172.21.15.184:3300/0 conn(0x7f09a8071d50 0x7f09a80cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ae0a4700 1 --2- 172.21.15.149:0/1952237095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8159380 0x7f09a80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 -- 172.21.15.149:0/1952237095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8159380 msgr2=0x7f09a80716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 --2- 172.21.15.149:0/1952237095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8159380 0x7f09a80716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 -- 172.21.15.149:0/1952237095 >> v2:172.21.15.184:3300/0 conn(0x7f09a8071d50 msgr2=0x7f09a80cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:24.488 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 --2- 172.21.15.149:0/1952237095 >> v2:172.21.15.184:3300/0 conn(0x7f09a8071d50 0x7f09a80cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 -- 172.21.15.149:0/1952237095 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80b12e0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ae8a5700 1 --2- 172.21.15.149:0/1952237095 >> v2:172.21.15.184:3300/0 conn(0x7f09a8071d50 0x7f09a80cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:24.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad8a3700 1 --2- 172.21.15.149:0/1952237095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a80cd220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09a80704f0 tx=0x7f09a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c458522df428c4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.485+0000 7f09ad0a2700 1 -- 172.21.15.149:0/1952237095 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a400b870 con 0x7f09a80b1dc0 2023-06-09T04:37:24.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09ad0a2700 1 -- 172.21.15.149:0/1952237095 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a400b9d0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09ad0a2700 1 -- 172.21.15.149:0/1952237095 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a400bd60 con 0x7f09a80b1dc0 2023-06-09T04:37:24.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 -- 172.21.15.149:0/1952237095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 msgr2=0x7f09a80cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 --2- 172.21.15.149:0/1952237095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a80cd220 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f09a80704f0 tx=0x7f09a4009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 -- 172.21.15.149:0/1952237095 shutdown_connections 2023-06-09T04:37:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 --2- 172.21.15.149:0/1952237095 >> v2:172.21.15.184:3300/0 conn(0x7f09a8071d50 0x7f09a80cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 --2- 172.21.15.149:0/1952237095 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8159380 0x7f09a80716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 --2- 172.21.15.149:0/1952237095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a80cd220 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 -- 172.21.15.149:0/1952237095 >> 172.21.15.149:0/1952237095 conn(0x7f09a806aec0 msgr2=0x7f09a806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 -- 172.21.15.149:0/1952237095 shutdown_connections 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.486+0000 7f09b0308700 1 -- 172.21.15.149:0/1952237095 wait complete. 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.487+0000 7f09b0308700 1 Processor -- start 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.487+0000 7f09b0308700 1 -- start start 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09b0308700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8071d50 0x7f09a8151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09b0308700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a81597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09b0308700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a8159380 0x7f09a8159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09b0308700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a815a350 con 0x7f09a80b1dc0 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09b0308700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a815a630 con 0x7f09a8159380 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09b0308700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a80ab990 con 0x7f09a8071d50 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ad8a3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a81597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ad8a3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a81597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36866/0 (socket says 172.21.15.149:36866) 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ad8a3700 1 -- 172.21.15.149:0/3559153599 learned_addr learned my addr 172.21.15.149:0/3559153599 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ae8a5700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a8159380 0x7f09a8159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ae0a4700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8071d50 0x7f09a8151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ad8a3700 1 -- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8071d50 msgr2=0x7f09a8151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ad8a3700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8071d50 0x7f09a8151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ad8a3700 1 -- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a8159380 msgr2=0x7f09a8159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.488+0000 7f09ad8a3700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a8159380 0x7f09a8159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.489+0000 7f09ad8a3700 1 -- 172.21.15.149:0/3559153599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a4009550 con 0x7f09a80b1dc0 2023-06-09T04:37:24.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.489+0000 7f09ad8a3700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a81597e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09a80b2240 tx=0x7f09a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.489+0000 7f099effd700 1 -- 172.21.15.149:0/3559153599 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4004310 con 0x7f09a80b1dc0 2023-06-09T04:37:24.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.489+0000 7f099effd700 1 -- 172.21.15.149:0/3559153599 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a401f070 con 0x7f09a80b1dc0 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.489+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a80abc70 con 0x7f09a80b1dc0 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.489+0000 7f099effd700 1 -- 172.21.15.149:0/3559153599 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a40036a0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.489+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a815a910 con 0x7f09a80b1dc0 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.490+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a80abeb0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.490+0000 7f099effd700 1 -- 172.21.15.149:0/3559153599 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09a4021030 con 0x7f09a80b1dc0 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.490+0000 7f099effd700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098c06ace0 0x7f098c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.491+0000 7f099effd700 1 -- 172.21.15.149:0/3559153599 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f09a408aa80 con 0x7f09a80b1dc0 2023-06-09T04:37:24.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.491+0000 7f09ae0a4700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098c06ace0 0x7f098c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.491+0000 7f09ae0a4700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098c06ace0 0x7f098c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0998006fd0 tx=0x7f0998008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.495+0000 7f099effd700 1 -- 172.21.15.149:0/3559153599 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f09a80abeb0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.685+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09a80abeb0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.686+0000 7f099effd700 1 -- 172.21.15.149:0/3559153599 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09a80abeb0 con 0x7f09a80b1dc0 2023-06-09T04:37:24.687 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:24.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098c06ace0 msgr2=0x7f098c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098c06ace0 0x7f098c06d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0998006fd0 tx=0x7f0998008040 comp rx=0 tx=0).stop 2023-06-09T04:37:24.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 msgr2=0x7f09a81597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a81597e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f09a80b2240 tx=0x7f09a4004750 comp rx=0 tx=0).stop 2023-06-09T04:37:24.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 shutdown_connections 2023-06-09T04:37:24.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f098c06ace0 0x7f098c06d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f09a8071d50 0x7f09a8151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09a8159380 0x7f09a8159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 --2- 172.21.15.149:0/3559153599 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f09a80b1dc0 0x7f09a81597e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 >> 172.21.15.149:0/3559153599 conn(0x7f09a806aec0 msgr2=0x7f09a80b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:24.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 shutdown_connections 2023-06-09T04:37:24.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.688+0000 7f09b0308700 1 -- 172.21.15.149:0/3559153599 wait complete. 2023-06-09T04:37:24.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:24.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.824+0000 7f88c6d12700 1 Processor -- start 2023-06-09T04:37:24.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.824+0000 7f88c6d12700 1 -- start start 2023-06-09T04:37:24.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.824+0000 7f88c6d12700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f88c015a400 0x7f88c006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.824+0000 7f88c6d12700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 0x7f88c00b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.824+0000 7f88c6d12700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c00720f0 con 0x7f88c0069db0 2023-06-09T04:37:24.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.824+0000 7f88c6d12700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c006a6c0 con 0x7f88c015a400 2023-06-09T04:37:24.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.824+0000 7f88c6d12700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00cb960 con 0x7f88c00ccc00 2023-06-09T04:37:24.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88c4aae700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f88c0069db0 0x7f88c00c9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60736/0 (socket says 172.21.15.149:60736) 2023-06-09T04:37:24.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88c4aae700 1 -- 172.21.15.149:0/2215216738 learned_addr learned my addr 172.21.15.149:0/2215216738 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:24.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bffff700 1 --2- 172.21.15.149:0/2215216738 >> v2:172.21.15.184:3300/0 conn(0x7f88c015a400 0x7f88c006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88c52af700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 0x7f88c00b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218193602 0 0) 0x7f88c00720f0 con 0x7f88c0069db0 2023-06-09T04:37:24.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b00035b0 con 0x7f88c0069db0 2023-06-09T04:37:24.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2980590718 0 0) 0x7f88b00035b0 con 0x7f88c0069db0 2023-06-09T04:37:24.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 msgr2=0x7f88c00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:24.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 0x7f88c00b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 >> v2:172.21.15.184:3300/0 conn(0x7f88c015a400 msgr2=0x7f88c006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 --2- 172.21.15.149:0/2215216738 >> v2:172.21.15.184:3300/0 conn(0x7f88c015a400 0x7f88c006a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00cbc40 con 0x7f88c0069db0 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f88b4001670 con 0x7f88c0069db0 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 >> v1:172.21.15.149:6789/0 conn(0x7f88c0069db0 legacy=0x7f88c00c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 0x7f88b0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b0003f80 0x7f88b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88b0004d90 0x7f88b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c006a6c0 con 0x7f88b0004d90 2023-06-09T04:37:24.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00cb960 con 0x7f88b0003f80 2023-06-09T04:37:24.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b000ba40 con 0x7f88c00ccc00 2023-06-09T04:37:24.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88c52af700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88b0004d90 0x7f88b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88bffff700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b0003f80 0x7f88b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.825+0000 7f88c4aae700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 0x7f88b0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c52af700 1 -- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 msgr2=0x7f88b0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c52af700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00ccc00 0x7f88b0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c52af700 1 -- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b0003f80 msgr2=0x7f88b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c52af700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88b0003f80 0x7f88b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c52af700 1 -- 172.21.15.149:0/2215216738 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00035b0 con 0x7f88b0004d90 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c52af700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88b0004d90 0x7f88b0005200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009fc0 tx=0x7f88b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5553e0d8964f2634 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b800ebd0 con 0x7f88b0004d90 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b800f040 con 0x7f88b0004d90 2023-06-09T04:37:24.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88bf7fe700 1 -- 172.21.15.149:0/2215216738 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8014480 con 0x7f88b0004d90 2023-06-09T04:37:24.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c6d12700 1 -- 172.21.15.149:0/2215216738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88b0004d90 msgr2=0x7f88b0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c6d12700 1 --2- 172.21.15.149:0/2215216738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88b0004d90 0x7f88b0005200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009fc0 tx=0x7f88b0005880 comp rx=0 tx=0).stop 2023-06-09T04:37:24.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c52af700 1 -- 172.21.15.149:0/2215216738 reap_dead start 2023-06-09T04:37:24.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c6d12700 1 -- 172.21.15.149:0/2215216738 shutdown_connections 2023-06-09T04:37:24.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c6d12700 1 -- 172.21.15.149:0/2215216738 >> 172.21.15.149:0/2215216738 conn(0x7f88c006aec0 msgr2=0x7f88c006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:24.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c6d12700 1 -- 172.21.15.149:0/2215216738 shutdown_connections 2023-06-09T04:37:24.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.826+0000 7f88c6d12700 1 -- 172.21.15.149:0/2215216738 wait complete. 2023-06-09T04:37:24.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.828+0000 7f88c6d12700 1 Processor -- start 2023-06-09T04:37:24.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.828+0000 7f88c6d12700 1 -- start start 2023-06-09T04:37:24.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c6d12700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00c54a0 0x7f88c015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c6d12700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88c015af90 0x7f88c00c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c6d12700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88c00c3420 0x7f88c0142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c6d12700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c015c090 con 0x7f88c00c3420 2023-06-09T04:37:24.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c6d12700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c00c3890 con 0x7f88c015af90 2023-06-09T04:37:24.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c6d12700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c015c9f0 con 0x7f88c00c54a0 2023-06-09T04:37:24.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c52af700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88c00c3420 0x7f88c0142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c52af700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88c00c3420 0x7f88c0142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36886/0 (socket says 172.21.15.149:36886) 2023-06-09T04:37:24.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c52af700 1 -- 172.21.15.149:0/3825751878 learned_addr learned my addr 172.21.15.149:0/3825751878 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:24.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88c4aae700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00c54a0 0x7f88c015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.829+0000 7f88bffff700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88c015af90 0x7f88c00c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c52af700 1 -- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00c54a0 msgr2=0x7f88c015c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c52af700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00c54a0 0x7f88c015c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c52af700 1 -- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88c015af90 msgr2=0x7f88c00c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c52af700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88c015af90 0x7f88c00c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c52af700 1 -- 172.21.15.149:0/3825751878 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c015b410 con 0x7f88c00c3420 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88bffff700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88c015af90 0x7f88c00c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c52af700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88c00c3420 0x7f88c0142b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88b0004770 tx=0x7f88b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88bd7fa700 1 -- 172.21.15.149:0/3825751878 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8007000 con 0x7f88c00c3420 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88bd7fa700 1 -- 172.21.15.149:0/3825751878 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8022070 con 0x7f88c00c3420 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88bd7fa700 1 -- 172.21.15.149:0/3825751878 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8029480 con 0x7f88c00c3420 2023-06-09T04:37:24.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c015b6f0 con 0x7f88c00c3420 2023-06-09T04:37:24.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.830+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c015bcb0 con 0x7f88c00c3420 2023-06-09T04:37:24.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.831+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c00cb610 con 0x7f88c00c3420 2023-06-09T04:37:24.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.831+0000 7f88bd7fa700 1 -- 172.21.15.149:0/3825751878 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88b80295e0 con 0x7f88c00c3420 2023-06-09T04:37:24.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.831+0000 7f88bd7fa700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f88a406ace0 0x7f88a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:24.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.832+0000 7f88bd7fa700 1 -- 172.21.15.149:0/3825751878 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88b8024070 con 0x7f88c00c3420 2023-06-09T04:37:24.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.832+0000 7f88c4aae700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f88a406ace0 0x7f88a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:24.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.832+0000 7f88c4aae700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f88a406ace0 0x7f88a406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88b40048d0 tx=0x7f88b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:24.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:24.836+0000 7f88bd7fa700 1 -- 172.21.15.149:0/3825751878 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88b8056100 con 0x7f88c00c3420 2023-06-09T04:37:25.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.022+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f88c0073fa0 con 0x7f88c00c3420 2023-06-09T04:37:25.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.023+0000 7f88bd7fa700 1 -- 172.21.15.149:0/3825751878 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f88b8059720 con 0x7f88c00c3420 2023-06-09T04:37:25.024 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:25.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f88a406ace0 msgr2=0x7f88a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f88a406ace0 0x7f88a406d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88b40048d0 tx=0x7f88b4009040 comp rx=0 tx=0).stop 2023-06-09T04:37:25.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88c00c3420 msgr2=0x7f88c0142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88c00c3420 0x7f88c0142b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f88b0004770 tx=0x7f88b8009750 comp rx=0 tx=0).stop 2023-06-09T04:37:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 shutdown_connections 2023-06-09T04:37:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f88a406ace0 0x7f88a406d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f88c00c54a0 0x7f88c015c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f88c00c3420 0x7f88c0142b60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 --2- 172.21.15.149:0/3825751878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88c015af90 0x7f88c00c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 >> 172.21.15.149:0/3825751878 conn(0x7f88c006aec0 msgr2=0x7f88c00af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:25.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 shutdown_connections 2023-06-09T04:37:25.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.025+0000 7f88c6d12700 1 -- 172.21.15.149:0/3825751878 wait complete. 2023-06-09T04:37:25.038 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:37:25.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.160+0000 7fed5061b700 1 Processor -- start 2023-06-09T04:37:25.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.160+0000 7fed5061b700 1 -- start start 2023-06-09T04:37:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed5061b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fed4815c590 0x7fed480af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed5061b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 0x7fed480b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed5061b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480af050 con 0x7fed480ccba0 2023-06-09T04:37:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed5061b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed480afae0 con 0x7fed4815c590 2023-06-09T04:37:25.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed5061b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480af800 con 0x7fed4806a4c0 2023-06-09T04:37:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4dbb6700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fed480ccba0 0x7fed48069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60754/0 (socket says 172.21.15.149:60754) 2023-06-09T04:37:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4dbb6700 1 -- 172.21.15.149:0/3162317260 learned_addr learned my addr 172.21.15.149:0/3162317260 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/3162317260 >> v2:172.21.15.184:3300/0 conn(0x7fed4815c590 0x7fed480af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4ebb8700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 0x7fed480b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502388015 0 0) 0x7fed480af050 con 0x7fed480ccba0 2023-06-09T04:37:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed340035b0 con 0x7fed480ccba0 2023-06-09T04:37:25.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2496021151 0 0) 0x7fed340035b0 con 0x7fed480ccba0 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 msgr2=0x7fed480b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 0x7fed480b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 >> v2:172.21.15.184:3300/0 conn(0x7fed4815c590 msgr2=0x7fed480af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 --2- 172.21.15.149:0/3162317260 >> v2:172.21.15.184:3300/0 conn(0x7fed4815c590 0x7fed480af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480cc0c0 con 0x7fed480ccba0 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7fed38001670 con 0x7fed480ccba0 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 >> v1:172.21.15.149:6789/0 conn(0x7fed480ccba0 legacy=0x7fed48069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.161+0000 7fed4d3b5700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 0x7fed34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed34004d90 0x7fed34005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480afae0 con 0x7fed34003a00 2023-06-09T04:37:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480af800 con 0x7fed34004d90 2023-06-09T04:37:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3400ba10 con 0x7fed4806a4c0 2023-06-09T04:37:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4dbb6700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 0x7fed34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4ebb8700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed34004d90 0x7fed34005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4e3b7700 1 -- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 msgr2=0x7fed34004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:25.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 0x7fed34004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4e3b7700 1 -- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed34004d90 msgr2=0x7fed34005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:25.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed34004d90 0x7fed34005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4e3b7700 1 -- 172.21.15.149:0/3162317260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340035b0 con 0x7fed34003a00 2023-06-09T04:37:25.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4dbb6700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed4806a4c0 0x7fed34004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4ebb8700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed34004d90 0x7fed34005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed34003e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed44009b40 tx=0x7fed34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6cde7c13520d1bb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44005a20 con 0x7fed34003a00 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44005b80 con 0x7fed34003a00 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.162+0000 7fed4d3b5700 1 -- 172.21.15.149:0/3162317260 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4400e6c0 con 0x7fed34003a00 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.163+0000 7fed5061b700 1 -- 172.21.15.149:0/3162317260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 msgr2=0x7fed34003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.163+0000 7fed5061b700 1 --2- 172.21.15.149:0/3162317260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed34003e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed44009b40 tx=0x7fed34005880 comp rx=0 tx=0).stop 2023-06-09T04:37:25.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.163+0000 7fed4ebb8700 1 -- 172.21.15.149:0/3162317260 reap_dead start 2023-06-09T04:37:25.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.163+0000 7fed5061b700 1 -- 172.21.15.149:0/3162317260 shutdown_connections 2023-06-09T04:37:25.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.163+0000 7fed5061b700 1 -- 172.21.15.149:0/3162317260 >> 172.21.15.149:0/3162317260 conn(0x7fed4806b7e0 msgr2=0x7fed480cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:25.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.163+0000 7fed5061b700 1 -- 172.21.15.149:0/3162317260 shutdown_connections 2023-06-09T04:37:25.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.163+0000 7fed5061b700 1 -- 172.21.15.149:0/3162317260 wait complete. 2023-06-09T04:37:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.164+0000 7fed5061b700 1 Processor -- start 2023-06-09T04:37:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.164+0000 7fed5061b700 1 -- start start 2023-06-09T04:37:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed480c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.172 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed480c8390 0x7fed480b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed48155090 0x7fed48155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480c31d0 con 0x7fed34003a00 2023-06-09T04:37:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480c34b0 con 0x7fed48155090 2023-06-09T04:37:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed48155a40 con 0x7fed480c8390 2023-06-09T04:37:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed480c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed480c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36902/0 (socket says 172.21.15.149:36902) 2023-06-09T04:37:25.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 -- 172.21.15.149:0/1222264897 learned_addr learned my addr 172.21.15.149:0/1222264897 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4dbb6700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed480c8390 0x7fed480b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4ebb8700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed48155090 0x7fed48155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 -- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed480c8390 msgr2=0x7fed480b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed480c8390 0x7fed480b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 -- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed48155090 msgr2=0x7fed48155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed48155090 0x7fed48155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 -- 172.21.15.149:0/1222264897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480b4390 con 0x7fed34003a00 2023-06-09T04:37:25.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed4e3b7700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed480c8f70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed44000c00 tx=0x7fed440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed3effd700 1 -- 172.21.15.149:0/1222264897 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44020070 con 0x7fed34003a00 2023-06-09T04:37:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed3effd700 1 -- 172.21.15.149:0/1222264897 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44004050 con 0x7fed34003a00 2023-06-09T04:37:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed480c31d0 con 0x7fed34003a00 2023-06-09T04:37:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed3effd700 1 -- 172.21.15.149:0/1222264897 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440043e0 con 0x7fed34003a00 2023-06-09T04:37:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.165+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed480b4950 con 0x7fed34003a00 2023-06-09T04:37:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.166+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed48073fa0 con 0x7fed34003a00 2023-06-09T04:37:25.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.167+0000 7fed3effd700 1 -- 172.21.15.149:0/1222264897 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed440036a0 con 0x7fed34003a00 2023-06-09T04:37:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.167+0000 7fed3effd700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fed2c06ace0 0x7fed2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.167+0000 7fed3effd700 1 -- 172.21.15.149:0/1222264897 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed4408a680 con 0x7fed34003a00 2023-06-09T04:37:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.167+0000 7fed4dbb6700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fed2c06ace0 0x7fed2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.168+0000 7fed4dbb6700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fed2c06ace0 0x7fed2c06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fed481f5490 tx=0x7fed38007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.172+0000 7fed3effd700 1 -- 172.21.15.149:0/1222264897 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed44055430 con 0x7fed34003a00 2023-06-09T04:37:25.403 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.402+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed48071dc0 con 0x7fed34003a00 2023-06-09T04:37:25.404 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.403+0000 7fed3effd700 1 -- 172.21.15.149:0/1222264897 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7fed44058a50 con 0x7fed34003a00 2023-06-09T04:37:25.404 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:25.404 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:37:25.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fed2c06ace0 msgr2=0x7fed2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fed2c06ace0 0x7fed2c06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fed481f5490 tx=0x7fed38007040 comp rx=0 tx=0).stop 2023-06-09T04:37:25.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 msgr2=0x7fed480c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.406 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed480c8f70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fed44000c00 tx=0x7fed440047c0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 shutdown_connections 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fed2c06ace0 0x7fed2c06d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed48155090 0x7fed48155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fed34003a00 0x7fed480c8f70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 --2- 172.21.15.149:0/1222264897 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fed480c8390 0x7fed480b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 >> 172.21.15.149:0/1222264897 conn(0x7fed4806b7e0 msgr2=0x7fed480cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 shutdown_connections 2023-06-09T04:37:25.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.405+0000 7fed5061b700 1 -- 172.21.15.149:0/1222264897 wait complete. 2023-06-09T04:37:25.408 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:37:25.418 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:25.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.538+0000 7fa096a06700 1 Processor -- start 2023-06-09T04:37:25.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.538+0000 7fa096a06700 1 -- start start 2023-06-09T04:37:25.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.539+0000 7fa096a06700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa0900ceab0 0x7fa0900cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.539+0000 7fa096a06700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0900cd770 con 0x7fa09015a6a0 2023-06-09T04:37:25.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.539+0000 7fa096a06700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa090158100 con 0x7fa090157d30 2023-06-09T04:37:25.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.539+0000 7fa096a06700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09015b2d0 con 0x7fa0900ceab0 2023-06-09T04:37:25.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.539+0000 7fa094fa3700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa09015a6a0 0x7fa09015aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60778/0 (socket says 172.21.15.149:60778) 2023-06-09T04:37:25.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.539+0000 7fa094fa3700 1 -- 172.21.15.149:0/3180202400 learned_addr learned my addr 172.21.15.149:0/3180202400 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:25.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08f7fe700 1 --2- 172.21.15.149:0/3180202400 >> v2:172.21.15.184:3300/0 conn(0x7fa0900ceab0 0x7fa0900cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08effd700 1 -- 172.21.15.149:0/3180202400 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020589738 0 0) 0x7fa0900cd770 con 0x7fa09015a6a0 2023-06-09T04:37:25.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08effd700 1 -- 172.21.15.149:0/3180202400 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0780035b0 con 0x7fa09015a6a0 2023-06-09T04:37:25.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08effd700 1 -- 172.21.15.149:0/3180202400 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2983146706 0 0) 0x7fa0780035b0 con 0x7fa09015a6a0 2023-06-09T04:37:25.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08f7fe700 1 -- 172.21.15.149:0/3180202400 >> v1:172.21.15.184:6789/0 conn(0x7fa090157d30 legacy=0x7fa0900ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08f7fe700 1 -- 172.21.15.149:0/3180202400 >> v1:172.21.15.149:6789/0 conn(0x7fa09015a6a0 legacy=0x7fa09015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08f7fe700 1 -- 172.21.15.149:0/3180202400 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09015b5b0 con 0x7fa0900ceab0 2023-06-09T04:37:25.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08f7fe700 1 --2- 172.21.15.149:0/3180202400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 0x7fa0900cdc00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa080009840 tx=0x7fa080009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=547db2d03ed7bf09 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08effd700 1 -- 172.21.15.149:0/3180202400 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880019f0 con 0x7fa0900ceab0 2023-06-09T04:37:25.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08effd700 1 -- 172.21.15.149:0/3180202400 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa080004030 con 0x7fa0900ceab0 2023-06-09T04:37:25.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.540+0000 7fa08effd700 1 -- 172.21.15.149:0/3180202400 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800043a0 con 0x7fa0900ceab0 2023-06-09T04:37:25.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.541+0000 7fa096a06700 1 -- 172.21.15.149:0/3180202400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 msgr2=0x7fa0900cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.541+0000 7fa096a06700 1 --2- 172.21.15.149:0/3180202400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 0x7fa0900cdc00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa080009840 tx=0x7fa080009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:25.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.541+0000 7fa096a06700 1 -- 172.21.15.149:0/3180202400 shutdown_connections 2023-06-09T04:37:25.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.541+0000 7fa096a06700 1 --2- 172.21.15.149:0/3180202400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 0x7fa0900cdc00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.541+0000 7fa096a06700 1 -- 172.21.15.149:0/3180202400 >> 172.21.15.149:0/3180202400 conn(0x7fa09006a6d0 msgr2=0x7fa090099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:25.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.541+0000 7fa096a06700 1 -- 172.21.15.149:0/3180202400 shutdown_connections 2023-06-09T04:37:25.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.541+0000 7fa096a06700 1 -- 172.21.15.149:0/3180202400 wait complete. 2023-06-09T04:37:25.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.542+0000 7fa096a06700 1 Processor -- start 2023-06-09T04:37:25.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.542+0000 7fa096a06700 1 -- start start 2023-06-09T04:37:25.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa096a06700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 0x7fa0900cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa096a06700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa090157d30 0x7fa09006b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa096a06700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09015a6a0 0x7fa0901f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa096a06700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901535d0 con 0x7fa09015a6a0 2023-06-09T04:37:25.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa096a06700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901f5570 con 0x7fa0900ceab0 2023-06-09T04:37:25.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa096a06700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0901f5850 con 0x7fa090157d30 2023-06-09T04:37:25.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09015a6a0 0x7fa0901f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09015a6a0 0x7fa0901f0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36920/0 (socket says 172.21.15.149:36920) 2023-06-09T04:37:25.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 -- 172.21.15.149:0/1258870582 learned_addr learned my addr 172.21.15.149:0/1258870582 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:25.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa08ffff700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 0x7fa0900cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa08f7fe700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa090157d30 0x7fa09006b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 -- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa090157d30 msgr2=0x7fa09006b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa090157d30 0x7fa09006b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 -- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 msgr2=0x7fa0900cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 0x7fa0900cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa094fa3700 1 -- 172.21.15.149:0/1258870582 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0800094a0 con 0x7fa09015a6a0 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.543+0000 7fa08f7fe700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa090157d30 0x7fa09006b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.544+0000 7fa094fa3700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09015a6a0 0x7fa0901f0f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa08800cbe0 tx=0x7fa08800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.544+0000 7fa08cff9700 1 -- 172.21.15.149:0/1258870582 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08800ab10 con 0x7fa09015a6a0 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.544+0000 7fa08cff9700 1 -- 172.21.15.149:0/1258870582 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08800ac90 con 0x7fa09015a6a0 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.544+0000 7fa08cff9700 1 -- 172.21.15.149:0/1258870582 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880070d0 con 0x7fa09015a6a0 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.544+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0901f5b30 con 0x7fa09015a6a0 2023-06-09T04:37:25.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.544+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0900cc460 con 0x7fa09015a6a0 2023-06-09T04:37:25.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.545+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa090153740 con 0x7fa09015a6a0 2023-06-09T04:37:25.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.545+0000 7fa08cff9700 1 -- 172.21.15.149:0/1258870582 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa088007230 con 0x7fa09015a6a0 2023-06-09T04:37:25.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.546+0000 7fa08cff9700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa07c06ace0 0x7fa07c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.546+0000 7fa08cff9700 1 -- 172.21.15.149:0/1258870582 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa088089210 con 0x7fa09015a6a0 2023-06-09T04:37:25.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.546+0000 7fa08ffff700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa07c06ace0 0x7fa07c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.546+0000 7fa08ffff700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa07c06ace0 0x7fa07c06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa084001850 tx=0x7fa084009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.550+0000 7fa08cff9700 1 -- 172.21.15.149:0/1258870582 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa090153740 con 0x7fa09015a6a0 2023-06-09T04:37:25.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.738+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa090153740 con 0x7fa09015a6a0 2023-06-09T04:37:25.740 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.739+0000 7fa08cff9700 1 -- 172.21.15.149:0/1258870582 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7fa090153740 con 0x7fa09015a6a0 2023-06-09T04:37:25.741 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:25.741 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:25.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa07c06ace0 msgr2=0x7fa07c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa07c06ace0 0x7fa07c06d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa084001850 tx=0x7fa084009040 comp rx=0 tx=0).stop 2023-06-09T04:37:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09015a6a0 msgr2=0x7fa0901f0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09015a6a0 0x7fa0901f0f20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa08800cbe0 tx=0x7fa08800cef0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 shutdown_connections 2023-06-09T04:37:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa07c06ace0 0x7fa07c06d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa09015a6a0 0x7fa0901f0f20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0900ceab0 0x7fa0900cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 --2- 172.21.15.149:0/1258870582 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa090157d30 0x7fa09006b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 >> 172.21.15.149:0/1258870582 conn(0x7fa09006a6d0 msgr2=0x7fa0901582f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 shutdown_connections 2023-06-09T04:37:25.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.741+0000 7fa096a06700 1 -- 172.21.15.149:0/1258870582 wait complete. 2023-06-09T04:37:25.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:25.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:25.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.877+0000 7fa6d67f6700 1 Processor -- start 2023-06-09T04:37:25.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.877+0000 7fa6d67f6700 1 -- start start 2023-06-09T04:37:25.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6d67f6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6d015c780 0x7fa6d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6d67f6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d0072170 0x7fa6d006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6d67f6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d0071cc0 con 0x7fa6d015c3b0 2023-06-09T04:37:25.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6d67f6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d0071a00 con 0x7fa6d015c780 2023-06-09T04:37:25.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6d67f6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d00cf320 con 0x7fa6d0072170 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6cf7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6d015c780 0x7fa6d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6cf7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa6d015c780 0x7fa6d0069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36924/0 (socket says 172.21.15.149:36924) 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6cf7fe700 1 -- 172.21.15.149:0/575614173 learned_addr learned my addr 172.21.15.149:0/575614173 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.878+0000 7fa6d4d93700 1 --2- 172.21.15.149:0/575614173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d0072170 0x7fa6d006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6cf7fe700 1 -- 172.21.15.149:0/575614173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d0072170 msgr2=0x7fa6d006a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6cf7fe700 1 --2- 172.21.15.149:0/575614173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d0072170 0x7fa6d006a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6cf7fe700 1 -- 172.21.15.149:0/575614173 >> v1:172.21.15.184:6789/0 conn(0x7fa6d015c3b0 legacy=0x7fa6d00b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:25.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6cf7fe700 1 -- 172.21.15.149:0/575614173 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d00cd220 con 0x7fa6d015c780 2023-06-09T04:37:25.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6cf7fe700 1 --2- 172.21.15.149:0/575614173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d015c780 0x7fa6d0069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00098f0 tx=0x7fa6c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c223af1a60f3e77 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6ceffd700 1 -- 172.21.15.149:0/575614173 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0004230 con 0x7fa6d015c780 2023-06-09T04:37:25.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6ceffd700 1 -- 172.21.15.149:0/575614173 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0004390 con 0x7fa6d015c780 2023-06-09T04:37:25.882 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6ceffd700 1 -- 172.21.15.149:0/575614173 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00036a0 con 0x7fa6d015c780 2023-06-09T04:37:25.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 -- 172.21.15.149:0/575614173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d015c780 msgr2=0x7fa6d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/575614173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d015c780 0x7fa6d0069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00098f0 tx=0x7fa6c0009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:25.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 -- 172.21.15.149:0/575614173 shutdown_connections 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/575614173 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d0072170 0x7fa6d006a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/575614173 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d015c780 0x7fa6d0069db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 -- 172.21.15.149:0/575614173 >> 172.21.15.149:0/575614173 conn(0x7fa6d006aec0 msgr2=0x7fa6d006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 -- 172.21.15.149:0/575614173 shutdown_connections 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.879+0000 7fa6d67f6700 1 -- 172.21.15.149:0/575614173 wait complete. 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.881+0000 7fa6d67f6700 1 Processor -- start 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.881+0000 7fa6d67f6700 1 -- start start 2023-06-09T04:37:25.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.881+0000 7fa6d67f6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d0072170 0x7fa6d014da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.881+0000 7fa6d67f6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d015c3b0 0x7fa6d00abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d67f6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6d015c780 0x7fa6d0157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d67f6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d0140fb0 con 0x7fa6d0072170 2023-06-09T04:37:25.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d67f6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d0141290 con 0x7fa6d015c780 2023-06-09T04:37:25.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d67f6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d0141570 con 0x7fa6d015c3b0 2023-06-09T04:37:25.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d0072170 0x7fa6d014da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d0072170 0x7fa6d014da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36928/0 (socket says 172.21.15.149:36928) 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 -- 172.21.15.149:0/3971222752 learned_addr learned my addr 172.21.15.149:0/3971222752 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cf7fe700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d015c3b0 0x7fa6d00abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d4d93700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6d015c780 0x7fa6d0157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 -- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d015c3b0 msgr2=0x7fa6d00abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d015c3b0 0x7fa6d00abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 -- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6d015c780 msgr2=0x7fa6d0157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6d015c780 0x7fa6d0157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:25.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 -- 172.21.15.149:0/3971222752 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c0009550 con 0x7fa6d0072170 2023-06-09T04:37:25.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d4d93700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6d015c780 0x7fa6d0157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:25.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6cffff700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d0072170 0x7fa6d014da90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c4d0 tx=0x7fa6c400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6ccff9700 1 -- 172.21.15.149:0/3971222752 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011790 con 0x7fa6d0072170 2023-06-09T04:37:25.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6ccff9700 1 -- 172.21.15.149:0/3971222752 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c40118f0 con 0x7fa6d0072170 2023-06-09T04:37:25.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d0141850 con 0x7fa6d0072170 2023-06-09T04:37:25.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6ccff9700 1 -- 172.21.15.149:0/3971222752 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4011ca0 con 0x7fa6d0072170 2023-06-09T04:37:25.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.882+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d014dfd0 con 0x7fa6d0072170 2023-06-09T04:37:25.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.883+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d013ec40 con 0x7fa6d0072170 2023-06-09T04:37:25.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.884+0000 7fa6ccff9700 1 -- 172.21.15.149:0/3971222752 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6c401c460 con 0x7fa6d0072170 2023-06-09T04:37:25.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.884+0000 7fa6ccff9700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa6bc06ace0 0x7fa6bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:25.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.884+0000 7fa6ccff9700 1 -- 172.21.15.149:0/3971222752 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6c4089620 con 0x7fa6d0072170 2023-06-09T04:37:25.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.884+0000 7fa6cf7fe700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa6bc06ace0 0x7fa6bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:25.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.884+0000 7fa6cf7fe700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa6bc06ace0 0x7fa6bc06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00cf620 tx=0x7fa6c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:25.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:25.888+0000 7fa6ccff9700 1 -- 172.21.15.149:0/3971222752 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6d013ec40 con 0x7fa6d0072170 2023-06-09T04:37:26.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.074+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6d013ec40 con 0x7fa6d0072170 2023-06-09T04:37:26.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.075+0000 7fa6ccff9700 1 -- 172.21.15.149:0/3971222752 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6d013ec40 con 0x7fa6d0072170 2023-06-09T04:37:26.076 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:26.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa6bc06ace0 msgr2=0x7fa6bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa6bc06ace0 0x7fa6bc06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00cf620 tx=0x7fa6c0008030 comp rx=0 tx=0).stop 2023-06-09T04:37:26.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d0072170 msgr2=0x7fa6d014da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d0072170 0x7fa6d014da90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400c4d0 tx=0x7fa6c400c890 comp rx=0 tx=0).stop 2023-06-09T04:37:26.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 shutdown_connections 2023-06-09T04:37:26.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa6bc06ace0 0x7fa6bc06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6d015c780 0x7fa6d0157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa6d0072170 0x7fa6d014da90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 --2- 172.21.15.149:0/3971222752 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa6d015c3b0 0x7fa6d00abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 >> 172.21.15.149:0/3971222752 conn(0x7fa6d006aec0 msgr2=0x7fa6d00b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:26.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 shutdown_connections 2023-06-09T04:37:26.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.077+0000 7fa6d67f6700 1 -- 172.21.15.149:0/3971222752 wait complete. 2023-06-09T04:37:26.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:26.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.211+0000 7fcf645cf700 1 Processor -- start 2023-06-09T04:37:26.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.211+0000 7fcf645cf700 1 -- start start 2023-06-09T04:37:26.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf645cf700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf5c159380 0x7fcf5c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf645cf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf645cf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c06f480 con 0x7fcf5c071d50 2023-06-09T04:37:26.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf645cf700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0b10d0 con 0x7fcf5c159380 2023-06-09T04:37:26.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf645cf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cb590 con 0x7fcf5c0b1dc0 2023-06-09T04:37:26.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf6236b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcf5c159380 0x7fcf5c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf61b6a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf62b6c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcf5c071d50 0x7fcf5c15cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:38570/0 (socket says 172.21.15.149:38570) 2023-06-09T04:37:26.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf62b6c700 1 -- 172.21.15.149:0/4066171395 learned_addr learned my addr 172.21.15.149:0/4066171395 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:26.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf6236b700 1 -- 172.21.15.149:0/4066171395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c0b1dc0 msgr2=0x7fcf5c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf6236b700 1 --2- 172.21.15.149:0/4066171395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf6236b700 1 -- 172.21.15.149:0/4066171395 >> v1:172.21.15.184:6789/0 conn(0x7fcf5c071d50 legacy=0x7fcf5c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.213+0000 7fcf6236b700 1 -- 172.21.15.149:0/4066171395 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c06f760 con 0x7fcf5c159380 2023-06-09T04:37:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf6236b700 1 --2- 172.21.15.149:0/4066171395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c159380 0x7fcf5c0716c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009840 tx=0x7fcf4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df340dc9281d8e30 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf61369700 1 -- 172.21.15.149:0/4066171395 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011830 con 0x7fcf5c159380 2023-06-09T04:37:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf61369700 1 -- 172.21.15.149:0/4066171395 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c011990 con 0x7fcf5c159380 2023-06-09T04:37:26.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf61369700 1 -- 172.21.15.149:0/4066171395 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011d20 con 0x7fcf5c159380 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 -- 172.21.15.149:0/4066171395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c159380 msgr2=0x7fcf5c0716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 --2- 172.21.15.149:0/4066171395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c159380 0x7fcf5c0716c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009840 tx=0x7fcf4c009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 -- 172.21.15.149:0/4066171395 shutdown_connections 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 --2- 172.21.15.149:0/4066171395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c159380 0x7fcf5c0716c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 --2- 172.21.15.149:0/4066171395 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 -- 172.21.15.149:0/4066171395 >> 172.21.15.149:0/4066171395 conn(0x7fcf5c06aec0 msgr2=0x7fcf5c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 -- 172.21.15.149:0/4066171395 shutdown_connections 2023-06-09T04:37:26.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.214+0000 7fcf645cf700 1 -- 172.21.15.149:0/4066171395 wait complete. 2023-06-09T04:37:26.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.215+0000 7fcf645cf700 1 Processor -- start 2023-06-09T04:37:26.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf645cf700 1 -- start start 2023-06-09T04:37:26.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf645cf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c071d50 0x7fcf5c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf645cf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf645cf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c159380 0x7fcf5c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf645cf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c62f0 con 0x7fcf5c159380 2023-06-09T04:37:26.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf645cf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c151860 con 0x7fcf5c0b1dc0 2023-06-09T04:37:26.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf645cf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c151b40 con 0x7fcf5c071d50 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf62b6c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c159380 0x7fcf5c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf62b6c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c159380 0x7fcf5c159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36946/0 (socket says 172.21.15.149:36946) 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.216+0000 7fcf62b6c700 1 -- 172.21.15.149:0/2358144705 learned_addr learned my addr 172.21.15.149:0/2358144705 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf6236b700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c071d50 0x7fcf5c150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf61b6a700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf62b6c700 1 -- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c071d50 msgr2=0x7fcf5c150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf62b6c700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c071d50 0x7fcf5c150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf62b6c700 1 -- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c0b1dc0 msgr2=0x7fcf5c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf62b6c700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf62b6c700 1 -- 172.21.15.149:0/2358144705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0094a0 con 0x7fcf5c159380 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf61b6a700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf62b6c700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c159380 0x7fcf5c159ac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400cb10 tx=0x7fcf5400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf52ffd700 1 -- 172.21.15.149:0/2358144705 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400ab00 con 0x7fcf5c159380 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf52ffd700 1 -- 172.21.15.149:0/2358144705 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5400ac60 con 0x7fcf5c159380 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c151e20 con 0x7fcf5c159380 2023-06-09T04:37:26.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf52ffd700 1 -- 172.21.15.149:0/2358144705 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf54012400 con 0x7fcf5c159380 2023-06-09T04:37:26.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.217+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c14ec10 con 0x7fcf5c159380 2023-06-09T04:37:26.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.218+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0c3eb0 con 0x7fcf5c159380 2023-06-09T04:37:26.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.219+0000 7fcf52ffd700 1 -- 172.21.15.149:0/2358144705 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf5401b3b0 con 0x7fcf5c159380 2023-06-09T04:37:26.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.219+0000 7fcf52ffd700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf4006ace0 0x7fcf4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.219+0000 7fcf52ffd700 1 -- 172.21.15.149:0/2358144705 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf540893f0 con 0x7fcf5c159380 2023-06-09T04:37:26.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.219+0000 7fcf6236b700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf4006ace0 0x7fcf4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.219+0000 7fcf6236b700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf4006ace0 0x7fcf4006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000c00 tx=0x7fcf4c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.223+0000 7fcf52ffd700 1 -- 172.21.15.149:0/2358144705 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf54054260 con 0x7fcf5c159380 2023-06-09T04:37:26.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.410+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf5c073fa0 con 0x7fcf5c159380 2023-06-09T04:37:26.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.410+0000 7fcf52ffd700 1 -- 172.21.15.149:0/2358144705 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf54057880 con 0x7fcf5c159380 2023-06-09T04:37:26.412 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:26.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf4006ace0 msgr2=0x7fcf4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf4006ace0 0x7fcf4006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000c00 tx=0x7fcf4c01c040 comp rx=0 tx=0).stop 2023-06-09T04:37:26.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c159380 msgr2=0x7fcf5c159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c159380 0x7fcf5c159ac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400cb10 tx=0x7fcf5400ced0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 shutdown_connections 2023-06-09T04:37:26.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcf4006ace0 0x7fcf4006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcf5c071d50 0x7fcf5c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf5c159380 0x7fcf5c159ac0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 --2- 172.21.15.149:0/2358144705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf5c0b1dc0 0x7fcf5c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 >> 172.21.15.149:0/2358144705 conn(0x7fcf5c06aec0 msgr2=0x7fcf5c0b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:26.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 shutdown_connections 2023-06-09T04:37:26.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.413+0000 7fcf645cf700 1 -- 172.21.15.149:0/2358144705 wait complete. 2023-06-09T04:37:26.426 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:26.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.548+0000 7f48485a1700 1 Processor -- start 2023-06-09T04:37:26.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.549+0000 7f48485a1700 1 -- start start 2023-06-09T04:37:26.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.549+0000 7f48485a1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f484015c520 0x7f4840071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.549+0000 7f48485a1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484006a4c0 0x7f48400b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.549+0000 7f48485a1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484015c8f0 con 0x7f48400cee20 2023-06-09T04:37:26.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.549+0000 7f48485a1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400cd940 con 0x7f484015c520 2023-06-09T04:37:26.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.549+0000 7f48485a1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48400b20f0 con 0x7f484006a4c0 2023-06-09T04:37:26.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4845b3c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f48400cee20 0x7f4840069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60816/0 (socket says 172.21.15.149:60816) 2023-06-09T04:37:26.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4845b3c700 1 -- 172.21.15.149:0/2662211191 learned_addr learned my addr 172.21.15.149:0/2662211191 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:26.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4846b3e700 1 --2- 172.21.15.149:0/2662211191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484006a4c0 0x7f48400b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f484633d700 1 --2- 172.21.15.149:0/2662211191 >> v2:172.21.15.184:3300/0 conn(0x7f484015c520 0x7f4840071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f484533b700 1 -- 172.21.15.149:0/2662211191 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748704348 0 0) 0x7f483c001110 con 0x7f48400cee20 2023-06-09T04:37:26.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f484533b700 1 -- 172.21.15.149:0/2662211191 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c0035b0 con 0x7f48400cee20 2023-06-09T04:37:26.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4846b3e700 1 -- 172.21.15.149:0/2662211191 >> v2:172.21.15.184:3300/0 conn(0x7f484015c520 msgr2=0x7f4840071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:26.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4846b3e700 1 --2- 172.21.15.149:0/2662211191 >> v2:172.21.15.184:3300/0 conn(0x7f484015c520 0x7f4840071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4846b3e700 1 -- 172.21.15.149:0/2662211191 >> v1:172.21.15.149:6789/0 conn(0x7f48400cee20 legacy=0x7f4840069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4846b3e700 1 -- 172.21.15.149:0/2662211191 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400cd3c0 con 0x7f484006a4c0 2023-06-09T04:37:26.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f4846b3e700 1 --2- 172.21.15.149:0/2662211191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484006a4c0 0x7f48400b24a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abf625772a5576fa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f484533b700 1 -- 172.21.15.149:0/2662211191 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800e070 con 0x7f484006a4c0 2023-06-09T04:37:26.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f484533b700 1 -- 172.21.15.149:0/2662211191 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800bb20 con 0x7f484006a4c0 2023-06-09T04:37:26.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.550+0000 7f484533b700 1 -- 172.21.15.149:0/2662211191 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483800be90 con 0x7f484006a4c0 2023-06-09T04:37:26.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 -- 172.21.15.149:0/2662211191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484006a4c0 msgr2=0x7f48400b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 --2- 172.21.15.149:0/2662211191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484006a4c0 0x7f48400b24a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4838009d90 tx=0x7f483800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:26.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 -- 172.21.15.149:0/2662211191 shutdown_connections 2023-06-09T04:37:26.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 --2- 172.21.15.149:0/2662211191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f484006a4c0 0x7f48400b24a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 --2- 172.21.15.149:0/2662211191 >> v2:172.21.15.184:3300/0 conn(0x7f484015c520 0x7f4840071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 -- 172.21.15.149:0/2662211191 >> 172.21.15.149:0/2662211191 conn(0x7f484006aec0 msgr2=0x7f484006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:26.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 -- 172.21.15.149:0/2662211191 shutdown_connections 2023-06-09T04:37:26.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.551+0000 7f48485a1700 1 -- 172.21.15.149:0/2662211191 wait complete. 2023-06-09T04:37:26.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.552+0000 7f48485a1700 1 Processor -- start 2023-06-09T04:37:26.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.552+0000 7f48485a1700 1 -- start start 2023-06-09T04:37:26.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f48485a1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f484006a4c0 0x7f48400c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f48485a1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48400cee20 0x7f484014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f48485a1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484015c520 0x7f48400af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f48485a1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400ac660 con 0x7f484006a4c0 2023-06-09T04:37:26.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f48485a1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400acf00 con 0x7f484015c520 2023-06-09T04:37:26.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f48485a1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484014d990 con 0x7f48400cee20 2023-06-09T04:37:26.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f484006a4c0 0x7f48400c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f484006a4c0 0x7f48400c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36956/0 (socket says 172.21.15.149:36956) 2023-06-09T04:37:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 -- 172.21.15.149:0/1226849484 learned_addr learned my addr 172.21.15.149:0/1226849484 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f4845b3c700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48400cee20 0x7f484014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f4846b3e700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484015c520 0x7f48400af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 -- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48400cee20 msgr2=0x7f484014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48400cee20 0x7f484014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 -- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484015c520 msgr2=0x7f48400af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484015c520 0x7f48400af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 -- 172.21.15.149:0/1226849484 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009a70 con 0x7f484006a4c0 2023-06-09T04:37:26.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f4845b3c700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48400cee20 0x7f484014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:26.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.553+0000 7f484633d700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f484006a4c0 0x7f48400c3180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f483000e8a0 tx=0x7f483000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.554+0000 7f4836ffd700 1 -- 172.21.15.149:0/1226849484 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830009590 con 0x7f484006a4c0 2023-06-09T04:37:26.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.554+0000 7f4836ffd700 1 -- 172.21.15.149:0/1226849484 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4830013680 con 0x7f484006a4c0 2023-06-09T04:37:26.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.554+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48400b3510 con 0x7f484006a4c0 2023-06-09T04:37:26.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.554+0000 7f4836ffd700 1 -- 172.21.15.149:0/1226849484 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300139f0 con 0x7f484006a4c0 2023-06-09T04:37:26.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.554+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48400acb90 con 0x7f484006a4c0 2023-06-09T04:37:26.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.555+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4840073fa0 con 0x7f484006a4c0 2023-06-09T04:37:26.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.555+0000 7f4836ffd700 1 -- 172.21.15.149:0/1226849484 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4830013b50 con 0x7f484006a4c0 2023-06-09T04:37:26.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.555+0000 7f4836ffd700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f482406ace0 0x7f482406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.555+0000 7f4836ffd700 1 -- 172.21.15.149:0/1226849484 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48300896c0 con 0x7f484006a4c0 2023-06-09T04:37:26.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.556+0000 7f4845b3c700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f482406ace0 0x7f482406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.556+0000 7f4845b3c700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f482406ace0 0x7f482406d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48400b4920 tx=0x7f483c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.560+0000 7f4836ffd700 1 -- 172.21.15.149:0/1226849484 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4830054480 con 0x7f484006a4c0 2023-06-09T04:37:26.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.748+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48400c2ad0 con 0x7f484006a4c0 2023-06-09T04:37:26.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.749+0000 7f4836ffd700 1 -- 172.21.15.149:0/1226849484 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4830057aa0 con 0x7f484006a4c0 2023-06-09T04:37:26.750 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:26.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f482406ace0 msgr2=0x7f482406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f482406ace0 0x7f482406d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48400b4920 tx=0x7f483c009040 comp rx=0 tx=0).stop 2023-06-09T04:37:26.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f484006a4c0 msgr2=0x7f48400c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f484006a4c0 0x7f48400c3180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f483000e8a0 tx=0x7f483000ebb0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 shutdown_connections 2023-06-09T04:37:26.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f482406ace0 0x7f482406d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f484015c520 0x7f48400af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f484006a4c0 0x7f48400c3180 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 --2- 172.21.15.149:0/1226849484 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f48400cee20 0x7f484014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 >> 172.21.15.149:0/1226849484 conn(0x7f484006aec0 msgr2=0x7f4840159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:26.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 shutdown_connections 2023-06-09T04:37:26.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.751+0000 7f48485a1700 1 -- 172.21.15.149:0/1226849484 wait complete. 2023-06-09T04:37:26.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:26.887 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.886+0000 7fb831abc700 1 Processor -- start 2023-06-09T04:37:26.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.886+0000 7fb831abc700 1 -- start start 2023-06-09T04:37:26.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb831abc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb82c069db0 0x7fb82c0c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb831abc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb82c15a400 0x7fb82c06a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb831abc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c0ccc00 0x7fb82c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb831abc700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c0720f0 con 0x7fb82c15a400 2023-06-09T04:37:26.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb831abc700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82c0ca1e0 con 0x7fb82c069db0 2023-06-09T04:37:26.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb831abc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c06a6c0 con 0x7fb82c0ccc00 2023-06-09T04:37:26.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb82affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb82c15a400 0x7fb82c06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb82affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb82c15a400 0x7fb82c06a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36964/0 (socket says 172.21.15.149:36964) 2023-06-09T04:37:26.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.887+0000 7fb82affd700 1 -- 172.21.15.149:0/2662761815 learned_addr learned my addr 172.21.15.149:0/2662761815 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:26.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82b7fe700 1 --2- 172.21.15.149:0/2662761815 >> v2:172.21.15.184:3300/0 conn(0x7fb82c069db0 0x7fb82c0c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82bfff700 1 --2- 172.21.15.149:0/2662761815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c0ccc00 0x7fb82c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82affd700 1 -- 172.21.15.149:0/2662761815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c0ccc00 msgr2=0x7fb82c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:26.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82affd700 1 --2- 172.21.15.149:0/2662761815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c0ccc00 0x7fb82c0b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82affd700 1 -- 172.21.15.149:0/2662761815 >> v2:172.21.15.184:3300/0 conn(0x7fb82c069db0 msgr2=0x7fb82c0c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:26.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82affd700 1 --2- 172.21.15.149:0/2662761815 >> v2:172.21.15.184:3300/0 conn(0x7fb82c069db0 0x7fb82c0c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82affd700 1 -- 172.21.15.149:0/2662761815 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0cb960 con 0x7fb82c15a400 2023-06-09T04:37:26.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82bfff700 1 --2- 172.21.15.149:0/2662761815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c0ccc00 0x7fb82c0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:26.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82affd700 1 --2- 172.21.15.149:0/2662761815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c06a180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb82c066830 tx=0x7fb81c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca97dc16c588824d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82a7fc700 1 -- 172.21.15.149:0/2662761815 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00b870 con 0x7fb82c15a400 2023-06-09T04:37:26.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82a7fc700 1 -- 172.21.15.149:0/2662761815 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00b9d0 con 0x7fb82c15a400 2023-06-09T04:37:26.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb82a7fc700 1 -- 172.21.15.149:0/2662761815 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00bd60 con 0x7fb82c15a400 2023-06-09T04:37:26.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb831abc700 1 -- 172.21.15.149:0/2662761815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 msgr2=0x7fb82c06a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.888+0000 7fb831abc700 1 --2- 172.21.15.149:0/2662761815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c06a180 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb82c066830 tx=0x7fb81c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.889+0000 7fb831abc700 1 -- 172.21.15.149:0/2662761815 shutdown_connections 2023-06-09T04:37:26.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.889+0000 7fb831abc700 1 --2- 172.21.15.149:0/2662761815 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c0ccc00 0x7fb82c0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.889+0000 7fb831abc700 1 --2- 172.21.15.149:0/2662761815 >> v2:172.21.15.184:3300/0 conn(0x7fb82c069db0 0x7fb82c0c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.889+0000 7fb831abc700 1 --2- 172.21.15.149:0/2662761815 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c06a180 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.889+0000 7fb831abc700 1 -- 172.21.15.149:0/2662761815 >> 172.21.15.149:0/2662761815 conn(0x7fb82c06aec0 msgr2=0x7fb82c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:26.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.889+0000 7fb831abc700 1 -- 172.21.15.149:0/2662761815 shutdown_connections 2023-06-09T04:37:26.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.889+0000 7fb831abc700 1 -- 172.21.15.149:0/2662761815 wait complete. 2023-06-09T04:37:26.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.890+0000 7fb831abc700 1 Processor -- start 2023-06-09T04:37:26.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.890+0000 7fb831abc700 1 -- start start 2023-06-09T04:37:26.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c069db0 0x7fb82c0ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb82c0ccc00 0x7fb82c0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0ad920 con 0x7fb82c15a400 2023-06-09T04:37:26.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c156fb0 con 0x7fb82c0ccc00 2023-06-09T04:37:26.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82c0ac340 con 0x7fb82c069db0 2023-06-09T04:37:26.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c0cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36974/0 (socket says 172.21.15.149:36974) 2023-06-09T04:37:26.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 -- 172.21.15.149:0/1279155595 learned_addr learned my addr 172.21.15.149:0/1279155595 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:26.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82affd700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb82c0ccc00 0x7fb82c0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82b7fe700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c069db0 0x7fb82c0ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 -- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c069db0 msgr2=0x7fb82c0ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c069db0 0x7fb82c0ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 -- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb82c0ccc00 msgr2=0x7fb82c0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb82c0ccc00 0x7fb82c0ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 -- 172.21.15.149:0/1279155595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c009550 con 0x7fb82c15a400 2023-06-09T04:37:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82b7fe700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c069db0 0x7fb82c0ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb82bfff700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c0cd250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb82400cd50 tx=0x7fb82400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb813fff700 1 -- 172.21.15.149:0/1279155595 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400cea0 con 0x7fb82c15a400 2023-06-09T04:37:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb813fff700 1 -- 172.21.15.149:0/1279155595 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400f480 con 0x7fb82c15a400 2023-06-09T04:37:26.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c0ac620 con 0x7fb82c15a400 2023-06-09T04:37:26.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb813fff700 1 -- 172.21.15.149:0/1279155595 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400f810 con 0x7fb82c15a400 2023-06-09T04:37:26.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.891+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c0acbe0 con 0x7fb82c15a400 2023-06-09T04:37:26.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.892+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82c073fa0 con 0x7fb82c15a400 2023-06-09T04:37:26.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.893+0000 7fb813fff700 1 -- 172.21.15.149:0/1279155595 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb82400b040 con 0x7fb82c15a400 2023-06-09T04:37:26.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.893+0000 7fb813fff700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb81806ace0 0x7fb81806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:26.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.893+0000 7fb813fff700 1 -- 172.21.15.149:0/1279155595 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb824089e00 con 0x7fb82c15a400 2023-06-09T04:37:26.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.893+0000 7fb82b7fe700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb81806ace0 0x7fb81806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:26.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.894+0000 7fb82b7fe700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb81806ace0 0x7fb81806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb820007a50 tx=0x7fb820008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:26.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:26.898+0000 7fb813fff700 1 -- 172.21.15.149:0/1279155595 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb824054c50 con 0x7fb82c15a400 2023-06-09T04:37:27.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.082+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb82c0b5330 con 0x7fb82c15a400 2023-06-09T04:37:27.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.083+0000 7fb813fff700 1 -- 172.21.15.149:0/1279155595 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb824058270 con 0x7fb82c15a400 2023-06-09T04:37:27.084 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.084+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb81806ace0 msgr2=0x7fb81806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.084+0000 7fb831abc700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb81806ace0 0x7fb81806d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb820007a50 tx=0x7fb820008040 comp rx=0 tx=0).stop 2023-06-09T04:37:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 msgr2=0x7fb82c0cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c0cd250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb82400cd50 tx=0x7fb82400a560 comp rx=0 tx=0).stop 2023-06-09T04:37:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 shutdown_connections 2023-06-09T04:37:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb81806ace0 0x7fb81806d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb82c069db0 0x7fb82c0ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb82c15a400 0x7fb82c0cd250 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 --2- 172.21.15.149:0/1279155595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb82c0ccc00 0x7fb82c0ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 >> 172.21.15.149:0/1279155595 conn(0x7fb82c06aec0 msgr2=0x7fb82c0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:27.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 shutdown_connections 2023-06-09T04:37:27.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.085+0000 7fb831abc700 1 -- 172.21.15.149:0/1279155595 wait complete. 2023-06-09T04:37:27.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:27.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.220+0000 7f871d941700 1 Processor -- start 2023-06-09T04:37:27.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.220+0000 7f871d941700 1 -- start start 2023-06-09T04:37:27.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f871d941700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87180b60a0 0x7f87180cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f871d941700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180cf5b0 0x7f871815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f871d941700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180cda20 con 0x7f871815e170 2023-06-09T04:37:27.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f871d941700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87180b6470 con 0x7f87180b60a0 2023-06-09T04:37:27.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f871d941700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871815a520 con 0x7f87180cf5b0 2023-06-09T04:37:27.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f87167fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180cf5b0 0x7f871815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f8716ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87180b60a0 0x7f87180cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f87167fc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180cf5b0 0x7f871815dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42592/0 (socket says 172.21.15.149:42592) 2023-06-09T04:37:27.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f8716ffd700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f87180b60a0 0x7f87180cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:56242/0 (socket says 172.21.15.149:56242) 2023-06-09T04:37:27.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f87167fc700 1 -- 172.21.15.149:0/3462304315 learned_addr learned my addr 172.21.15.149:0/3462304315 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:27.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.221+0000 7f87177fe700 1 --1- 172.21.15.149:0/3462304315 >> v1:172.21.15.184:6789/0 conn(0x7f871815e170 0x7f87180ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:38612/0 (socket says 172.21.15.149:38612) 2023-06-09T04:37:27.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8716ffd700 1 -- 172.21.15.149:0/3462304315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180cf5b0 msgr2=0x7f871815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:27.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8716ffd700 1 --2- 172.21.15.149:0/3462304315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180cf5b0 0x7f871815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8716ffd700 1 -- 172.21.15.149:0/3462304315 >> v1:172.21.15.184:6789/0 conn(0x7f871815e170 legacy=0x7f87180ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8716ffd700 1 -- 172.21.15.149:0/3462304315 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871815ea40 con 0x7f87180b60a0 2023-06-09T04:37:27.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8715ffb700 1 -- 172.21.15.149:0/3462304315 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605198710 0 0) 0x7f87180cda20 con 0x7f871815e170 2023-06-09T04:37:27.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8716ffd700 1 --2- 172.21.15.149:0/3462304315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87180b60a0 0x7f87180cad90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f870c009840 tx=0x7f870c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b4551057a86136 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8715ffb700 1 -- 172.21.15.149:0/3462304315 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c011830 con 0x7f87180b60a0 2023-06-09T04:37:27.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8715ffb700 1 -- 172.21.15.149:0/3462304315 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c011990 con 0x7f87180b60a0 2023-06-09T04:37:27.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.222+0000 7f8715ffb700 1 -- 172.21.15.149:0/3462304315 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c011d20 con 0x7f87180b60a0 2023-06-09T04:37:27.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 -- 172.21.15.149:0/3462304315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87180b60a0 msgr2=0x7f87180cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 --2- 172.21.15.149:0/3462304315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87180b60a0 0x7f87180cad90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f870c009840 tx=0x7f870c009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:27.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 -- 172.21.15.149:0/3462304315 shutdown_connections 2023-06-09T04:37:27.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 --2- 172.21.15.149:0/3462304315 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f87180b60a0 0x7f87180cad90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 --2- 172.21.15.149:0/3462304315 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180cf5b0 0x7f871815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 -- 172.21.15.149:0/3462304315 >> 172.21.15.149:0/3462304315 conn(0x7f8718069db0 msgr2=0x7f871806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:27.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 -- 172.21.15.149:0/3462304315 shutdown_connections 2023-06-09T04:37:27.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.223+0000 7f871d941700 1 -- 172.21.15.149:0/3462304315 wait complete. 2023-06-09T04:37:27.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.224+0000 7f871d941700 1 Processor -- start 2023-06-09T04:37:27.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.224+0000 7f871d941700 1 -- start start 2023-06-09T04:37:27.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f871d941700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180b60a0 0x7f871806cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f871d941700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87180cf5b0 0x7f871815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f871d941700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871815e170 0x7f87181572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f871d941700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180c69f0 con 0x7f87180cf5b0 2023-06-09T04:37:27.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f871d941700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180c5950 con 0x7f871815e170 2023-06-09T04:37:27.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f871d941700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87180c5c30 con 0x7f87180b60a0 2023-06-09T04:37:27.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87180cf5b0 0x7f871815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87180cf5b0 0x7f871815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36984/0 (socket says 172.21.15.149:36984) 2023-06-09T04:37:27.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 -- 172.21.15.149:0/346110525 learned_addr learned my addr 172.21.15.149:0/346110525 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:27.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87177fe700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871815e170 0x7f87181572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f8716ffd700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180b60a0 0x7f871806cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 -- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180b60a0 msgr2=0x7f871806cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180b60a0 0x7f871806cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 -- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871815e170 msgr2=0x7f87181572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871815e170 0x7f87181572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87167fc700 1 -- 172.21.15.149:0/346110525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c0094a0 con 0x7f87180cf5b0 2023-06-09T04:37:27.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f87177fe700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871815e170 0x7f87181572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:27.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.225+0000 7f8716ffd700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180b60a0 0x7f871806cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:27.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.226+0000 7f87167fc700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87180cf5b0 0x7f871815d030 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f870800e910 tx=0x7f870800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.226+0000 7f86fffff700 1 -- 172.21.15.149:0/346110525 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87080096a0 con 0x7f87180cf5b0 2023-06-09T04:37:27.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.226+0000 7f86fffff700 1 -- 172.21.15.149:0/346110525 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800c850 con 0x7f87180cf5b0 2023-06-09T04:37:27.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.226+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87180c5f10 con 0x7f87180cf5b0 2023-06-09T04:37:27.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.226+0000 7f86fffff700 1 -- 172.21.15.149:0/346110525 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870800cc00 con 0x7f87180cf5b0 2023-06-09T04:37:27.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.226+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87180c64d0 con 0x7f87180cf5b0 2023-06-09T04:37:27.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.227+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8718073fa0 con 0x7f87180cf5b0 2023-06-09T04:37:27.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.227+0000 7f86fffff700 1 -- 172.21.15.149:0/346110525 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f870800cd60 con 0x7f87180cf5b0 2023-06-09T04:37:27.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.227+0000 7f86fffff700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f870406ace0 0x7f870406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.228+0000 7f86fffff700 1 -- 172.21.15.149:0/346110525 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8708089740 con 0x7f87180cf5b0 2023-06-09T04:37:27.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.228+0000 7f8716ffd700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f870406ace0 0x7f870406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.228+0000 7f8716ffd700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f870406ace0 0x7f870406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f870c009fd0 tx=0x7f870c01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.232+0000 7f86fffff700 1 -- 172.21.15.149:0/346110525 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8708054590 con 0x7f87180cf5b0 2023-06-09T04:37:27.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.419+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f87180cb0b0 con 0x7f87180cf5b0 2023-06-09T04:37:27.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.419+0000 7f86fffff700 1 -- 172.21.15.149:0/346110525 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8708057bb0 con 0x7f87180cf5b0 2023-06-09T04:37:27.421 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:27.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f870406ace0 msgr2=0x7f870406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f870406ace0 0x7f870406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f870c009fd0 tx=0x7f870c01c040 comp rx=0 tx=0).stop 2023-06-09T04:37:27.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87180cf5b0 msgr2=0x7f871815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87180cf5b0 0x7f871815d030 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f870800e910 tx=0x7f870800ecd0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 shutdown_connections 2023-06-09T04:37:27.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f870406ace0 0x7f870406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f87180b60a0 0x7f871806cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f871815e170 0x7f87181572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 --2- 172.21.15.149:0/346110525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87180cf5b0 0x7f871815d030 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 >> 172.21.15.149:0/346110525 conn(0x7f8718069db0 msgr2=0x7f871806a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:27.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 shutdown_connections 2023-06-09T04:37:27.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.421+0000 7f871d941700 1 -- 172.21.15.149:0/346110525 wait complete. 2023-06-09T04:37:27.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:37:27.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.554+0000 7f0891b85700 1 Processor -- start 2023-06-09T04:37:27.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.554+0000 7f0891b85700 1 -- start start 2023-06-09T04:37:27.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f0891b85700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f088c15c590 0x7f088c0af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f0891b85700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c06a4c0 0x7f088c0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f0891b85700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c0af050 con 0x7f088c0ccba0 2023-06-09T04:37:27.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f0891b85700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c0afae0 con 0x7f088c15c590 2023-06-09T04:37:27.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f0891b85700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0af800 con 0x7f088c06a4c0 2023-06-09T04:37:27.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088b7fe700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f088c15c590 0x7f088c0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088bfff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c06a4c0 0x7f088c0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088affd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f088c0ccba0 0x7f088c069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:38622/0 (socket says 172.21.15.149:38622) 2023-06-09T04:37:27.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088affd700 1 -- 172.21.15.149:0/507766903 learned_addr learned my addr 172.21.15.149:0/507766903 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:27.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088b7fe700 1 --2- 172.21.15.149:0/507766903 >> v2:172.21.15.184:3300/0 conn(0x7f088c15c590 0x7f088c0af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:56256/0 (socket says 172.21.15.149:56256) 2023-06-09T04:37:27.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088bfff700 1 -- 172.21.15.149:0/507766903 >> v2:172.21.15.184:3300/0 conn(0x7f088c15c590 msgr2=0x7f088c0af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:27.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088bfff700 1 --2- 172.21.15.149:0/507766903 >> v2:172.21.15.184:3300/0 conn(0x7f088c15c590 0x7f088c0af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088bfff700 1 -- 172.21.15.149:0/507766903 >> v1:172.21.15.184:6789/0 conn(0x7f088c0ccba0 legacy=0x7f088c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.555+0000 7f088bfff700 1 -- 172.21.15.149:0/507766903 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c0cc0c0 con 0x7f088c06a4c0 2023-06-09T04:37:27.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f088bfff700 1 --2- 172.21.15.149:0/507766903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c06a4c0 0x7f088c0b06d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0884009d90 tx=0x7f088400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a460f1ef1fd9890 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f088a7fc700 1 -- 172.21.15.149:0/507766903 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088400e070 con 0x7f088c06a4c0 2023-06-09T04:37:27.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f088a7fc700 1 -- 172.21.15.149:0/507766903 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088400bb20 con 0x7f088c06a4c0 2023-06-09T04:37:27.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f088a7fc700 1 -- 172.21.15.149:0/507766903 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0884012430 con 0x7f088c06a4c0 2023-06-09T04:37:27.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 -- 172.21.15.149:0/507766903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c06a4c0 msgr2=0x7f088c0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 --2- 172.21.15.149:0/507766903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c06a4c0 0x7f088c0b06d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0884009d90 tx=0x7f088400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:27.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 -- 172.21.15.149:0/507766903 shutdown_connections 2023-06-09T04:37:27.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 --2- 172.21.15.149:0/507766903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c06a4c0 0x7f088c0b06d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 --2- 172.21.15.149:0/507766903 >> v2:172.21.15.184:3300/0 conn(0x7f088c15c590 0x7f088c0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 -- 172.21.15.149:0/507766903 >> 172.21.15.149:0/507766903 conn(0x7f088c06b7e0 msgr2=0x7f088c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:27.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 -- 172.21.15.149:0/507766903 shutdown_connections 2023-06-09T04:37:27.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.556+0000 7f0891b85700 1 -- 172.21.15.149:0/507766903 wait complete. 2023-06-09T04:37:27.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 Processor -- start 2023-06-09T04:37:27.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 -- start start 2023-06-09T04:37:27.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f088c06a4c0 0x7f088c0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c0ccba0 0x7f088c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c15c590 0x7f088c1f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0b3670 con 0x7f088c06a4c0 2023-06-09T04:37:27.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0c4880 con 0x7f088c15c590 2023-06-09T04:37:27.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.558+0000 7f0891b85700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0b38c0 con 0x7f088c0ccba0 2023-06-09T04:37:27.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f088c06a4c0 0x7f088c0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f088c06a4c0 0x7f088c0c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36998/0 (socket says 172.21.15.149:36998) 2023-06-09T04:37:27.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 -- 172.21.15.149:0/1113298475 learned_addr learned my addr 172.21.15.149:0/1113298475 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:27.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088affd700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c0ccba0 0x7f088c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088bfff700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c15c590 0x7f088c1f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 -- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c0ccba0 msgr2=0x7f088c0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c0ccba0 0x7f088c0c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 -- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c15c590 msgr2=0x7f088c1f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c15c590 0x7f088c1f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 -- 172.21.15.149:0/1113298475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884009a70 con 0x7f088c06a4c0 2023-06-09T04:37:27.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f088b7fe700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f088c06a4c0 0x7f088c0c5d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f088000e900 tx=0x7f088000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f0873fff700 1 -- 172.21.15.149:0/1113298475 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880013680 con 0x7f088c06a4c0 2023-06-09T04:37:27.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f0873fff700 1 -- 172.21.15.149:0/1113298475 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08800137e0 con 0x7f088c06a4c0 2023-06-09T04:37:27.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f0873fff700 1 -- 172.21.15.149:0/1113298475 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0880013b50 con 0x7f088c06a4c0 2023-06-09T04:37:27.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c0b3ba0 con 0x7f088c06a4c0 2023-06-09T04:37:27.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.559+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c0b4440 con 0x7f088c06a4c0 2023-06-09T04:37:27.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.560+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c0b4600 con 0x7f088c06a4c0 2023-06-09T04:37:27.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.561+0000 7f0873fff700 1 -- 172.21.15.149:0/1113298475 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0880013cb0 con 0x7f088c06a4c0 2023-06-09T04:37:27.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.561+0000 7f0873fff700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f087806ace0 0x7f087806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.561+0000 7f0873fff700 1 -- 172.21.15.149:0/1113298475 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08800899c0 con 0x7f088c06a4c0 2023-06-09T04:37:27.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.561+0000 7f088affd700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f087806ace0 0x7f087806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.561+0000 7f088affd700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f087806ace0 0x7f087806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c89b0 tx=0x7f087c007f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.565+0000 7f0873fff700 1 -- 172.21.15.149:0/1113298475 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0880054810 con 0x7f088c06a4c0 2023-06-09T04:37:27.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.796+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f088c073fa0 con 0x7f088c06a4c0 2023-06-09T04:37:27.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.796+0000 7f0873fff700 1 -- 172.21.15.149:0/1113298475 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f0880017090 con 0x7f088c06a4c0 2023-06-09T04:37:27.798 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:27.798 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:37:27.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f087806ace0 msgr2=0x7f087806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f087806ace0 0x7f087806d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f088c0c89b0 tx=0x7f087c007f10 comp rx=0 tx=0).stop 2023-06-09T04:37:27.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f088c06a4c0 msgr2=0x7f088c0c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f088c06a4c0 0x7f088c0c5d00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f088000e900 tx=0x7f088000ec10 comp rx=0 tx=0).stop 2023-06-09T04:37:27.800 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 shutdown_connections 2023-06-09T04:37:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f087806ace0 0x7f087806d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f088c15c590 0x7f088c1f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f088c06a4c0 0x7f088c0c5d00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 --2- 172.21.15.149:0/1113298475 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f088c0ccba0 0x7f088c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 >> 172.21.15.149:0/1113298475 conn(0x7f088c06b7e0 msgr2=0x7f088c0b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 shutdown_connections 2023-06-09T04:37:27.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.799+0000 7f0891b85700 1 -- 172.21.15.149:0/1113298475 wait complete. 2023-06-09T04:37:27.802 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:37:27.812 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.930+0000 7f8fc7446700 1 Processor -- start 2023-06-09T04:37:27.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.930+0000 7f8fc7446700 1 -- start start 2023-06-09T04:37:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.931+0000 7f8fc7446700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fc015c590 0x7f8fc00af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.931+0000 7f8fc7446700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00af050 con 0x7f8fc00ccba0 2023-06-09T04:37:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.931+0000 7f8fc7446700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00af800 con 0x7f8fc006a4c0 2023-06-09T04:37:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.931+0000 7f8fc7446700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00afae0 con 0x7f8fc015c590 2023-06-09T04:37:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.931+0000 7f8fc51e2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8fc015c590 0x7f8fc00af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.931+0000 7f8fc49e1700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8fc00ccba0 0x7f8fc0069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60870/0 (socket says 172.21.15.149:60870) 2023-06-09T04:37:27.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.931+0000 7f8fc49e1700 1 -- 172.21.15.149:0/4289259161 learned_addr learned my addr 172.21.15.149:0/4289259161 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.932+0000 7f8fc51e2700 1 -- 172.21.15.149:0/4289259161 >> v1:172.21.15.184:6789/0 conn(0x7f8fc006a4c0 legacy=0x7f8fc00ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:27.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.932+0000 7f8fc51e2700 1 -- 172.21.15.149:0/4289259161 >> v1:172.21.15.149:6789/0 conn(0x7f8fc00ccba0 legacy=0x7f8fc0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.932+0000 7f8fc51e2700 1 -- 172.21.15.149:0/4289259161 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00cc0c0 con 0x7f8fc015c590 2023-06-09T04:37:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.932+0000 7f8fc51e2700 1 --2- 172.21.15.149:0/4289259161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc015c590 0x7f8fc00af220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009820 tx=0x7f8fb0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d152aac9d2d552 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.932+0000 7f8fb7fff700 1 -- 172.21.15.149:0/4289259161 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0005e30 con 0x7f8fc015c590 2023-06-09T04:37:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.932+0000 7f8fb7fff700 1 -- 172.21.15.149:0/4289259161 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0004030 con 0x7f8fc015c590 2023-06-09T04:37:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.932+0000 7f8fb7fff700 1 -- 172.21.15.149:0/4289259161 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00043c0 con 0x7f8fc015c590 2023-06-09T04:37:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.933+0000 7f8fc7446700 1 -- 172.21.15.149:0/4289259161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc015c590 msgr2=0x7f8fc00af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.933+0000 7f8fc7446700 1 --2- 172.21.15.149:0/4289259161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc015c590 0x7f8fc00af220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009820 tx=0x7f8fb0009b30 comp rx=0 tx=0).stop 2023-06-09T04:37:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.933+0000 7f8fc7446700 1 -- 172.21.15.149:0/4289259161 shutdown_connections 2023-06-09T04:37:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.933+0000 7f8fc7446700 1 --2- 172.21.15.149:0/4289259161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc015c590 0x7f8fc00af220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.933+0000 7f8fc7446700 1 -- 172.21.15.149:0/4289259161 >> 172.21.15.149:0/4289259161 conn(0x7f8fc006b7e0 msgr2=0x7f8fc00cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.933+0000 7f8fc7446700 1 -- 172.21.15.149:0/4289259161 shutdown_connections 2023-06-09T04:37:27.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.933+0000 7f8fc7446700 1 -- 172.21.15.149:0/4289259161 wait complete. 2023-06-09T04:37:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.934+0000 7f8fc7446700 1 Processor -- start 2023-06-09T04:37:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.934+0000 7f8fc7446700 1 -- start start 2023-06-09T04:37:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc7446700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc006a4c0 0x7f8fc0155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc7446700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ccba0 0x7f8fc00b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc7446700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fc015c590 0x7f8fc00b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc7446700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b4610 con 0x7f8fc00ccba0 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc7446700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b3130 con 0x7f8fc006a4c0 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc7446700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00b3410 con 0x7f8fc015c590 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ccba0 0x7f8fc00b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ccba0 0x7f8fc00b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37012/0 (socket says 172.21.15.149:37012) 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 -- 172.21.15.149:0/125814480 learned_addr learned my addr 172.21.15.149:0/125814480 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc51e2700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc006a4c0 0x7f8fc0155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc59e3700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fc015c590 0x7f8fc00b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 -- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fc015c590 msgr2=0x7f8fc00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fc015c590 0x7f8fc00b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 -- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc006a4c0 msgr2=0x7f8fc0155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc006a4c0 0x7f8fc0155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 -- 172.21.15.149:0/125814480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0009430 con 0x7f8fc00ccba0 2023-06-09T04:37:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc51e2700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc006a4c0 0x7f8fc0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:27.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc49e1700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ccba0 0x7f8fc00b4df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c490 tx=0x7f8fbc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fb5ffb700 1 -- 172.21.15.149:0/125814480 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc005d70 con 0x7f8fc00ccba0 2023-06-09T04:37:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fb5ffb700 1 -- 172.21.15.149:0/125814480 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc0070d0 con 0x7f8fc00ccba0 2023-06-09T04:37:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc00b36f0 con 0x7f8fc00ccba0 2023-06-09T04:37:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.935+0000 7f8fb5ffb700 1 -- 172.21.15.149:0/125814480 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc007460 con 0x7f8fc00ccba0 2023-06-09T04:37:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.936+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc0155e40 con 0x7f8fc00ccba0 2023-06-09T04:37:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.937+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc00b4b10 con 0x7f8fc00ccba0 2023-06-09T04:37:27.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.937+0000 7f8fb5ffb700 1 -- 172.21.15.149:0/125814480 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fbc0075c0 con 0x7f8fc00ccba0 2023-06-09T04:37:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.937+0000 7f8fb5ffb700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8fa406ad10 0x7f8fa406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.937+0000 7f8fb5ffb700 1 -- 172.21.15.149:0/125814480 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fbc088ca0 con 0x7f8fc00ccba0 2023-06-09T04:37:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.937+0000 7f8fc51e2700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8fa406ad10 0x7f8fa406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:27.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.938+0000 7f8fc51e2700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8fa406ad10 0x7f8fa406d1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0000c00 tx=0x7f8fb0008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:27.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:27.942+0000 7f8fb5ffb700 1 -- 172.21.15.149:0/125814480 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8fbc053a60 con 0x7f8fc00ccba0 2023-06-09T04:37:28.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.127+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fc0073fa0 con 0x7f8fc00ccba0 2023-06-09T04:37:28.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.128+0000 7f8fb5ffb700 1 -- 172.21.15.149:0/125814480 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f8fbc017090 con 0x7f8fc00ccba0 2023-06-09T04:37:28.130 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:28.130 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:28.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8fa406ad10 msgr2=0x7f8fa406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8fa406ad10 0x7f8fa406d1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0000c00 tx=0x7f8fb0008070 comp rx=0 tx=0).stop 2023-06-09T04:37:28.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ccba0 msgr2=0x7f8fc00b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ccba0 0x7f8fc00b4df0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00c490 tx=0x7f8fbc00c850 comp rx=0 tx=0).stop 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 shutdown_connections 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8fa406ad10 0x7f8fa406d1c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8fc015c590 0x7f8fc00b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8fc006a4c0 0x7f8fc0155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 --2- 172.21.15.149:0/125814480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8fc00ccba0 0x7f8fc00b4df0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 >> 172.21.15.149:0/125814480 conn(0x7f8fc006b7e0 msgr2=0x7f8fc00ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.130+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 shutdown_connections 2023-06-09T04:37:28.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.131+0000 7f8fc7446700 1 -- 172.21.15.149:0/125814480 wait complete. 2023-06-09T04:37:28.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:37:28.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.263+0000 7f6a7d6e6700 1 Processor -- start 2023-06-09T04:37:28.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.263+0000 7f6a7d6e6700 1 -- start start 2023-06-09T04:37:28.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a7d6e6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6a7806aec0 0x7f6a7806b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a7d6e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 0x7f6a780cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a7d6e6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7806b7d0 con 0x7f6a780cd0c0 2023-06-09T04:37:28.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a7d6e6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a780d0fd0 con 0x7f6a7806aec0 2023-06-09T04:37:28.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a7d6e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780d0350 con 0x7f6a780ce510 2023-06-09T04:37:28.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a777fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6a780cd0c0 0x7f6a780cd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60886/0 (socket says 172.21.15.149:60886) 2023-06-09T04:37:28.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a777fe700 1 -- 172.21.15.149:0/1871160189 learned_addr learned my addr 172.21.15.149:0/1871160189 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:28.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a76ffd700 1 --2- 172.21.15.149:0/1871160189 >> v2:172.21.15.184:3300/0 conn(0x7f6a7806aec0 0x7f6a7806b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a767fc700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 0x7f6a780cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371857903 0 0) 0x7f6a7806b7d0 con 0x7f6a780cd0c0 2023-06-09T04:37:28.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a600035b0 con 0x7f6a780cd0c0 2023-06-09T04:37:28.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314447869 0 0) 0x7f6a600035b0 con 0x7f6a780cd0c0 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 msgr2=0x7f6a780cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 0x7f6a780cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 >> v2:172.21.15.184:3300/0 conn(0x7f6a7806aec0 msgr2=0x7f6a7806b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 --2- 172.21.15.149:0/1871160189 >> v2:172.21.15.184:3300/0 conn(0x7f6a7806aec0 0x7f6a7806b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780d0630 con 0x7f6a780cd0c0 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.264+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f6a700019f0 con 0x7f6a780cd0c0 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 >> v1:172.21.15.149:6789/0 conn(0x7f6a780cd0c0 legacy=0x7f6a780cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60003a00 0x7f6a60003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a60004430 0x7f6a600048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 0x7f6a60004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780d0fd0 con 0x7f6a60004430 2023-06-09T04:37:28.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a780d0350 con 0x7f6a60003a00 2023-06-09T04:37:28.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6000ba10 con 0x7f6a780ce510 2023-06-09T04:37:28.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a767fc700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a60004430 0x7f6a600048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a76ffd700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60003a00 0x7f6a60003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a777fe700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 0x7f6a60004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a767fc700 1 -- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 msgr2=0x7f6a60004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a767fc700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a780ce510 0x7f6a60004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a767fc700 1 -- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60003a00 msgr2=0x7f6a60003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a767fc700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60003a00 0x7f6a60003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a767fc700 1 -- 172.21.15.149:0/1871160189 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600035b0 con 0x7f6a60004430 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a767fc700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a60004430 0x7f6a600048f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009b60 tx=0x7f6a60005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c791ebbadbd1f09b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:28.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800e6c0 con 0x7f6a60004430 2023-06-09T04:37:28.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6800e820 con 0x7f6a60004430 2023-06-09T04:37:28.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.265+0000 7f6a75ffb700 1 -- 172.21.15.149:0/1871160189 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800eb90 con 0x7f6a60004430 2023-06-09T04:37:28.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.266+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/1871160189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a60004430 msgr2=0x7f6a600048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.266+0000 7f6a7d6e6700 1 --2- 172.21.15.149:0/1871160189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a60004430 0x7f6a600048f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6a68009b60 tx=0x7f6a60005880 comp rx=0 tx=0).stop 2023-06-09T04:37:28.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.266+0000 7f6a777fe700 1 -- 172.21.15.149:0/1871160189 reap_dead start 2023-06-09T04:37:28.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.266+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/1871160189 shutdown_connections 2023-06-09T04:37:28.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.266+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/1871160189 >> 172.21.15.149:0/1871160189 conn(0x7f6a7806a6d0 msgr2=0x7f6a78099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:28.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.266+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/1871160189 shutdown_connections 2023-06-09T04:37:28.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.266+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/1871160189 wait complete. 2023-06-09T04:37:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.268+0000 7f6a7d6e6700 1 Processor -- start 2023-06-09T04:37:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.268+0000 7f6a7d6e6700 1 -- start start 2023-06-09T04:37:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60004430 0x7f6a7814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a780b5e80 0x7f6a781e2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a781f5a20 0x7f6a7814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a781f5600 con 0x7f6a780b5e80 2023-06-09T04:37:28.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7814b450 con 0x7f6a60004430 2023-06-09T04:37:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7814e810 con 0x7f6a781f5a20 2023-06-09T04:37:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a780b5e80 0x7f6a781e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a780b5e80 0x7f6a781e2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37032/0 (socket says 172.21.15.149:37032) 2023-06-09T04:37:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 -- 172.21.15.149:0/2525882568 learned_addr learned my addr 172.21.15.149:0/2525882568 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a76ffd700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60004430 0x7f6a7814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a777fe700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a781f5a20 0x7f6a7814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 -- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a781f5a20 msgr2=0x7f6a7814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a781f5a20 0x7f6a7814d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 -- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60004430 msgr2=0x7f6a7814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60004430 0x7f6a7814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 -- 172.21.15.149:0/2525882568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780b6350 con 0x7f6a780b5e80 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a767fc700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a780b5e80 0x7f6a781e2900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6a68000c00 tx=0x7f6a680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/2525882568 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68021070 con 0x7f6a780b5e80 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/2525882568 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a680036a0 con 0x7f6a780b5e80 2023-06-09T04:37:28.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a781f4f40 con 0x7f6a780b5e80 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/2525882568 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800e6c0 con 0x7f6a780b5e80 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.269+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a781e2e40 con 0x7f6a780b5e80 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.270+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a781f4da0 con 0x7f6a780b5e80 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.271+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/2525882568 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a68025070 con 0x7f6a780b5e80 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.271+0000 7f6a5f7fe700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6a6406ace0 0x7f6a6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.272+0000 7f6a76ffd700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6a6406ace0 0x7f6a6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.272+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/2525882568 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a6808a8f0 con 0x7f6a780b5e80 2023-06-09T04:37:28.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.272+0000 7f6a76ffd700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6a6406ace0 0x7f6a6406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009ce0 tx=0x7f6a6c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:28.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.276+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/2525882568 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a781f4da0 con 0x7f6a780b5e80 2023-06-09T04:37:28.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:28.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:28.511 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.510+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a781f4da0 con 0x7f6a780b5e80 2023-06-09T04:37:28.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.511+0000 7f6a5f7fe700 1 -- 172.21.15.149:0/2525882568 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f6a781f4da0 con 0x7f6a780b5e80 2023-06-09T04:37:28.512 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:28.512 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:37:28.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6a6406ace0 msgr2=0x7f6a6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6a6406ace0 0x7f6a6406d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c009ce0 tx=0x7f6a6c009210 comp rx=0 tx=0).stop 2023-06-09T04:37:28.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a780b5e80 msgr2=0x7f6a781e2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:28.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a780b5e80 0x7f6a781e2900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6a68000c00 tx=0x7f6a680047c0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 shutdown_connections 2023-06-09T04:37:28.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6a6406ace0 0x7f6a6406d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6a781f5a20 0x7f6a7814d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a60004430 0x7f6a7814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 --2- 172.21.15.149:0/2525882568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a780b5e80 0x7f6a781e2900 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:28.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 >> 172.21.15.149:0/2525882568 conn(0x7f6a7806a6d0 msgr2=0x7f6a780cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:28.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 shutdown_connections 2023-06-09T04:37:28.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:28.513+0000 7f6a7d6e6700 1 -- 172.21.15.149:0/2525882568 wait complete. 2023-06-09T04:37:28.516 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:37:28.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:36:53.063490+0000', 'modified': '2023-06-09T04:37:15.514379+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4270}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4270': {'gid': 4270, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6833/1611193931', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 1611193931}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 1611193931}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:37:28.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:37:28.930 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-09T04:37:29.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.052+0000 7fa9956af700 1 Processor -- start 2023-06-09T04:37:29.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.052+0000 7fa9956af700 1 -- start start 2023-06-09T04:37:29.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa9956af700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa99015d7f0 0x7fa9900711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa9956af700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa990069db0 0x7fa99006a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa9956af700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9900ccf00 con 0x7fa9900cca40 2023-06-09T04:37:29.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa9956af700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9900720f0 con 0x7fa990069db0 2023-06-09T04:37:29.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa9956af700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99006a730 con 0x7fa99015d7f0 2023-06-09T04:37:29.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98e7fc700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fa9900cca40 0x7fa9900cb650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60902/0 (socket says 172.21.15.149:60902) 2023-06-09T04:37:29.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98f7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fa990069db0 0x7fa99006a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98e7fc700 1 -- 172.21.15.149:0/1223361908 learned_addr learned my addr 172.21.15.149:0/1223361908 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:29.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98effd700 1 --2- 172.21.15.149:0/1223361908 >> v2:172.21.15.184:3300/0 conn(0x7fa99015d7f0 0x7fa9900711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98f7fe700 1 -- 172.21.15.149:0/1223361908 >> v2:172.21.15.184:3300/0 conn(0x7fa99015d7f0 msgr2=0x7fa9900711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/1223361908 >> v2:172.21.15.184:3300/0 conn(0x7fa99015d7f0 0x7fa9900711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98f7fe700 1 -- 172.21.15.149:0/1223361908 >> v1:172.21.15.149:6789/0 conn(0x7fa9900cca40 legacy=0x7fa9900cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98f7fe700 1 -- 172.21.15.149:0/1223361908 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99015dbc0 con 0x7fa990069db0 2023-06-09T04:37:29.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98dffb700 1 -- 172.21.15.149:0/1223361908 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125691503 0 0) 0x7fa9900ccf00 con 0x7fa9900cca40 2023-06-09T04:37:29.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98effd700 1 --2- 172.21.15.149:0/1223361908 >> v2:172.21.15.184:3300/0 conn(0x7fa99015d7f0 0x7fa9900711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:29.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/1223361908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa99006a1f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa990070ca0 tx=0x7fa98800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543956f8b015ebf8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98dffb700 1 -- 172.21.15.149:0/1223361908 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800e070 con 0x7fa990069db0 2023-06-09T04:37:29.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98dffb700 1 -- 172.21.15.149:0/1223361908 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98800bbd0 con 0x7fa990069db0 2023-06-09T04:37:29.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.053+0000 7fa98dffb700 1 -- 172.21.15.149:0/1223361908 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988012430 con 0x7fa990069db0 2023-06-09T04:37:29.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 -- 172.21.15.149:0/1223361908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 msgr2=0x7fa99006a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 --2- 172.21.15.149:0/1223361908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa99006a1f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa990070ca0 tx=0x7fa98800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:29.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 -- 172.21.15.149:0/1223361908 shutdown_connections 2023-06-09T04:37:29.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 --2- 172.21.15.149:0/1223361908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa99006a1f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 --2- 172.21.15.149:0/1223361908 >> v2:172.21.15.184:3300/0 conn(0x7fa99015d7f0 0x7fa9900711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 -- 172.21.15.149:0/1223361908 >> 172.21.15.149:0/1223361908 conn(0x7fa99006aec0 msgr2=0x7fa99006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:29.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 -- 172.21.15.149:0/1223361908 shutdown_connections 2023-06-09T04:37:29.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.054+0000 7fa9956af700 1 -- 172.21.15.149:0/1223361908 wait complete. 2023-06-09T04:37:29.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.055+0000 7fa9956af700 1 Processor -- start 2023-06-09T04:37:29.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.055+0000 7fa9956af700 1 -- start start 2023-06-09T04:37:29.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa9956af700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa9901f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa9956af700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9900cca40 0x7fa9900a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa9956af700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99015d7f0 0x7fa9900c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa9956af700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901f3f20 con 0x7fa990069db0 2023-06-09T04:37:29.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa9956af700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901f3680 con 0x7fa9900cca40 2023-06-09T04:37:29.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa9956af700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901f3960 con 0x7fa99015d7f0 2023-06-09T04:37:29.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa98effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa9901f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa98effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa9901f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37042/0 (socket says 172.21.15.149:37042) 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa98effd700 1 -- 172.21.15.149:0/2409130199 learned_addr learned my addr 172.21.15.149:0/2409130199 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9900cca40 0x7fa9900a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.056+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99015d7f0 0x7fa9900c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa98effd700 1 -- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99015d7f0 msgr2=0x7fa9900c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa98effd700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99015d7f0 0x7fa9900c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa98effd700 1 -- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9900cca40 msgr2=0x7fa9900a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa98effd700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9900cca40 0x7fa9900a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa98effd700 1 -- 172.21.15.149:0/2409130199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988009a70 con 0x7fa990069db0 2023-06-09T04:37:29.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa98effd700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa9901f30a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa98000e810 tx=0x7fa98000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa9777fe700 1 -- 172.21.15.149:0/2409130199 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980013610 con 0x7fa990069db0 2023-06-09T04:37:29.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa9777fe700 1 -- 172.21.15.149:0/2409130199 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980013770 con 0x7fa990069db0 2023-06-09T04:37:29.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9901f3c40 con 0x7fa990069db0 2023-06-09T04:37:29.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa9777fe700 1 -- 172.21.15.149:0/2409130199 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980013b20 con 0x7fa990069db0 2023-06-09T04:37:29.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.057+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9900a9340 con 0x7fa990069db0 2023-06-09T04:37:29.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.059+0000 7fa9777fe700 1 -- 172.21.15.149:0/2409130199 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa980013c80 con 0x7fa990069db0 2023-06-09T04:37:29.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.059+0000 7fa9777fe700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa97c06ace0 0x7fa97c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.059+0000 7fa9777fe700 1 -- 172.21.15.149:0/2409130199 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa980089280 con 0x7fa990069db0 2023-06-09T04:37:29.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.059+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa97c06ace0 0x7fa97c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.060+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa97c06ace0 0x7fa97c06d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa99015bfd0 tx=0x7fa984007de0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.061+0000 7fa9a1834b80 1 Processor -- start 2023-06-09T04:37:29.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.061+0000 7fa9a1834b80 1 -- start start 2023-06-09T04:37:29.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd6c0 0x55a2748fdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a274946c70 0x55a2749470e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2748033b0 con 0x55a2748fd2f0 2023-06-09T04:37:29.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a274804c60 con 0x55a274946c70 2023-06-09T04:37:29.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a274857570 con 0x55a2748fd6c0 2023-06-09T04:37:29.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37050/0 (socket says 172.21.15.149:37050) 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 -- 172.21.15.149:0/2548939292 learned_addr learned my addr 172.21.15.149:0/2548939292 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd6c0 0x55a2748fdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a274946c70 0x55a2749470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 -- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd6c0 msgr2=0x55a2748fdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd6c0 0x55a2748fdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 -- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a274946c70 msgr2=0x55a2749470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a274946c70 0x55a2749470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 -- 172.21.15.149:0/2548939292 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a27467ed90 con 0x55a2748fd2f0 2023-06-09T04:37:29.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.062+0000 7fa98effd700 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa980054290 tx=0x7fa98005be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c98369927f5519 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa974ff9700 1 -- 172.21.15.149:0/2548939292 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980056130 con 0x55a2748fd2f0 2023-06-09T04:37:29.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa974ff9700 1 -- 172.21.15.149:0/2548939292 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98005fc50 con 0x55a2748fd2f0 2023-06-09T04:37:29.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa974ff9700 1 -- 172.21.15.149:0/2548939292 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980053b80 con 0x55a2748fd2f0 2023-06-09T04:37:29.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2548939292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 msgr2=0x55a2748f9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9310 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa980054290 tx=0x7fa98005be20 comp rx=0 tx=0).stop 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2548939292 shutdown_connections 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a274946c70 0x55a2749470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9310 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2548939292 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd6c0 0x55a2748fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2548939292 >> 172.21.15.149:0/2548939292 conn(0x55a2748fbce0 msgr2=0x55a2749444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2548939292 shutdown_connections 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.063+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2548939292 wait complete. 2023-06-09T04:37:29.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.064+0000 7fa9a1834b80 1 -- start start 2023-06-09T04:37:29.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.064+0000 7fa9a1834b80 1 Processor -- start 2023-06-09T04:37:29.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.065+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.065+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a27492c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.065+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a274946c70 0x55a27492b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.065+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a274850a00 con 0x55a2748fd2f0 2023-06-09T04:37:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.065+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2747f0a70 con 0x55a2748fd6c0 2023-06-09T04:37:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.065+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2747f0770 con 0x55a274946c70 2023-06-09T04:37:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa9a1834b80 10 client.0 _ll_register_callbacks cb 0x55a2747ee630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:37:29.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37056/0 (socket says 172.21.15.149:37056) 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 -- 172.21.15.149:0/1402650530 learned_addr learned my addr 172.21.15.149:0/1402650530 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a274946c70 0x55a27492b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a27492c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 -- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a274946c70 msgr2=0x55a27492b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a274946c70 0x55a27492b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 -- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 msgr2=0x55a27492c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a27492c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 -- 172.21.15.149:0/1402650530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9900a9340 con 0x55a2748fd2f0 2023-06-09T04:37:29.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a27492c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:29.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a274946c70 0x55a27492b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:29.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa98effd700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa980054290 tx=0x7fa980000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317865136886e82e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa96dffb700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-06-09T04:37:29.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa96dffb700 1 -- 172.21.15.149:0/1402650530 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980056ef0 con 0x55a2748fd2f0 2023-06-09T04:37:29.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa96dffb700 1 -- 172.21.15.149:0/1402650530 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9800561f0 con 0x55a2748fd2f0 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2748f1850 con 0x55a2748fd2f0 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa96dffb700 1 -- 172.21.15.149:0/1402650530 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa980057050 con 0x55a2748fd2f0 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa9a1834b80 10 client.4827 fetch_fsmap learned FSMap version 9 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55a274667c10 con 0x55a2748fd2f0 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa96dffb700 1 -- 172.21.15.149:0/1402650530 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a2748f1850 con 0x55a2748fd2f0 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa96dffb700 1 -- 172.21.15.149:0/1402650530 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa980076ab0 con 0x55a2748fd2f0 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.066+0000 7fa9a1834b80 10 client.4827 fetch_fsmap finished waiting for FSMap version 9 2023-06-09T04:37:29.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa9a1834b80 10 client.4827 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:37:29.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa9a1834b80 20 client.4827 populate_metadata read hostname 'smithi149' 2023-06-09T04:37:29.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a27493fcc0 0x55a274920df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa9a1834b80 4 client.4827 mds_command: new command op to 4270 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:37:29.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 --> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2748499e0 con 0x55a27493fcc0 2023-06-09T04:37:29.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a27493fcc0 0x55a274920df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa96dffb700 10 client.4827 ms_handle_connect on v2:172.21.15.184:6832/1611193931 2023-06-09T04:37:29.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.067+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a27493fcc0 0x55a274920df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121071f4231120b6 server_cookie=4a362948aac95b2d in_seq=0 out_seq=0 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa96dffb700 1 -- 172.21.15.149:0/1402650530 <== mds.0 v2:172.21.15.184:6832/1611193931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a2748499e0 con 0x55a27493fcc0 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa96dffb700 10 client.4827 handle_command_reply: tid=0 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 client.4827 shutdown 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 msgr2=0x55a2748f9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9620 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa980054290 tx=0x7fa980000bc0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 shutdown_connections 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a27493fcc0 0x55a274920df0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a274946c70 0x55a27492b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a2748fd2f0 0x55a2748f9620 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa96dffb700 0 client.4827 ms_handle_reset on v2:172.21.15.184:6832/1611193931 2023-06-09T04:37:29.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/1402650530 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a27492c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 >> 172.21.15.149:0/1402650530 conn(0x55a2748fbce0 msgr2=0x55a274944420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:29.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 shutdown_connections 2023-06-09T04:37:29.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 1 -- 172.21.15.149:0/1402650530 wait complete. 2023-06-09T04:37:29.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.068+0000 7fa9a1834b80 20 client.4827 trim_cache size 0 max 16384 2023-06-09T04:37:29.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.086+0000 7fa9a1834b80 1 Processor -- start 2023-06-09T04:37:29.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.086+0000 7fa9a1834b80 1 -- start start 2023-06-09T04:37:29.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a274945090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2748fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a2748fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2746d48d0 con 0x55a274946c70 2023-06-09T04:37:29.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2748fc650 con 0x55a2748fd6c0 2023-06-09T04:37:29.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a274926710 con 0x55a2748fd2f0 2023-06-09T04:37:29.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a2748fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a2748fb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37068/0 (socket says 172.21.15.149:37068) 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2344259512 learned_addr learned my addr 172.21.15.149:0/2344259512 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2344259512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 msgr2=0x55a274945090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2748fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a274945090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2344259512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 msgr2=0x55a2748fca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2748fca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2344259512 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2746a5200 con 0x55a274946c70 2023-06-09T04:37:29.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a2748fb6d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9900cd1d0 tx=0x7fa988011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a4f1227f161824 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9757fa700 1 -- 172.21.15.149:0/2344259512 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98802b070 con 0x55a274946c70 2023-06-09T04:37:29.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9757fa700 1 -- 172.21.15.149:0/2344259512 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988003b20 con 0x55a274946c70 2023-06-09T04:37:29.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.087+0000 7fa9757fa700 1 -- 172.21.15.149:0/2344259512 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988021040 con 0x55a274946c70 2023-06-09T04:37:29.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2344259512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 msgr2=0x55a2748fb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a2748fb6d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9900cd1d0 tx=0x7fa988011000 comp rx=0 tx=0).stop 2023-06-09T04:37:29.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2344259512 shutdown_connections 2023-06-09T04:37:29.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a274945090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a2748fb6d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2344259512 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2748fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2344259512 >> 172.21.15.149:0/2344259512 conn(0x55a2748fbce0 msgr2=0x55a274966790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:29.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2344259512 shutdown_connections 2023-06-09T04:37:29.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2344259512 wait complete. 2023-06-09T04:37:29.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.088+0000 7fa9a1834b80 1 -- start start 2023-06-09T04:37:29.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 1 Processor -- start 2023-06-09T04:37:29.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a2748f9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2749ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a274920e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2749aef20 con 0x55a274946c70 2023-06-09T04:37:29.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27495e230 con 0x55a2748fd6c0 2023-06-09T04:37:29.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a2748fe540 con 0x55a2748fd2f0 2023-06-09T04:37:29.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa9a1834b80 10 client.0 _ll_register_callbacks cb 0x55a2747ee630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:37:29.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa98f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a274920e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa98f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a274920e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37074/0 (socket says 172.21.15.149:37074) 2023-06-09T04:37:29.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.089+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2415919861 learned_addr learned my addr 172.21.15.149:0/2415919861 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:29.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98effd700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a2748f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98e7fc700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2749ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 msgr2=0x55a2748f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a2748f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 msgr2=0x55a2749ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2749ae9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98f7fe700 1 -- 172.21.15.149:0/2415919861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99015dbc0 con 0x55a274946c70 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98effd700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a2748f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa98f7fe700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a274920e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa988014040 tx=0x7fa988004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38ca89f60f7b28 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa96dffb700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-06-09T04:37:29.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa96dffb700 1 -- 172.21.15.149:0/2415919861 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98802b040 con 0x55a274946c70 2023-06-09T04:37:29.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa96dffb700 1 -- 172.21.15.149:0/2415919861 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa988032660 con 0x55a274946c70 2023-06-09T04:37:29.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a274929a70 con 0x55a274946c70 2023-06-09T04:37:29.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa96dffb700 1 -- 172.21.15.149:0/2415919861 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa988032820 con 0x55a274946c70 2023-06-09T04:37:29.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 10 client.4833 fetch_fsmap learned FSMap version 9 2023-06-09T04:37:29.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55a27467d260 con 0x55a274946c70 2023-06-09T04:37:29.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa96dffb700 1 -- 172.21.15.149:0/2415919861 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a274929a70 con 0x55a274946c70 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa96dffb700 1 -- 172.21.15.149:0/2415919861 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa988024030 con 0x55a274946c70 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 10 client.4833 fetch_fsmap finished waiting for FSMap version 9 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 10 client.4833 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 20 client.4833 populate_metadata read hostname 'smithi149' 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a274921580 0x55a27495d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 4 client.4833 mds_command: new command op to 4270 tid=0[{"prefix": "status"}] 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.090+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 --> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fa98005fc50 con 0x55a274921580 2023-06-09T04:37:29.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa98effd700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a274921580 0x55a27495d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa96dffb700 10 client.4833 ms_handle_connect on v2:172.21.15.184:6832/1611193931 2023-06-09T04:37:29.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa98effd700 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a274921580 0x55a27495d2e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea003d1743582fcf server_cookie=77fbaac0f721e21b in_seq=0 out_seq=0 2023-06-09T04:37:29.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa96dffb700 1 -- 172.21.15.149:0/2415919861 <== mds.0 v2:172.21.15.184:6832/1611193931 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7fa98005fc50 con 0x55a274921580 2023-06-09T04:37:29.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa96dffb700 10 client.4833 handle_command_reply: tid=0 2023-06-09T04:37:29.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 client.4833 shutdown 2023-06-09T04:37:29.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 msgr2=0x55a274920e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a274920e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa988014040 tx=0x7fa988004b40 comp rx=0 tx=0).stop 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 shutdown_connections 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:6832/1611193931,v1:172.21.15.184:6833/1611193931] conn(0x55a274921580 0x55a27495d2e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x55a2748fd2f0 0x55a2748f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a274946c70 0x55a274920e50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa96dffb700 0 client.4833 ms_handle_reset on v2:172.21.15.184:6832/1611193931 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 --2- 172.21.15.149:0/2415919861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a2748fd6c0 0x55a2749ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 >> 172.21.15.149:0/2415919861 conn(0x55a2748fbce0 msgr2=0x55a274944d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:29.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 shutdown_connections 2023-06-09T04:37:29.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 1 -- 172.21.15.149:0/2415919861 wait complete. 2023-06-09T04:37:29.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.091+0000 7fa9a1834b80 20 client.4833 trim_cache size 0 max 16384 2023-06-09T04:37:29.103 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-06-09T04:37:29.103 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "8958df92-450c-4c1c-8166-a5a3573afffd", 2023-06-09T04:37:29.103 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-06-09T04:37:29.103 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 4270, 2023-06-09T04:37:29.104 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-06-09T04:37:29.104 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-06-09T04:37:29.104 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-06-09T04:37:29.104 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 36.026562843000001, 2023-06-09T04:37:29.104 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 9, 2023-06-09T04:37:29.104 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 26, 2023-06-09T04:37:29.104 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 26, 2023-06-09T04:37:29.105 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 41.363396504000001 2023-06-09T04:37:29.105 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-06-09T04:37:29.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa97c06ace0 msgr2=0x7fa97c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa97c06ace0 0x7fa97c06d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa99015bfd0 tx=0x7fa984007de0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 msgr2=0x7fa9901f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa9901f30a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa98000e810 tx=0x7fa98000eb20 comp rx=0 tx=0).stop 2023-06-09T04:37:29.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 shutdown_connections 2023-06-09T04:37:29.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fa97c06ace0 0x7fa97c06d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fa99015d7f0 0x7fa9900c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa990069db0 0x7fa9901f30a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 --2- 172.21.15.149:0/2409130199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9900cca40 0x7fa9900a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 >> 172.21.15.149:0/2409130199 conn(0x7fa99006aec0 msgr2=0x7fa99015c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:29.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 shutdown_connections 2023-06-09T04:37:29.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.092+0000 7fa9956af700 1 -- 172.21.15.149:0/2409130199 wait complete. 2023-06-09T04:37:29.108 INFO:teuthology.run_tasks:Running task kclient... 2023-06-09T04:37:29.121 INFO:tasks.kclient:Mounting kernel clients... 2023-06-09T04:37:29.121 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-09T04:37:29.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.122 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-06-09T04:37:29.137 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-09T04:37:29.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.138 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-09T04:37:29.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.217 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-06-09T04:37:29.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.333 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-06-09T04:37:29.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link delete ceph-brx 2023-06-09T04:37:29.419 INFO:teuthology.orchestra.run.smithi149.stderr:Cannot find device "ceph-brx" 2023-06-09T04:37:29.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:29.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.421 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-06-09T04:37:29.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-06-09T04:37:29.516 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-06-09T04:37:29.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:29.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.518 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-06-09T04:37:29.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:29.577 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2023-06-09T04:37:29.648 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2023-06-09T04:37:29.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:37:29.650 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-06-09T04:37:29.650 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:37:29.651 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:37:29.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:37:29.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.772+0000 7fb41e063700 1 Processor -- start 2023-06-09T04:37:29.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.773+0000 7fb41e063700 1 -- start start 2023-06-09T04:37:29.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.773+0000 7fb41e063700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb418158840 0x7fb4180c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.773+0000 7fb41e063700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180c8ba0 con 0x7fb4180cebf0 2023-06-09T04:37:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.773+0000 7fb41e063700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180c8e80 con 0x7fb4180701b0 2023-06-09T04:37:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.773+0000 7fb41e063700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4180c9160 con 0x7fb418158840 2023-06-09T04:37:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4177fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb418158840 0x7fb4180c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb417fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb4180cebf0 0x7fb4180cd360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60942/0 (socket says 172.21.15.149:60942) 2023-06-09T04:37:29.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb417fff700 1 -- 172.21.15.149:0/2520438992 learned_addr learned my addr 172.21.15.149:0/2520438992 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:29.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4177fe700 1 -- 172.21.15.149:0/2520438992 >> v1:172.21.15.184:6789/0 conn(0x7fb4180701b0 legacy=0x7fb4180ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4177fe700 1 -- 172.21.15.149:0/2520438992 >> v1:172.21.15.149:6789/0 conn(0x7fb4180cebf0 legacy=0x7fb4180cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4177fe700 1 -- 172.21.15.149:0/2520438992 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180ccb60 con 0x7fb418158840 2023-06-09T04:37:29.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4177fe700 1 --2- 172.21.15.149:0/2520438992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb418158840 0x7fb4180c9570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb408009840 tx=0x7fb408009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555db29d9f7d9830 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4167fc700 1 -- 172.21.15.149:0/2520438992 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408011830 con 0x7fb418158840 2023-06-09T04:37:29.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4167fc700 1 -- 172.21.15.149:0/2520438992 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb408011990 con 0x7fb418158840 2023-06-09T04:37:29.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.774+0000 7fb4167fc700 1 -- 172.21.15.149:0/2520438992 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408011d20 con 0x7fb418158840 2023-06-09T04:37:29.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.775+0000 7fb41e063700 1 -- 172.21.15.149:0/2520438992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb418158840 msgr2=0x7fb4180c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.775+0000 7fb41e063700 1 --2- 172.21.15.149:0/2520438992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb418158840 0x7fb4180c9570 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb408009840 tx=0x7fb408009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:29.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.775+0000 7fb41e063700 1 -- 172.21.15.149:0/2520438992 shutdown_connections 2023-06-09T04:37:29.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.775+0000 7fb41e063700 1 --2- 172.21.15.149:0/2520438992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb418158840 0x7fb4180c9570 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.775+0000 7fb41e063700 1 -- 172.21.15.149:0/2520438992 >> 172.21.15.149:0/2520438992 conn(0x7fb41806aa40 msgr2=0x7fb4180b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:29.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.775+0000 7fb41e063700 1 -- 172.21.15.149:0/2520438992 shutdown_connections 2023-06-09T04:37:29.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.775+0000 7fb41e063700 1 -- 172.21.15.149:0/2520438992 wait complete. 2023-06-09T04:37:29.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.776+0000 7fb41e063700 1 Processor -- start 2023-06-09T04:37:29.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.777+0000 7fb41e063700 1 -- start start 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4180701b0 0x7fb4180c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4180cebf0 0x7fb4180c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb418158840 0x7fb4180c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b1960 con 0x7fb4180cebf0 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b1c40 con 0x7fb4180701b0 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b1f20 con 0x7fb418158840 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4180cebf0 0x7fb4180c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4180cebf0 0x7fb4180c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37084/0 (socket says 172.21.15.149:37084) 2023-06-09T04:37:29.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 -- 172.21.15.149:0/2291432824 learned_addr learned my addr 172.21.15.149:0/2291432824 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:29.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb417fff700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb418158840 0x7fb4180c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb4177fe700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4180701b0 0x7fb4180c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 -- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb418158840 msgr2=0x7fb4180c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb418158840 0x7fb4180c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 -- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4180701b0 msgr2=0x7fb4180c1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:29.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4180701b0 0x7fb4180c1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 -- 172.21.15.149:0/2291432824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080094a0 con 0x7fb4180cebf0 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb416ffd700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4180cebf0 0x7fb4180c93a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c4b0 tx=0x7fb40000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb40ffff700 1 -- 172.21.15.149:0/2291432824 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000052d0 con 0x7fb4180cebf0 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb40ffff700 1 -- 172.21.15.149:0/2291432824 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400005430 con 0x7fb4180cebf0 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb40ffff700 1 -- 172.21.15.149:0/2291432824 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000038c0 con 0x7fb4180cebf0 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180b2200 con 0x7fb4180cebf0 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.778+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41814c3b0 con 0x7fb4180cebf0 2023-06-09T04:37:29.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.779+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4180c6b60 con 0x7fb4180cebf0 2023-06-09T04:37:29.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.780+0000 7fb40ffff700 1 -- 172.21.15.149:0/2291432824 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb400003a20 con 0x7fb4180cebf0 2023-06-09T04:37:29.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.780+0000 7fb40ffff700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3f806ace0 0x7fb3f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:29.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.780+0000 7fb40ffff700 1 -- 172.21.15.149:0/2291432824 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb400088b40 con 0x7fb4180cebf0 2023-06-09T04:37:29.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.780+0000 7fb4177fe700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3f806ace0 0x7fb3f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:29.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.781+0000 7fb4177fe700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3f806ace0 0x7fb3f806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb408000c00 tx=0x7fb40801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:29.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:29.785+0000 7fb40ffff700 1 -- 172.21.15.149:0/2291432824 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb400053860 con 0x7fb4180cebf0 2023-06-09T04:37:30.015 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.014+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb418073fa0 con 0x7fb4180cebf0 2023-06-09T04:37:30.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.014+0000 7fb40ffff700 1 -- 172.21.15.149:0/2291432824 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb400056e80 con 0x7fb4180cebf0 2023-06-09T04:37:30.016 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:37:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.016+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3f806ace0 msgr2=0x7fb3f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.016+0000 7fb41e063700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3f806ace0 0x7fb3f806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb408000c00 tx=0x7fb40801c040 comp rx=0 tx=0).stop 2023-06-09T04:37:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.016+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4180cebf0 msgr2=0x7fb4180c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.016+0000 7fb41e063700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4180cebf0 0x7fb4180c93a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c4b0 tx=0x7fb40000c7c0 comp rx=0 tx=0).stop 2023-06-09T04:37:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 shutdown_connections 2023-06-09T04:37:30.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3f806ace0 0x7fb3f806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb418158840 0x7fb4180c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4180701b0 0x7fb4180c1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 --2- 172.21.15.149:0/2291432824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4180cebf0 0x7fb4180c93a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 >> 172.21.15.149:0/2291432824 conn(0x7fb41806aa40 msgr2=0x7fb418071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 shutdown_connections 2023-06-09T04:37:30.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:30.017+0000 7fb41e063700 1 -- 172.21.15.149:0/2291432824 wait complete. 2023-06-09T04:37:30.030 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:37:30.031 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:37:30.031 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-06-09T04:37:30.031 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:37:30.032 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:37:30.032 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:37:30.032 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:37:30.033 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:37:30.033 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:37:30.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.034 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-06-09T04:37:30.052 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:30.052 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:30.052 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:30.053 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:30.053 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:30.053 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:30.054 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:30.054 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:30.054 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:30.054 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:30.055 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:30.055 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:30.055 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:37:30.055 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:30.056 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:37:30.056 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42263sec preferred_lft 42263sec 2023-06-09T04:37:30.056 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c1e6:9d48:acd9:41ca/64 scope link noprefixroute 2023-06-09T04:37:30.056 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:30.057 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:37:30.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.058 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:30.058 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:30.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:37:30.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr flush dev ceph-brx 2023-06-09T04:37:30.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set ceph-brx up 2023-06-09T04:37:30.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:37:30.061 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:30.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.167 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:37:30.194 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-06-09T04:37:30.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.196 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-06-09T04:37:30.255 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-06-09T04:37:30.255 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:37:30.255 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:37:30.256 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:37:30.256 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:37:30.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.257 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:30.258 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:30.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:37:30.258 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:37:30.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:37:30.259 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:30.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.361 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-06-09T04:37:30.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.378 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-06-09T04:37:30.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.434 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:30.434 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:30.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:37:30.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-09T04:37:30.435 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:30.528 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-09T04:37:30.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.529 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:30.530 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:30.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-09T04:37:30.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:37:30.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-09T04:37:30.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-09T04:37:30.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-09T04:37:30.531 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:30.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.745 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:30.745 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:30.745 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-06-09T04:37:30.745 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:37:30.746 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:30.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:30.873 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:37:30.894 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:37:30.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:30.895 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:37:30.950 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:37:30.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:30.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:37:31.035 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:37:31.035 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:37:31.035 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:37:31.161 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:37:31.161 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:37:31.161 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:37:31.162 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:31.162 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:31.229 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:37:31.229 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:37:31.229 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:37:31.229 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:31.229 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:31.229 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-06-09T04:37:31.230 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-06-09T04:37:31.230 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8958df92-450c-4c1c-8166-a5a3573afffd" will pass to kernel 2023-06-09T04:37:31.232 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:37:31.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:31.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:37:31.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:31.259 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:31.330 INFO:teuthology.orchestra.run.smithi149.stdout:client4845 2023-06-09T04:37:31.330 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:31.331 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:31.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:31.387 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:31.458 INFO:teuthology.orchestra.run.smithi149.stdout:client4845 2023-06-09T04:37:31.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:31.459 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:31.530 INFO:teuthology.orchestra.run.smithi149.stdout:client4845 2023-06-09T04:37:31.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:31.531 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8958df92-450c-4c1c-8166-a5a3573afffd.client4845/status') 2023-06-09T04:37:31.610 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4845 (3)192.168.0.1:0/1594402966 2023-06-09T04:37:31.610 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2023-06-09T04:37:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2023-06-09T04:37:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2023-06-09T04:37:31.611 INFO:teuthology.orchestra.run.smithi149.stderr:69 bytes copied, 1.9855e-05 s, 3.5 MB/s 2023-06-09T04:37:31.612 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-06-09T04:37:31.612 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:37:31.612 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:37:31.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:37:31.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.772+0000 7f6f60ff6700 1 Processor -- start 2023-06-09T04:37:31.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.772+0000 7f6f60ff6700 1 -- start start 2023-06-09T04:37:31.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f60ff6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f5c0b80d0 0x7f6f5c1606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:31.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f60ff6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0cf1d0 con 0x7f6f5c0b43f0 2023-06-09T04:37:31.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f60ff6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0cd790 con 0x7f6f5c0b5000 2023-06-09T04:37:31.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f60ff6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0ccfc0 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f5a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f5c0b80d0 0x7f6f5c1606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:31.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f5a59c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f6f5c0b80d0 0x7f6f5c1606f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37094/0 (socket says 172.21.15.149:37094) 2023-06-09T04:37:31.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f5ad9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f6f5c0b43f0 0x7f6f5c0b4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60958/0 (socket says 172.21.15.149:60958) 2023-06-09T04:37:31.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.773+0000 7f6f5a59c700 1 -- 172.21.15.149:0/450622230 learned_addr learned my addr 172.21.15.149:0/450622230 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:31.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5a59c700 1 -- 172.21.15.149:0/450622230 >> v1:172.21.15.184:6789/0 conn(0x7f6f5c0b5000 legacy=0x7f6f5c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5a59c700 1 -- 172.21.15.149:0/450622230 >> v1:172.21.15.149:6789/0 conn(0x7f6f5c0b43f0 legacy=0x7f6f5c0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5959a700 1 -- 172.21.15.149:0/450622230 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069706238 0 0) 0x7f6f5c0cf1d0 con 0x7f6f5c0b43f0 2023-06-09T04:37:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5a59c700 1 -- 172.21.15.149:0/450622230 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c160c30 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5a59c700 1 --2- 172.21.15.149:0/450622230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c1606f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f500098f0 tx=0x7f6f50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c42ff5f1422b04 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5959a700 1 -- 172.21.15.149:0/450622230 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000b8a0 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5959a700 1 -- 172.21.15.149:0/450622230 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000ba00 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f5959a700 1 -- 172.21.15.149:0/450622230 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000bd90 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f60ff6700 1 -- 172.21.15.149:0/450622230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 msgr2=0x7f6f5c1606f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:31.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/450622230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c1606f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f500098f0 tx=0x7f6f50009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:31.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f60ff6700 1 -- 172.21.15.149:0/450622230 shutdown_connections 2023-06-09T04:37:31.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/450622230 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c1606f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:31.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.774+0000 7f6f60ff6700 1 -- 172.21.15.149:0/450622230 >> 172.21.15.149:0/450622230 conn(0x7f6f5c072120 msgr2=0x7f6f5c06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:31.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.775+0000 7f6f60ff6700 1 -- 172.21.15.149:0/450622230 shutdown_connections 2023-06-09T04:37:31.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.775+0000 7f6f60ff6700 1 -- 172.21.15.149:0/450622230 wait complete. 2023-06-09T04:37:31.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.776+0000 7f6f60ff6700 1 Processor -- start 2023-06-09T04:37:31.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.776+0000 7f6f60ff6700 1 -- start start 2023-06-09T04:37:31.780 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f5c0b43f0 0x7f6f5c15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f5c0b5000 0x7f6f5c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c0a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1f1ed0 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c15a6a0 con 0x7f6f5c0b5000 2023-06-09T04:37:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c1f2140 con 0x7f6f5c0b43f0 2023-06-09T04:37:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c0a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:31.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c0a9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37104/0 (socket says 172.21.15.149:37104) 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 -- 172.21.15.149:0/1045709584 learned_addr learned my addr 172.21.15.149:0/1045709584 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f59d9b700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f5c0b5000 0x7f6f5c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5a59c700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f5c0b43f0 0x7f6f5c15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 -- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f5c0b43f0 msgr2=0x7f6f5c15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f5c0b43f0 0x7f6f5c15a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 -- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f5c0b5000 msgr2=0x7f6f5c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f5c0b5000 0x7f6f5c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:31.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 -- 172.21.15.149:0/1045709584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50009550 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5a59c700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f5c0b43f0 0x7f6f5c15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f59d9b700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f5c0b5000 0x7f6f5c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f5ad9d700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c0a9d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400cba0 tx=0x7f6f5400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f4affd700 1 -- 172.21.15.149:0/1045709584 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400ab80 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f4affd700 1 -- 172.21.15.149:0/1045709584 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5400ad00 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f4affd700 1 -- 172.21.15.149:0/1045709584 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54007310 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c1f2420 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.777+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c1f29e0 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.778+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c073fa0 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.779+0000 7f6f4affd700 1 -- 172.21.15.149:0/1045709584 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f54007470 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.779+0000 7f6f4affd700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6f3c06ace0 0x7f6f3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.779+0000 7f6f4affd700 1 -- 172.21.15.149:0/1045709584 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f54089460 con 0x7f6f5c0b80d0 2023-06-09T04:37:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.780+0000 7f6f5a59c700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6f3c06ace0 0x7f6f3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.780+0000 7f6f5a59c700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6f3c06ace0 0x7f6f3c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0d3350 tx=0x7f6f50008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:31.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:31.783+0000 7f6f4affd700 1 -- 172.21.15.149:0/1045709584 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f54054390 con 0x7f6f5c0b80d0 2023-06-09T04:37:32.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.012+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f5c0d3870 con 0x7f6f5c0b80d0 2023-06-09T04:37:32.014 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.012+0000 7f6f4affd700 1 -- 172.21.15.149:0/1045709584 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6f54018070 con 0x7f6f5c0b80d0 2023-06-09T04:37:32.014 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:37:32.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.014+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6f3c06ace0 msgr2=0x7f6f3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:32.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.014+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6f3c06ace0 0x7f6f3c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0d3350 tx=0x7f6f50008030 comp rx=0 tx=0).stop 2023-06-09T04:37:32.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.014+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 msgr2=0x7f6f5c0a9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:32.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c0a9d40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6f5400cba0 tx=0x7f6f5400cf60 comp rx=0 tx=0).stop 2023-06-09T04:37:32.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 shutdown_connections 2023-06-09T04:37:32.016 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f6f3c06ace0 0x7f6f3c06d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:32.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f6f5c0b43f0 0x7f6f5c15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:32.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6f5c0b80d0 0x7f6f5c0a9d40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:32.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 --2- 172.21.15.149:0/1045709584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f5c0b5000 0x7f6f5c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:32.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 >> 172.21.15.149:0/1045709584 conn(0x7f6f5c072120 msgr2=0x7f6f5c0cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:32.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 shutdown_connections 2023-06-09T04:37:32.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:32.015+0000 7f6f60ff6700 1 -- 172.21.15.149:0/1045709584 wait complete. 2023-06-09T04:37:32.028 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:37:32.028 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:37:32.028 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-06-09T04:37:32.028 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-09T04:37:32.029 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:37:32.029 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:37:32.029 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:37:32.029 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:37:32.029 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:37:32.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.030 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-06-09T04:37:32.046 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:32.046 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.047 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:32.047 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:32.047 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:32.048 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:32.048 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:37:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:37:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42261sec preferred_lft 42261sec 2023-06-09T04:37:32.048 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c1e6:9d48:acd9:41ca/64 scope link noprefixroute 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether ee:ab:30:7e:cf:fd brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b0b5:d8ff:febd:c80d/64 scope link 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.049 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:37:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether ee:ab:30:7e:cf:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:37:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ecab:30ff:fe7e:cffd/64 scope link tentative 2023-06-09T04:37:32.050 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.050 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:37:32.111 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-06-09T04:37:32.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.113 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-06-09T04:37:32.171 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-06-09T04:37:32.171 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:37:32.171 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:37:32.171 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:37:32.172 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:37:32.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.173 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:32.173 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:32.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:37:32.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:37:32.174 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:37:32.174 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:32.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.277 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-06-09T04:37:32.293 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:37:32.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.294 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list-id 2023-06-09T04:37:32.349 INFO:teuthology.orchestra.run.smithi149.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-09T04:37:32.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.350 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:32.350 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:32.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:37:32.351 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-09T04:37:32.351 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:32.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:37:32.478 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:32.478 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:32.478 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:32.478 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.478 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:32.478 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.479 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:37:32.479 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 9a:89:7b:b7:61:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:37:32.479 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:37:32.479 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.479 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::9889:7bff:feb7:61d3/64 scope link tentative 2023-06-09T04:37:32.479 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 9a:89:7b:b7:61:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::9889:7bff:feb7:61d3/64 scope link tentative 2023-06-09T04:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:32.589 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-09T04:37:32.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.589 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:32.590 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:32.590 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-09T04:37:32.590 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:37:32.590 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-09T04:37:32.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-09T04:37:32.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-09T04:37:32.591 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:32.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:32.841 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:37:32.841 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:37:32.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.1 up 2023-06-09T04:37:32.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:37:32.841 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:37:32.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:32.960 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-09T04:37:32.982 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:37:32.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:32.983 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:37:33.039 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:37:33.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:33.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:37:33.124 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:37:33.124 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-09T04:37:33.125 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:37:33.133 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:37:33.133 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-09T04:37:33.134 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:37:33.134 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:33.134 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:33.207 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:37:33.266 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-09T04:37:33.266 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:37:33.266 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-06-09T04:37:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-06-09T04:37:33.267 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=8958df92-450c-4c1c-8166-a5a3573afffd" will pass to kernel 2023-06-09T04:37:33.268 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:37:33.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:33.268 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:37:33.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:33.294 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:33.366 INFO:teuthology.orchestra.run.smithi149.stdout:client4765 2023-06-09T04:37:33.366 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:33.367 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:33.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:33.423 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:33.494 INFO:teuthology.orchestra.run.smithi149.stdout:client4765 2023-06-09T04:37:33.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:33.495 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:33.566 INFO:teuthology.orchestra.run.smithi149.stdout:client4765 2023-06-09T04:37:33.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:33.567 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8958df92-450c-4c1c-8166-a5a3573afffd.client4765/status') 2023-06-09T04:37:33.647 INFO:teuthology.orchestra.run.smithi149.stdout:instance: client.4765 (3)172.21.15.149:0/1109893189 2023-06-09T04:37:33.647 INFO:teuthology.orchestra.run.smithi149.stdout:blocklisted: false 2023-06-09T04:37:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records in 2023-06-09T04:37:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:0+1 records out 2023-06-09T04:37:33.647 INFO:teuthology.orchestra.run.smithi149.stderr:71 bytes copied, 2.392e-05 s, 3.0 MB/s 2023-06-09T04:37:33.648 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-06-09T04:37:33.648 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:37:33.649 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:37:33.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:37:33.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.809+0000 7f8e4a9b9700 1 Processor -- start 2023-06-09T04:37:33.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.809+0000 7f8e4a9b9700 1 -- start start 2023-06-09T04:37:33.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e4a9b9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8e4406aec0 0x7f8e4406b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:33.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e4a9b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e440cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:33.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e4a9b9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e440cf380 con 0x7f8e4415c6a0 2023-06-09T04:37:33.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e4a9b9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e440d17b0 con 0x7f8e4406aec0 2023-06-09T04:37:33.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e4a9b9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4406b7d0 con 0x7f8e440cf9f0 2023-06-09T04:37:33.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e43fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8e4406aec0 0x7f8e4406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:33.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e437fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8e4415c6a0 0x7f8e440cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:60978/0 (socket says 172.21.15.149:60978) 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e43fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8e4406aec0 0x7f8e4406b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37112/0 (socket says 172.21.15.149:37112) 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e437fe700 1 -- 172.21.15.149:0/2643632966 learned_addr learned my addr 172.21.15.149:0/2643632966 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e48f56700 1 --2- 172.21.15.149:0/2643632966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e440cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e43fff700 1 -- 172.21.15.149:0/2643632966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 msgr2=0x7f8e440cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e43fff700 1 --2- 172.21.15.149:0/2643632966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e440cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e43fff700 1 -- 172.21.15.149:0/2643632966 >> v1:172.21.15.149:6789/0 conn(0x7f8e4415c6a0 legacy=0x7f8e440cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e43fff700 1 -- 172.21.15.149:0/2643632966 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e440ce770 con 0x7f8e4406aec0 2023-06-09T04:37:33.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e42ffd700 1 -- 172.21.15.149:0/2643632966 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648164416 0 0) 0x7f8e440cf380 con 0x7f8e4415c6a0 2023-06-09T04:37:33.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.810+0000 7f8e43fff700 1 --2- 172.21.15.149:0/2643632966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e4406b290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009840 tx=0x7f8e38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472aac59e8892f9d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:33.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e42ffd700 1 -- 172.21.15.149:0/2643632966 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38011830 con 0x7f8e4406aec0 2023-06-09T04:37:33.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e42ffd700 1 -- 172.21.15.149:0/2643632966 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38011990 con 0x7f8e4406aec0 2023-06-09T04:37:33.814 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e42ffd700 1 -- 172.21.15.149:0/2643632966 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38011d20 con 0x7f8e4406aec0 2023-06-09T04:37:33.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/2643632966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 msgr2=0x7f8e4406b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:33.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/2643632966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e4406b290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009840 tx=0x7f8e38009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:33.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/2643632966 shutdown_connections 2023-06-09T04:37:33.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/2643632966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e440cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:33.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/2643632966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e4406b290 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:33.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/2643632966 >> 172.21.15.149:0/2643632966 conn(0x7f8e44099b20 msgr2=0x7f8e4408a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:33.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/2643632966 shutdown_connections 2023-06-09T04:37:33.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.811+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/2643632966 wait complete. 2023-06-09T04:37:33.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.812+0000 7f8e4a9b9700 1 Processor -- start 2023-06-09T04:37:33.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e4a9b9700 1 -- start start 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e4a9b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e440c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e4a9b9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e44158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e4a9b9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e4415c6a0 0x7f8e441f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e4a9b9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e440ca7d0 con 0x7f8e4406aec0 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e4a9b9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e44158ac0 con 0x7f8e4415c6a0 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e4a9b9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e44158d40 con 0x7f8e440cf9f0 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e440c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:33.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e43fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e440c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37118/0 (socket says 172.21.15.149:37118) 2023-06-09T04:37:33.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e43fff700 1 -- 172.21.15.149:0/1038927034 learned_addr learned my addr 172.21.15.149:0/1038927034 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:33.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e437fe700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e44158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:33.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.813+0000 7f8e48f56700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e4415c6a0 0x7f8e441f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:33.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e43fff700 1 -- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 msgr2=0x7f8e44158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:33.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e43fff700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e44158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:33.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e43fff700 1 -- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e4415c6a0 msgr2=0x7f8e441f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:33.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e43fff700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e4415c6a0 0x7f8e441f1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e43fff700 1 -- 172.21.15.149:0/1038927034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380094a0 con 0x7f8e4406aec0 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e48f56700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e4415c6a0 0x7f8e441f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e43fff700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e440c6cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8e38014040 tx=0x7f8e38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e40ff9700 1 -- 172.21.15.149:0/1038927034 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e380036a0 con 0x7f8e4406aec0 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e40ff9700 1 -- 172.21.15.149:0/1038927034 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3801e070 con 0x7f8e4406aec0 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e44159020 con 0x7f8e4406aec0 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e40ff9700 1 -- 172.21.15.149:0/1038927034 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38003a20 con 0x7f8e4406aec0 2023-06-09T04:37:33.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.814+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e441595e0 con 0x7f8e4406aec0 2023-06-09T04:37:33.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.815+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e44073fa0 con 0x7f8e4406aec0 2023-06-09T04:37:33.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.815+0000 7f8e40ff9700 1 -- 172.21.15.149:0/1038927034 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e38003b80 con 0x7f8e4406aec0 2023-06-09T04:37:33.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.816+0000 7f8e40ff9700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e3006ad10 0x7f8e3006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:33.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.816+0000 7f8e40ff9700 1 -- 172.21.15.149:0/1038927034 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8e3808a830 con 0x7f8e4406aec0 2023-06-09T04:37:33.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.816+0000 7f8e437fe700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e3006ad10 0x7f8e3006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:33.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.816+0000 7f8e437fe700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e3006ad10 0x7f8e3006d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e440b1240 tx=0x7f8e34007be0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:33.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:33.820+0000 7f8e40ff9700 1 -- 172.21.15.149:0/1038927034 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e38055680 con 0x7f8e4406aec0 2023-06-09T04:37:34.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.049+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8e441f1aa0 con 0x7f8e4406aec0 2023-06-09T04:37:34.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.049+0000 7f8e40ff9700 1 -- 172.21.15.149:0/1038927034 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8e38058ca0 con 0x7f8e4406aec0 2023-06-09T04:37:34.051 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:37:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.051+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e3006ad10 msgr2=0x7f8e3006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.051+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e3006ad10 0x7f8e3006d1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8e440b1240 tx=0x7f8e34007be0 comp rx=0 tx=0).stop 2023-06-09T04:37:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.051+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 msgr2=0x7f8e440c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e440c6cf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8e38014040 tx=0x7f8e38004750 comp rx=0 tx=0).stop 2023-06-09T04:37:34.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 shutdown_connections 2023-06-09T04:37:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e3006ad10 0x7f8e3006d1c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e4415c6a0 0x7f8e441f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e4406aec0 0x7f8e440c6cf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 --2- 172.21.15.149:0/1038927034 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e440cf9f0 0x7f8e44158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 >> 172.21.15.149:0/1038927034 conn(0x7f8e44099b20 msgr2=0x7f8e440b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 shutdown_connections 2023-06-09T04:37:34.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:34.052+0000 7f8e4a9b9700 1 -- 172.21.15.149:0/1038927034 wait complete. 2023-06-09T04:37:34.065 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:37:34.065 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:37:34.065 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-06-09T04:37:34.065 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-09T04:37:34.066 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:37:34.066 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:37:34.066 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:37:34.066 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:37:34.066 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:37:34.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.067 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-06-09T04:37:34.087 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:34.087 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:34.087 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:34.088 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:34.088 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:34.088 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:34.088 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:34.088 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:34.088 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:34.088 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42294sec preferred_lft 42294sec 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::54d8:69b5:ce63:7e50/64 scope link noprefixroute 2023-06-09T04:37:34.089 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:34.090 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:37:34.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.090 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:34.090 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:34.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:37:34.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2023-06-09T04:37:34.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2023-06-09T04:37:34.091 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:37:34.092 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:34.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.267 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:37:34.293 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-06-09T04:37:34.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.295 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-06-09T04:37:34.365 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-06-09T04:37:34.365 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:37:34.365 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:37:34.365 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:37:34.366 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:37:34.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.366 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:34.366 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:34.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:37:34.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:37:34.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:37:34.367 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:34.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.619 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-06-09T04:37:34.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.636 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-06-09T04:37:34.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.693 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:34.693 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:34.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:37:34.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-09T04:37:34.694 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:34.786 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-09T04:37:34.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.786 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:34.787 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:34.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-09T04:37:34.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:37:34.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-09T04:37:34.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-09T04:37:34.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-09T04:37:34.788 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:34.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:34.993 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:34.993 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:34.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2023-06-09T04:37:34.994 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:37:34.994 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:35.094 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:35.094 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-09T04:37:35.119 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:37:35.119 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:35.119 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:37:35.175 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:37:35.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:35.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:37:35.270 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:37:35.270 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-09T04:37:35.271 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-06-09T04:37:35.365 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:37:35.365 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-09T04:37:35.365 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-06-09T04:37:35.365 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:35.365 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:37:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-09T04:37:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-06-09T04:37:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:35.395 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:35.396 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-06-09T04:37:35.396 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-06-09T04:37:35.396 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=8958df92-450c-4c1c-8166-a5a3573afffd" will pass to kernel 2023-06-09T04:37:35.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:37:35.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:35.399 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:37:35.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:35.433 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:35.503 INFO:teuthology.orchestra.run.smithi184.stdout:client4589 2023-06-09T04:37:35.504 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:35.504 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:35.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:35.560 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:35.631 INFO:teuthology.orchestra.run.smithi184.stdout:client4589 2023-06-09T04:37:35.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:35.631 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:35.702 INFO:teuthology.orchestra.run.smithi184.stdout:client4589 2023-06-09T04:37:35.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:35.703 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8958df92-450c-4c1c-8166-a5a3573afffd.client4589/status') 2023-06-09T04:37:35.781 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4589 (3)192.168.0.1:0/3559644408 2023-06-09T04:37:35.782 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-06-09T04:37:35.782 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-06-09T04:37:35.782 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-06-09T04:37:35.782 INFO:teuthology.orchestra.run.smithi184.stderr:69 bytes copied, 1.9755e-05 s, 3.5 MB/s 2023-06-09T04:37:35.783 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-06-09T04:37:35.783 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:37:35.783 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:37:35.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:37:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.916+0000 7fce8fde3700 1 Processor -- start 2023-06-09T04:37:35.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.916+0000 7fce8fde3700 1 -- start start 2023-06-09T04:37:35.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8fde3700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fce8806b4b0 0x7fce88145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:35.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8fde3700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce88145cd0 0x7fce880d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:35.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8fde3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce880d1100 con 0x7fce880d0ca0 2023-06-09T04:37:35.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8fde3700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880d16e0 con 0x7fce88145cd0 2023-06-09T04:37:35.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8fde3700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880cd050 con 0x7fce8806b4b0 2023-06-09T04:37:35.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce88145cd0 0x7fce880d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:35.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fce88145cd0 0x7fce880d0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37126/0 (socket says 172.21.15.149:37126) 2023-06-09T04:37:35.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 -- 172.21.15.149:0/2476887517 learned_addr learned my addr 172.21.15.149:0/2476887517 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:35.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8db7f700 1 --2- 172.21.15.149:0/2476887517 >> v2:172.21.15.184:3300/0 conn(0x7fce8806b4b0 0x7fce88145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:35.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 -- 172.21.15.149:0/2476887517 >> v2:172.21.15.184:3300/0 conn(0x7fce8806b4b0 msgr2=0x7fce88145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:35.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 --2- 172.21.15.149:0/2476887517 >> v2:172.21.15.184:3300/0 conn(0x7fce8806b4b0 0x7fce88145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:35.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 -- 172.21.15.149:0/2476887517 >> v1:172.21.15.184:6789/0 conn(0x7fce880d0ca0 legacy=0x7fce8815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:35.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 -- 172.21.15.149:0/2476887517 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880cbf30 con 0x7fce88145cd0 2023-06-09T04:37:35.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.917+0000 7fce8d37e700 1 --2- 172.21.15.149:0/2476887517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce880d0760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce880ce2f0 tx=0x7fce78009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8f120bf59b2355 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:35.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8cb7d700 1 -- 172.21.15.149:0/2476887517 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78004230 con 0x7fce88145cd0 2023-06-09T04:37:35.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8cb7d700 1 -- 172.21.15.149:0/2476887517 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78004390 con 0x7fce88145cd0 2023-06-09T04:37:35.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8cb7d700 1 -- 172.21.15.149:0/2476887517 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780036a0 con 0x7fce88145cd0 2023-06-09T04:37:35.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 -- 172.21.15.149:0/2476887517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 msgr2=0x7fce880d0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:35.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2476887517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce880d0760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fce880ce2f0 tx=0x7fce78009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:35.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 -- 172.21.15.149:0/2476887517 shutdown_connections 2023-06-09T04:37:35.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2476887517 >> v2:172.21.15.184:3300/0 conn(0x7fce8806b4b0 0x7fce88145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:35.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2476887517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce880d0760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:35.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 -- 172.21.15.149:0/2476887517 >> 172.21.15.149:0/2476887517 conn(0x7fce8806a6d0 msgr2=0x7fce88099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 -- 172.21.15.149:0/2476887517 shutdown_connections 2023-06-09T04:37:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.918+0000 7fce8fde3700 1 -- 172.21.15.149:0/2476887517 wait complete. 2023-06-09T04:37:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.919+0000 7fce8fde3700 1 Processor -- start 2023-06-09T04:37:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.919+0000 7fce8fde3700 1 -- start start 2023-06-09T04:37:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8fde3700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce8806b4b0 0x7fce880c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8fde3700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce880d0ca0 0x7fce881f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:35.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8fde3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce88156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8fde3700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce880c5280 con 0x7fce88145cd0 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8fde3700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881f5cd0 con 0x7fce880d0ca0 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8fde3700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce881f5fb0 con 0x7fce8806b4b0 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8e380700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce88156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8e380700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce88156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37136/0 (socket says 172.21.15.149:37136) 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8e380700 1 -- 172.21.15.149:0/2125066087 learned_addr learned my addr 172.21.15.149:0/2125066087 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8d37e700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce880d0ca0 0x7fce881f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:35.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.920+0000 7fce8db7f700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce8806b4b0 0x7fce880c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8e380700 1 -- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce8806b4b0 msgr2=0x7fce880c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8e380700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce8806b4b0 0x7fce880c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8e380700 1 -- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce880d0ca0 msgr2=0x7fce881f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8e380700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce880d0ca0 0x7fce881f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8e380700 1 -- 172.21.15.149:0/2125066087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce78009550 con 0x7fce88145cd0 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8db7f700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce8806b4b0 0x7fce880c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8e380700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce88156d40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce8000b970 tx=0x7fce8000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:35.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce7e7fc700 1 -- 172.21.15.149:0/2125066087 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000c930 con 0x7fce88145cd0 2023-06-09T04:37:35.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce7e7fc700 1 -- 172.21.15.149:0/2125066087 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8000cad0 con 0x7fce88145cd0 2023-06-09T04:37:35.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce881f6290 con 0x7fce88145cd0 2023-06-09T04:37:35.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce7e7fc700 1 -- 172.21.15.149:0/2125066087 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000ce80 con 0x7fce88145cd0 2023-06-09T04:37:35.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.921+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce881f59c0 con 0x7fce88145cd0 2023-06-09T04:37:35.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.922+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce880c5760 con 0x7fce88145cd0 2023-06-09T04:37:35.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.922+0000 7fce7e7fc700 1 -- 172.21.15.149:0/2125066087 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce80014440 con 0x7fce88145cd0 2023-06-09T04:37:35.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.923+0000 7fce7e7fc700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fce6c06ace0 0x7fce6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:35.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.923+0000 7fce7e7fc700 1 -- 172.21.15.149:0/2125066087 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce80089240 con 0x7fce88145cd0 2023-06-09T04:37:35.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.923+0000 7fce8db7f700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fce6c06ace0 0x7fce6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:35.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.923+0000 7fce8db7f700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fce6c06ace0 0x7fce6c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce84006fd0 tx=0x7fce84008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:35.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:35.927+0000 7fce7e7fc700 1 -- 172.21.15.149:0/2125066087 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce880c5760 con 0x7fce88145cd0 2023-06-09T04:37:36.156 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.155+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce880c5760 con 0x7fce88145cd0 2023-06-09T04:37:36.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.156+0000 7fce7e7fc700 1 -- 172.21.15.149:0/2125066087 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fce880c5760 con 0x7fce88145cd0 2023-06-09T04:37:36.157 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:37:36.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fce6c06ace0 msgr2=0x7fce6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:36.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fce6c06ace0 0x7fce6c06d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce84006fd0 tx=0x7fce84008040 comp rx=0 tx=0).stop 2023-06-09T04:37:36.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 msgr2=0x7fce88156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:36.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce88156d40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fce8000b970 tx=0x7fce8000bc80 comp rx=0 tx=0).stop 2023-06-09T04:37:36.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 shutdown_connections 2023-06-09T04:37:36.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fce6c06ace0 0x7fce6c06d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:36.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fce8806b4b0 0x7fce880c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:36.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce88145cd0 0x7fce88156d40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:36.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 --2- 172.21.15.149:0/2125066087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce880d0ca0 0x7fce881f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:36.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 >> 172.21.15.149:0/2125066087 conn(0x7fce8806a6d0 msgr2=0x7fce880cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:36.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 shutdown_connections 2023-06-09T04:37:36.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:36.158+0000 7fce8fde3700 1 -- 172.21.15.149:0/2125066087 wait complete. 2023-06-09T04:37:36.171 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:37:36.171 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:37:36.171 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2023-06-09T04:37:36.171 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-09T04:37:36.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:37:36.172 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:37:36.172 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:37:36.172 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:37:36.172 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:37:36.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.173 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2023-06-09T04:37:36.191 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:36.191 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.192 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:36.192 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:36.192 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:36.192 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 42292sec preferred_lft 42292sec 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::54d8:69b5:ce63:7e50/64 scope link noprefixroute 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.193 INFO:teuthology.orchestra.run.smithi184.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:37:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:41:b6:6f:99:9a brd ff:ff:ff:ff:ff:ff 2023-06-09T04:37:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:37:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::1059:aeff:fe34:9194/64 scope link 2023-06-09T04:37:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.194 INFO:teuthology.orchestra.run.smithi184.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:37:36.194 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether c6:41:b6:6f:99:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:37:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::c441:b6ff:fe6f:999a/64 scope link tentative 2023-06-09T04:37:36.195 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.195 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:37:36.258 INFO:teuthology.orchestra.run.smithi184.stdout:1 2023-06-09T04:37:36.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.259 DEBUG:teuthology.orchestra.run.smithi184:> route 2023-06-09T04:37:36.317 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2023-06-09T04:37:36.318 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:37:36.318 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:37:36.318 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:37:36.318 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:37:36.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.319 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:36.319 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:36.320 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:37:36.320 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:37:36.320 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:37:36.320 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:36.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.424 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2023-06-09T04:37:36.440 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-09T04:37:36.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.441 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2023-06-09T04:37:36.496 INFO:teuthology.orchestra.run.smithi184.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-09T04:37:36.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.496 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:36.497 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:36.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-09T04:37:36.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-09T04:37:36.497 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:36.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.589 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:37:36.624 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.624 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.625 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:37:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 6e:be:9c:f2:3b:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:37:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:37:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::6cbe:9cff:fef2:3b18/64 scope link tentative 2023-06-09T04:37:36.625 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.640 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:37:36.715 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:37:36.715 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:37:36.715 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:37:36.715 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.716 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2023-06-09T04:37:36.716 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.716 INFO:teuthology.orchestra.run.smithi184.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:37:36.716 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 6e:be:9c:f2:3b:18 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:37:36.716 INFO:teuthology.orchestra.run.smithi184.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:37:36.716 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.716 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::6cbe:9cff:fef2:3b18/64 scope link tentative 2023-06-09T04:37:36.717 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:37:36.738 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-09T04:37:36.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.739 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:36.739 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:36.739 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-09T04:37:36.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:37:36.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-09T04:37:36.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-09T04:37:36.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-09T04:37:36.741 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:36.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:36.979 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2023-06-09T04:37:36.979 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2023-06-09T04:37:36.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.1 up 2023-06-09T04:37:36.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:37:36.980 DEBUG:teuthology.orchestra.run.smithi184:> ') 2023-06-09T04:37:37.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:37.088 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-09T04:37:37.108 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:37:37.108 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:37:37.108 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:37:37.164 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:37:37.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:37.165 DEBUG:teuthology.orchestra.run.smithi184:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:37:37.249 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:37:37.249 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-09T04:37:37.249 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-06-09T04:37:37.257 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:37:37.257 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-09T04:37:37.258 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-06-09T04:37:37.258 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:37.258 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:37.287 INFO:teuthology.orchestra.run.smithi184.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:37:37.287 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-09T04:37:37.287 INFO:teuthology.orchestra.run.smithi184.stdout:invalid new device string format 2023-06-09T04:37:37.288 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:37:37.288 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:37:37.288 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-06-09T04:37:37.288 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-06-09T04:37:37.288 INFO:teuthology.orchestra.run.smithi184.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=8958df92-450c-4c1c-8166-a5a3573afffd" will pass to kernel 2023-06-09T04:37:37.290 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:37:37.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:37.291 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:37:37.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:37.319 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:37.389 INFO:teuthology.orchestra.run.smithi184.stdout:client4595 2023-06-09T04:37:37.390 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:37.390 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:37.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:37.447 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:37.517 INFO:teuthology.orchestra.run.smithi184.stdout:client4595 2023-06-09T04:37:37.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:37.518 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:37:37.588 INFO:teuthology.orchestra.run.smithi184.stdout:client4595 2023-06-09T04:37:37.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:37.589 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8958df92-450c-4c1c-8166-a5a3573afffd.client4595/status') 2023-06-09T04:37:37.667 INFO:teuthology.orchestra.run.smithi184.stdout:instance: client.4595 (3)192.168.0.2:0/3743166072 2023-06-09T04:37:37.668 INFO:teuthology.orchestra.run.smithi184.stdout:blocklisted: false 2023-06-09T04:37:37.668 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records in 2023-06-09T04:37:37.668 INFO:teuthology.orchestra.run.smithi184.stderr:0+1 records out 2023-06-09T04:37:37.668 INFO:teuthology.orchestra.run.smithi184.stderr:69 bytes copied, 3.6121e-05 s, 1.9 MB/s 2023-06-09T04:37:37.669 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-09T04:37:37.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:37.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.815+0000 7f9efef7c700 1 Processor -- start 2023-06-09T04:37:37.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.815+0000 7f9efef7c700 1 -- start start 2023-06-09T04:37:37.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.815+0000 7f9efef7c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9ef8157d30 0x7f9ef80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:37.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.815+0000 7f9efef7c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9ef80ce3a0 0x7f9ef80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:37.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.815+0000 7f9efef7c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80cd770 con 0x7f9ef815a6a0 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.815+0000 7f9efef7c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80ced60 con 0x7f9ef8157d30 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.815+0000 7f9efef7c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef8158100 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efcd18700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9ef8157d30 0x7f9ef80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efd519700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f9ef815a6a0 0x7f9ef815ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32772/0 (socket says 172.21.15.149:32772) 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efd519700 1 -- 172.21.15.149:0/1094386940 learned_addr learned my addr 172.21.15.149:0/1094386940 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9ef7fff700 1 --2- 172.21.15.149:0/1094386940 >> v2:172.21.15.184:3300/0 conn(0x7f9ef80ce3a0 0x7f9ef80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efcd18700 1 -- 172.21.15.149:0/1094386940 >> v2:172.21.15.184:3300/0 conn(0x7f9ef80ce3a0 msgr2=0x7f9ef80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:37.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efcd18700 1 --2- 172.21.15.149:0/1094386940 >> v2:172.21.15.184:3300/0 conn(0x7f9ef80ce3a0 0x7f9ef80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efcd18700 1 -- 172.21.15.149:0/1094386940 >> v1:172.21.15.149:6789/0 conn(0x7f9ef815a6a0 legacy=0x7f9ef815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efcd18700 1 -- 172.21.15.149:0/1094386940 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef815b2d0 con 0x7f9ef8157d30 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9ef77fe700 1 -- 172.21.15.149:0/1094386940 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320966193 0 0) 0x7f9ef80cd770 con 0x7f9ef815a6a0 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9efcd18700 1 --2- 172.21.15.149:0/1094386940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef8157d30 0x7f9ef80cdc00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80b33c0 tx=0x7f9eec009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d5fd956ea52fa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9ef77fe700 1 -- 172.21.15.149:0/1094386940 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec005e30 con 0x7f9ef8157d30 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9ef77fe700 1 -- 172.21.15.149:0/1094386940 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec006030 con 0x7f9ef8157d30 2023-06-09T04:37:37.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.816+0000 7f9ef77fe700 1 -- 172.21.15.149:0/1094386940 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0063c0 con 0x7f9ef8157d30 2023-06-09T04:37:37.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 -- 172.21.15.149:0/1094386940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef8157d30 msgr2=0x7f9ef80cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:37.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1094386940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef8157d30 0x7f9ef80cdc00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9ef80b33c0 tx=0x7f9eec009b00 comp rx=0 tx=0).stop 2023-06-09T04:37:37.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 -- 172.21.15.149:0/1094386940 shutdown_connections 2023-06-09T04:37:37.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1094386940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef8157d30 0x7f9ef80cdc00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:37.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1094386940 >> v2:172.21.15.184:3300/0 conn(0x7f9ef80ce3a0 0x7f9ef80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:37.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 -- 172.21.15.149:0/1094386940 >> 172.21.15.149:0/1094386940 conn(0x7f9ef806a6d0 msgr2=0x7f9ef8099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:37.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 -- 172.21.15.149:0/1094386940 shutdown_connections 2023-06-09T04:37:37.822 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.817+0000 7f9efef7c700 1 -- 172.21.15.149:0/1094386940 wait complete. 2023-06-09T04:37:37.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.818+0000 7f9efef7c700 1 Processor -- start 2023-06-09T04:37:37.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.818+0000 7f9efef7c700 1 -- start start 2023-06-09T04:37:37.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efef7c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef80ce3a0 0x7f9ef8155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:37.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efef7c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ef8157d30 0x7f9ef80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:37.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efef7c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ef815a6a0 0x7f9ef80cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:37.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efef7c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef81f1ae0 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.823 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efef7c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8155b80 con 0x7f9ef815a6a0 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efef7c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80b4980 con 0x7f9ef8157d30 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef80ce3a0 0x7f9ef8155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef80ce3a0 0x7f9ef8155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37146/0 (socket says 172.21.15.149:37146) 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 -- 172.21.15.149:0/1297699887 learned_addr learned my addr 172.21.15.149:0/1297699887 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9ef7fff700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ef8157d30 0x7f9ef80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efd519700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ef815a6a0 0x7f9ef80cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 -- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ef8157d30 msgr2=0x7f9ef80cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:37.824 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ef8157d30 0x7f9ef80cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:37.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 -- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ef815a6a0 msgr2=0x7f9ef80cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:37.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ef815a6a0 0x7f9ef80cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:37.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 -- 172.21.15.149:0/1297699887 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec009430 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.819+0000 7f9efcd18700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef80ce3a0 0x7f9ef8155640 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000c00 tx=0x7f9eec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:37.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.820+0000 7f9ef57fa700 1 -- 172.21.15.149:0/1297699887 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec006870 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.820+0000 7f9ef57fa700 1 -- 172.21.15.149:0/1297699887 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec020070 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.825 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.820+0000 7f9ef57fa700 1 -- 172.21.15.149:0/1297699887 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec004280 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.820+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef80b4c60 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.820+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef80b5220 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.821+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef80b4ac0 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.821+0000 7f9ef57fa700 1 -- 172.21.15.149:0/1297699887 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9eec022030 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.821+0000 7f9ef57fa700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9edc06ace0 0x7f9edc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:37.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.821+0000 7f9ef57fa700 1 -- 172.21.15.149:0/1297699887 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9eec08ab80 con 0x7f9ef80ce3a0 2023-06-09T04:37:37.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.822+0000 7f9ef7fff700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9edc06ace0 0x7f9edc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:37.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.822+0000 7f9ef7fff700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9edc06ace0 0x7f9edc06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009b40 tx=0x7f9ee4009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:37.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:37.826+0000 7f9ef57fa700 1 -- 172.21.15.149:0/1297699887 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ef80b4ac0 con 0x7f9ef80ce3a0 2023-06-09T04:37:38.017 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.016+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ef80b4ac0 con 0x7f9ef80ce3a0 2023-06-09T04:37:38.018 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.018+0000 7f9ef57fa700 1 -- 172.21.15.149:0/1297699887 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7f9ef80b4ac0 con 0x7f9ef80ce3a0 2023-06-09T04:37:38.019 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:38.019 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:38.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9edc06ace0 msgr2=0x7f9edc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9edc06ace0 0x7f9edc06d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009b40 tx=0x7f9ee4009210 comp rx=0 tx=0).stop 2023-06-09T04:37:38.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef80ce3a0 msgr2=0x7f9ef8155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef80ce3a0 0x7f9ef8155640 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9eec000c00 tx=0x7f9eec004750 comp rx=0 tx=0).stop 2023-06-09T04:37:38.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 shutdown_connections 2023-06-09T04:37:38.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9edc06ace0 0x7f9edc06d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ef815a6a0 0x7f9ef80cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ef80ce3a0 0x7f9ef8155640 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 --2- 172.21.15.149:0/1297699887 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9ef8157d30 0x7f9ef80cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 >> 172.21.15.149:0/1297699887 conn(0x7f9ef806a6d0 msgr2=0x7f9ef8099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:38.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 shutdown_connections 2023-06-09T04:37:38.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.020+0000 7f9efef7c700 1 -- 172.21.15.149:0/1297699887 wait complete. 2023-06-09T04:37:38.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:38.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:38.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.156+0000 7f3ad1b7f700 1 Processor -- start 2023-06-09T04:37:38.157 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.156+0000 7f3ad1b7f700 1 -- start start 2023-06-09T04:37:38.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3ad1b7f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3acc0ce480 0x7f3acc0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.158 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3ad1b7f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3acc06a9c0 0x7f3acc06ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3ad1b7f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3acc15c5d0 con 0x7f3acc15c200 2023-06-09T04:37:38.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3ad1b7f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc06b360 con 0x7f3acc06a9c0 2023-06-09T04:37:38.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3ad1b7f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc0cec20 con 0x7f3acc0ce480 2023-06-09T04:37:38.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3acc06a9c0 0x7f3acc06ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acb7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f3acc15c200 0x7f3acc06c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32786/0 (socket says 172.21.15.149:32786) 2023-06-09T04:37:38.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acb7fe700 1 -- 172.21.15.149:0/4232877705 learned_addr learned my addr 172.21.15.149:0/4232877705 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:38.159 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acaffd700 1 --2- 172.21.15.149:0/4232877705 >> v2:172.21.15.184:3300/0 conn(0x7f3acc0ce480 0x7f3acc0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acbfff700 1 -- 172.21.15.149:0/4232877705 >> v2:172.21.15.184:3300/0 conn(0x7f3acc0ce480 msgr2=0x7f3acc0ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:38.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acbfff700 1 --2- 172.21.15.149:0/4232877705 >> v2:172.21.15.184:3300/0 conn(0x7f3acc0ce480 0x7f3acc0ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acbfff700 1 -- 172.21.15.149:0/4232877705 >> v1:172.21.15.149:6789/0 conn(0x7f3acc15c200 legacy=0x7f3acc06c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acbfff700 1 -- 172.21.15.149:0/4232877705 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0ce940 con 0x7f3acc06a9c0 2023-06-09T04:37:38.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3aca7fc700 1 -- 172.21.15.149:0/4232877705 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272471230 0 0) 0x7f3abc001110 con 0x7f3acc15c200 2023-06-09T04:37:38.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3acbfff700 1 --2- 172.21.15.149:0/4232877705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc06a9c0 0x7f3acc06ae20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3acc070470 tx=0x7f3ac400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a30002f420e955 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.160 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3aca7fc700 1 -- 172.21.15.149:0/4232877705 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400e070 con 0x7f3acc06a9c0 2023-06-09T04:37:38.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3aca7fc700 1 -- 172.21.15.149:0/4232877705 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac400bb20 con 0x7f3acc06a9c0 2023-06-09T04:37:38.161 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.157+0000 7f3aca7fc700 1 -- 172.21.15.149:0/4232877705 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4012430 con 0x7f3acc06a9c0 2023-06-09T04:37:38.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/4232877705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc06a9c0 msgr2=0x7f3acc06ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/4232877705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc06a9c0 0x7f3acc06ae20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3acc070470 tx=0x7f3ac400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:38.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/4232877705 shutdown_connections 2023-06-09T04:37:38.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/4232877705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc06a9c0 0x7f3acc06ae20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/4232877705 >> v2:172.21.15.184:3300/0 conn(0x7f3acc0ce480 0x7f3acc0ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/4232877705 >> 172.21.15.149:0/4232877705 conn(0x7f3acc0cee30 msgr2=0x7f3acc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:38.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/4232877705 shutdown_connections 2023-06-09T04:37:38.163 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.158+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/4232877705 wait complete. 2023-06-09T04:37:38.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.159+0000 7f3ad1b7f700 1 Processor -- start 2023-06-09T04:37:38.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.159+0000 7f3ad1b7f700 1 -- start start 2023-06-09T04:37:38.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3ad1b7f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3acc06a9c0 0x7f3acc0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3ad1b7f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc0ce480 0x7f3acc0c4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3ad1b7f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3acc15c200 0x7f3acc0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3ad1b7f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0c3260 con 0x7f3acc0ce480 2023-06-09T04:37:38.164 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3ad1b7f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0c3540 con 0x7f3acc15c200 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3ad1b7f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0c3820 con 0x7f3acc06a9c0 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc0ce480 0x7f3acc0c4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acaffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc0ce480 0x7f3acc0c4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37162/0 (socket says 172.21.15.149:37162) 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acaffd700 1 -- 172.21.15.149:0/2587512570 learned_addr learned my addr 172.21.15.149:0/2587512570 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acbfff700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3acc15c200 0x7f3acc0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acb7fe700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3acc06a9c0 0x7f3acc0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acaffd700 1 -- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3acc06a9c0 msgr2=0x7f3acc0c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acaffd700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3acc06a9c0 0x7f3acc0c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acaffd700 1 -- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3acc15c200 msgr2=0x7f3acc0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.160+0000 7f3acaffd700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3acc15c200 0x7f3acc0b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.161+0000 7f3acaffd700 1 -- 172.21.15.149:0/2587512570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4009a70 con 0x7f3acc0ce480 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.161+0000 7f3acaffd700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc0ce480 0x7f3acc0c4f30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000e9b0 tx=0x7f3ac000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.161+0000 7f3ab3fff700 1 -- 172.21.15.149:0/2587512570 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000ee50 con 0x7f3acc0ce480 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.161+0000 7f3ab3fff700 1 -- 172.21.15.149:0/2587512570 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac000c7f0 con 0x7f3acc0ce480 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.161+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc0c3b00 con 0x7f3acc0ce480 2023-06-09T04:37:38.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.161+0000 7f3ab3fff700 1 -- 172.21.15.149:0/2587512570 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000cb60 con 0x7f3acc0ce480 2023-06-09T04:37:38.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.161+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc0c42e0 con 0x7f3acc0ce480 2023-06-09T04:37:38.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.162+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc0ce0e0 con 0x7f3acc0ce480 2023-06-09T04:37:38.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.162+0000 7f3ab3fff700 1 -- 172.21.15.149:0/2587512570 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ac000ccc0 con 0x7f3acc0ce480 2023-06-09T04:37:38.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.162+0000 7f3ab3fff700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ab806ace0 0x7f3ab806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.163+0000 7f3ab3fff700 1 -- 172.21.15.149:0/2587512570 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ac00897b0 con 0x7f3acc0ce480 2023-06-09T04:37:38.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.163+0000 7f3acb7fe700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ab806ace0 0x7f3ab806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.163+0000 7f3acb7fe700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ab806ace0 0x7f3ab806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000f60 tx=0x7f3abc007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.167+0000 7f3ab3fff700 1 -- 172.21.15.149:0/2587512570 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ac00544e0 con 0x7f3acc0ce480 2023-06-09T04:37:38.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.352+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3acc069eb0 con 0x7f3acc0ce480 2023-06-09T04:37:38.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.352+0000 7f3ab3fff700 1 -- 172.21.15.149:0/2587512570 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ac0057b00 con 0x7f3acc0ce480 2023-06-09T04:37:38.353 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:38.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ab806ace0 msgr2=0x7f3ab806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ab806ace0 0x7f3ab806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3abc000f60 tx=0x7f3abc007e70 comp rx=0 tx=0).stop 2023-06-09T04:37:38.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc0ce480 msgr2=0x7f3acc0c4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc0ce480 0x7f3acc0c4f30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000e9b0 tx=0x7f3ac000ecc0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 shutdown_connections 2023-06-09T04:37:38.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ab806ace0 0x7f3ab806d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3acc06a9c0 0x7f3acc0c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3acc15c200 0x7f3acc0b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 --2- 172.21.15.149:0/2587512570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3acc0ce480 0x7f3acc0c4f30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 >> 172.21.15.149:0/2587512570 conn(0x7f3acc0cee30 msgr2=0x7f3acc0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:38.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 shutdown_connections 2023-06-09T04:37:38.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.354+0000 7f3ad1b7f700 1 -- 172.21.15.149:0/2587512570 wait complete. 2023-06-09T04:37:38.368 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:38.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.490+0000 7f8e08386700 1 Processor -- start 2023-06-09T04:37:38.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.490+0000 7f8e08386700 1 -- start start 2023-06-09T04:37:38.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e08386700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8e000cded0 0x7f8e0015d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e08386700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8e001591d0 0x7f8e00071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e08386700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000716e0 con 0x7f8e000cd300 2023-06-09T04:37:38.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e08386700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0006f4a0 con 0x7f8e000cded0 2023-06-09T04:37:38.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e08386700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0015dad0 con 0x7f8e001591d0 2023-06-09T04:37:38.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e06122700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8e000cded0 0x7f8e0015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e05921700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8e000cd300 0x7f8e000ce2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32800/0 (socket says 172.21.15.149:32800) 2023-06-09T04:37:38.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e05921700 1 -- 172.21.15.149:0/836171264 learned_addr learned my addr 172.21.15.149:0/836171264 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:38.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.491+0000 7f8e06923700 1 --2- 172.21.15.149:0/836171264 >> v2:172.21.15.184:3300/0 conn(0x7f8e001591d0 0x7f8e00071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.494 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e06122700 1 -- 172.21.15.149:0/836171264 >> v2:172.21.15.184:3300/0 conn(0x7f8e001591d0 msgr2=0x7f8e00071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e06122700 1 --2- 172.21.15.149:0/836171264 >> v2:172.21.15.184:3300/0 conn(0x7f8e001591d0 0x7f8e00071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e06122700 1 -- 172.21.15.149:0/836171264 >> v1:172.21.15.149:6789/0 conn(0x7f8e000cd300 legacy=0x7f8e000ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e05120700 1 -- 172.21.15.149:0/836171264 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133051215 0 0) 0x7f8e000716e0 con 0x7f8e000cd300 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e06122700 1 -- 172.21.15.149:0/836171264 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0006f6b0 con 0x7f8e000cded0 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e06122700 1 --2- 172.21.15.149:0/836171264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e0015d590 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8e000cf5e0 tx=0x7f8df0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ff6f65afd8e84 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e05120700 1 -- 172.21.15.149:0/836171264 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011830 con 0x7f8e000cded0 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e05120700 1 -- 172.21.15.149:0/836171264 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df0011990 con 0x7f8e000cded0 2023-06-09T04:37:38.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e05120700 1 -- 172.21.15.149:0/836171264 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0011d20 con 0x7f8e000cded0 2023-06-09T04:37:38.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e08386700 1 -- 172.21.15.149:0/836171264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 msgr2=0x7f8e0015d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.492+0000 7f8e08386700 1 --2- 172.21.15.149:0/836171264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e0015d590 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8e000cf5e0 tx=0x7f8df0009b20 comp rx=0 tx=0).stop 2023-06-09T04:37:38.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.493+0000 7f8e08386700 1 -- 172.21.15.149:0/836171264 shutdown_connections 2023-06-09T04:37:38.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.493+0000 7f8e08386700 1 --2- 172.21.15.149:0/836171264 >> v2:172.21.15.184:3300/0 conn(0x7f8e001591d0 0x7f8e00071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.493+0000 7f8e08386700 1 --2- 172.21.15.149:0/836171264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e0015d590 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.493+0000 7f8e08386700 1 -- 172.21.15.149:0/836171264 >> 172.21.15.149:0/836171264 conn(0x7f8e0006aec0 msgr2=0x7f8e0006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:38.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.493+0000 7f8e08386700 1 -- 172.21.15.149:0/836171264 shutdown_connections 2023-06-09T04:37:38.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.493+0000 7f8e08386700 1 -- 172.21.15.149:0/836171264 wait complete. 2023-06-09T04:37:38.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 Processor -- start 2023-06-09T04:37:38.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 -- start start 2023-06-09T04:37:38.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e000cd300 0x7f8e000c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e000c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e001591d0 0x7f8e000cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001f1e20 con 0x7f8e000cded0 2023-06-09T04:37:38.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000c9670 con 0x7f8e001591d0 2023-06-09T04:37:38.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.494+0000 7f8e08386700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000c4570 con 0x7f8e000cd300 2023-06-09T04:37:38.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e000c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e000c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37176/0 (socket says 172.21.15.149:37176) 2023-06-09T04:37:38.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 -- 172.21.15.149:0/1694139046 learned_addr learned my addr 172.21.15.149:0/1694139046 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:38.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 -- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e000cd300 msgr2=0x7f8e000c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e06122700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e000cd300 0x7f8e000c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e06923700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e001591d0 0x7f8e000cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e000cd300 0x7f8e000c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 -- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e001591d0 msgr2=0x7f8e000cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e001591d0 0x7f8e000cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 -- 172.21.15.149:0/1694139046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df00094a0 con 0x7f8e000cded0 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e06923700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e001591d0 0x7f8e000cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e05921700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e000c3b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c540 tx=0x7f8dfc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8df6ffd700 1 -- 172.21.15.149:0/1694139046 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc004c80 con 0x7f8e000cded0 2023-06-09T04:37:38.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8df6ffd700 1 -- 172.21.15.149:0/1694139046 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc004de0 con 0x7f8e000cded0 2023-06-09T04:37:38.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e001f2070 con 0x7f8e000cded0 2023-06-09T04:37:38.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8df6ffd700 1 -- 172.21.15.149:0/1694139046 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc007310 con 0x7f8e000cded0 2023-06-09T04:37:38.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.495+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e001f2630 con 0x7f8e000cded0 2023-06-09T04:37:38.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.496+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e001f2850 con 0x7f8e000cded0 2023-06-09T04:37:38.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.497+0000 7f8df6ffd700 1 -- 172.21.15.149:0/1694139046 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8dfc007470 con 0x7f8e000cded0 2023-06-09T04:37:38.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.497+0000 7f8df6ffd700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8de406ace0 0x7f8de406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.497+0000 7f8df6ffd700 1 -- 172.21.15.149:0/1694139046 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8dfc089540 con 0x7f8e000cded0 2023-06-09T04:37:38.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.497+0000 7f8e06122700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8de406ace0 0x7f8de406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.497+0000 7f8e06122700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8de406ace0 0x7f8de406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8df00090b0 tx=0x7f8df0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.502+0000 7f8df6ffd700 1 -- 172.21.15.149:0/1694139046 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8dfc054300 con 0x7f8e000cded0 2023-06-09T04:37:38.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.688+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e00073fa0 con 0x7f8e000cded0 2023-06-09T04:37:38.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.689+0000 7f8df6ffd700 1 -- 172.21.15.149:0/1694139046 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8dfc057920 con 0x7f8e000cded0 2023-06-09T04:37:38.690 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8de406ace0 msgr2=0x7f8de406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8de406ace0 0x7f8de406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8df00090b0 tx=0x7f8df0008030 comp rx=0 tx=0).stop 2023-06-09T04:37:38.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 msgr2=0x7f8e000c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e000c3b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc00c540 tx=0x7f8dfc00c900 comp rx=0 tx=0).stop 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 shutdown_connections 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8de406ace0 0x7f8de406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8e000cd300 0x7f8e000c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e001591d0 0x7f8e000cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 --2- 172.21.15.149:0/1694139046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e000cded0 0x7f8e000c3b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 >> 172.21.15.149:0/1694139046 conn(0x7f8e0006aec0 msgr2=0x7f8e000b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:38.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 shutdown_connections 2023-06-09T04:37:38.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.691+0000 7f8e08386700 1 -- 172.21.15.149:0/1694139046 wait complete. 2023-06-09T04:37:38.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:38.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.825+0000 7f4cf033c700 1 Processor -- start 2023-06-09T04:37:38.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.826+0000 7f4cf033c700 1 -- start start 2023-06-09T04:37:38.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.826+0000 7f4cf033c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4ce815c320 0x7f4ce80cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.826+0000 7f4cf033c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4ce8071770 0x7f4ce8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.828 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.826+0000 7f4cf033c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce8071290 con 0x7f4ce815c6f0 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.826+0000 7f4cf033c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80b2050 con 0x7f4ce8071770 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.826+0000 7f4cf033c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80cd2c0 con 0x7f4ce815c320 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced8d7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4ce8071770 0x7f4ce8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4cee8d9700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4ce815c6f0 0x7f4ce8160020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32816/0 (socket says 172.21.15.149:32816) 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4cee8d9700 1 -- 172.21.15.149:0/390962277 learned_addr learned my addr 172.21.15.149:0/390962277 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4cee0d8700 1 --2- 172.21.15.149:0/390962277 >> v2:172.21.15.184:3300/0 conn(0x7f4ce815c320 0x7f4ce80cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced8d7700 1 -- 172.21.15.149:0/390962277 >> v2:172.21.15.184:3300/0 conn(0x7f4ce815c320 msgr2=0x7f4ce80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:38.829 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced8d7700 1 --2- 172.21.15.149:0/390962277 >> v2:172.21.15.184:3300/0 conn(0x7f4ce815c320 0x7f4ce80cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced8d7700 1 -- 172.21.15.149:0/390962277 >> v1:172.21.15.149:6789/0 conn(0x7f4ce815c6f0 legacy=0x7f4ce8160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced8d7700 1 -- 172.21.15.149:0/390962277 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80cd5a0 con 0x7f4ce8071770 2023-06-09T04:37:38.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced8d7700 1 --2- 172.21.15.149:0/390962277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80cd1a0 tx=0x7f4ce4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1948b91785ee1f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced0d6700 1 -- 172.21.15.149:0/390962277 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4011830 con 0x7f4ce8071770 2023-06-09T04:37:38.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced0d6700 1 -- 172.21.15.149:0/390962277 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4011990 con 0x7f4ce8071770 2023-06-09T04:37:38.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.827+0000 7f4ced0d6700 1 -- 172.21.15.149:0/390962277 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4011d20 con 0x7f4ce8071770 2023-06-09T04:37:38.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 -- 172.21.15.149:0/390962277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 msgr2=0x7f4ce8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 --2- 172.21.15.149:0/390962277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8069db0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80cd1a0 tx=0x7f4ce4009b20 comp rx=0 tx=0).stop 2023-06-09T04:37:38.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 -- 172.21.15.149:0/390962277 shutdown_connections 2023-06-09T04:37:38.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 --2- 172.21.15.149:0/390962277 >> v2:172.21.15.184:3300/0 conn(0x7f4ce815c320 0x7f4ce80cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 --2- 172.21.15.149:0/390962277 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8069db0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 -- 172.21.15.149:0/390962277 >> 172.21.15.149:0/390962277 conn(0x7f4ce806aec0 msgr2=0x7f4ce806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:38.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 -- 172.21.15.149:0/390962277 shutdown_connections 2023-06-09T04:37:38.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.828+0000 7f4cf033c700 1 -- 172.21.15.149:0/390962277 wait complete. 2023-06-09T04:37:38.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.829+0000 7f4cf033c700 1 Processor -- start 2023-06-09T04:37:38.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.829+0000 7f4cf033c700 1 -- start start 2023-06-09T04:37:38.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce815c320 0x7f4ce80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce815c6f0 0x7f4ce81f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81550d0 con 0x7f4ce8071770 2023-06-09T04:37:38.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c6c50 con 0x7f4ce815c6f0 2023-06-09T04:37:38.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81f2710 con 0x7f4ce815c320 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37188/0 (socket says 172.21.15.149:37188) 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 -- 172.21.15.149:0/1027014576 learned_addr learned my addr 172.21.15.149:0/1027014576 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 -- 172.21.15.149:0/1027014576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce815c320 msgr2=0x7f4ce80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce815c320 0x7f4ce80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 -- 172.21.15.149:0/1027014576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce815c6f0 msgr2=0x7f4ce81f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce815c6f0 0x7f4ce81f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:38.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 -- 172.21.15.149:0/1027014576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce40094a0 con 0x7f4ce8071770 2023-06-09T04:37:38.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cee0d8700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8154b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e810 tx=0x7f4cd800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cdeffd700 1 -- 172.21.15.149:0/1027014576 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8013610 con 0x7f4ce8071770 2023-06-09T04:37:38.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cdeffd700 1 -- 172.21.15.149:0/1027014576 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8013770 con 0x7f4ce8071770 2023-06-09T04:37:38.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce81f29f0 con 0x7f4ce8071770 2023-06-09T04:37:38.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cdeffd700 1 -- 172.21.15.149:0/1027014576 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8013b20 con 0x7f4ce8071770 2023-06-09T04:37:38.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.830+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce80c71f0 con 0x7f4ce8071770 2023-06-09T04:37:38.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.831+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce8073fa0 con 0x7f4ce8071770 2023-06-09T04:37:38.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.832+0000 7f4cdeffd700 1 -- 172.21.15.149:0/1027014576 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4cd8013c80 con 0x7f4ce8071770 2023-06-09T04:37:38.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.832+0000 7f4cdeffd700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4ccc06ace0 0x7f4ccc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:38.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.832+0000 7f4cdeffd700 1 -- 172.21.15.149:0/1027014576 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4cd8089490 con 0x7f4ce8071770 2023-06-09T04:37:38.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.832+0000 7f4ced8d7700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4ccc06ace0 0x7f4ccc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:38.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.833+0000 7f4ced8d7700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4ccc06ace0 0x7f4ccc06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8071b60 tx=0x7f4ce4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:38.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:38.837+0000 7f4cdeffd700 1 -- 172.21.15.149:0/1027014576 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4cd8054260 con 0x7f4ce8071770 2023-06-09T04:37:39.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.023+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ce80b55d0 con 0x7f4ce8071770 2023-06-09T04:37:39.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.023+0000 7f4cdeffd700 1 -- 172.21.15.149:0/1027014576 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4cd8057880 con 0x7f4ce8071770 2023-06-09T04:37:39.025 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:39.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.025+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4ccc06ace0 msgr2=0x7f4ccc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.025+0000 7f4cf033c700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4ccc06ace0 0x7f4ccc06d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8071b60 tx=0x7f4ce4010000 comp rx=0 tx=0).stop 2023-06-09T04:37:39.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.025+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 msgr2=0x7f4ce8154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.025+0000 7f4cf033c700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8154b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e810 tx=0x7f4cd800ebd0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 shutdown_connections 2023-06-09T04:37:39.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4ccc06ace0 0x7f4ccc06d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ce815c6f0 0x7f4ce81f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4ce8071770 0x7f4ce8154b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 --2- 172.21.15.149:0/1027014576 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4ce815c320 0x7f4ce80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 >> 172.21.15.149:0/1027014576 conn(0x7f4ce806aec0 msgr2=0x7f4ce80cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 shutdown_connections 2023-06-09T04:37:39.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.026+0000 7f4cf033c700 1 -- 172.21.15.149:0/1027014576 wait complete. 2023-06-09T04:37:39.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:39.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.161+0000 7f000c12a700 1 Processor -- start 2023-06-09T04:37:39.162 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.161+0000 7f000c12a700 1 -- start start 2023-06-09T04:37:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f000c12a700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0004159150 0x7f0004069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f000c12a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 0x7f000406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f000c12a700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040c9300 con 0x7f00040cd6e0 2023-06-09T04:37:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f000c12a700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00040ade90 con 0x7f0004159150 2023-06-09T04:37:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f000c12a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0004159520 con 0x7f0004070a10 2023-06-09T04:37:39.165 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f000a6c7700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f00040cd6e0 0x7f000406c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32832/0 (socket says 172.21.15.149:32832) 2023-06-09T04:37:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f000a6c7700 1 -- 172.21.15.149:0/1811624061 learned_addr learned my addr 172.21.15.149:0/1811624061 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1811624061 >> v2:172.21.15.184:3300/0 conn(0x7f0004159150 0x7f0004069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f00096c5700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 0x7f000406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246468456 0 0) 0x7f00040c9300 con 0x7f00040cd6e0 2023-06-09T04:37:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff00057c0 con 0x7f00040cd6e0 2023-06-09T04:37:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 307444710 0 0) 0x7efff00057c0 con 0x7f00040cd6e0 2023-06-09T04:37:39.166 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 msgr2=0x7f000406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 0x7f000406a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 >> v2:172.21.15.184:3300/0 conn(0x7f0004159150 msgr2=0x7f0004069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 --2- 172.21.15.149:0/1811624061 >> v2:172.21.15.184:3300/0 conn(0x7f0004159150 0x7f0004069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040adbb0 con 0x7f00040cd6e0 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7efffc0019f0 con 0x7f00040cd6e0 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 >> v1:172.21.15.149:6789/0 conn(0x7f00040cd6e0 legacy=0x7f000406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.162+0000 7f0008ec4700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7efff0006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.167 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 0x7efff0006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efff0006fa0 0x7efff0007410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040ade90 con 0x7efff0005c10 2023-06-09T04:37:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004159520 con 0x7efff0006fa0 2023-06-09T04:37:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff000dcd0 con 0x7f0004070a10 2023-06-09T04:37:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7efff0006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f00096c5700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 0x7efff0006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.168 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f000a6c7700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efff0006fa0 0x7efff0007410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0009ec6700 1 -- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 msgr2=0x7efff0006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0004070a10 0x7efff0006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0009ec6700 1 -- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efff0006fa0 msgr2=0x7efff0007410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efff0006fa0 0x7efff0007410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0009ec6700 1 -- 172.21.15.149:0/1811624061 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00057c0 con 0x7efff0005c10 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f000a6c7700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efff0006fa0 0x7efff0007410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7efff0006020 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0000009b60 tx=0x7efff0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b058c1b464e06d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000e6c0 con 0x7efff0005c10 2023-06-09T04:37:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000e820 con 0x7efff0005c10 2023-06-09T04:37:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.163+0000 7f0008ec4700 1 -- 172.21.15.149:0/1811624061 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000eb90 con 0x7efff0005c10 2023-06-09T04:37:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.164+0000 7f000c12a700 1 -- 172.21.15.149:0/1811624061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 msgr2=0x7efff0006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.164+0000 7f000c12a700 1 --2- 172.21.15.149:0/1811624061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7efff0006020 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0000009b60 tx=0x7efff0007a90 comp rx=0 tx=0).stop 2023-06-09T04:37:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.164+0000 7f000a6c7700 1 -- 172.21.15.149:0/1811624061 reap_dead start 2023-06-09T04:37:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.164+0000 7f000c12a700 1 -- 172.21.15.149:0/1811624061 shutdown_connections 2023-06-09T04:37:39.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.164+0000 7f000c12a700 1 -- 172.21.15.149:0/1811624061 >> 172.21.15.149:0/1811624061 conn(0x7f00040cf220 msgr2=0x7f00040cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:39.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.164+0000 7f000c12a700 1 -- 172.21.15.149:0/1811624061 shutdown_connections 2023-06-09T04:37:39.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.164+0000 7f000c12a700 1 -- 172.21.15.149:0/1811624061 wait complete. 2023-06-09T04:37:39.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.165+0000 7f000c12a700 1 Processor -- start 2023-06-09T04:37:39.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.165+0000 7f000c12a700 1 -- start start 2023-06-09T04:37:39.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000c12a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7f000415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000c12a700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f000415bf10 0x7f00041494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000c12a700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00041ed230 0x7f0004145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000c12a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000415ba80 con 0x7efff0005c10 2023-06-09T04:37:39.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000c12a700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00041499e0 con 0x7f00041ed230 2023-06-09T04:37:39.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000c12a700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000415ae70 con 0x7f000415bf10 2023-06-09T04:37:39.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7f000415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7f000415a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37208/0 (socket says 172.21.15.149:37208) 2023-06-09T04:37:39.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 -- 172.21.15.149:0/1663328298 learned_addr learned my addr 172.21.15.149:0/1663328298 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:39.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f00096c5700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f000415bf10 0x7f00041494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000a6c7700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00041ed230 0x7f0004145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 -- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f000415bf10 msgr2=0x7f00041494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f000415bf10 0x7f00041494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 -- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00041ed230 msgr2=0x7f0004145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00041ed230 0x7f0004145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 -- 172.21.15.149:0/1663328298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000415b150 con 0x7efff0005c10 2023-06-09T04:37:39.176 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f0009ec6700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7f000415a7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00000090b0 tx=0x7f00000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7efffa7fc700 1 -- 172.21.15.149:0/1663328298 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000021070 con 0x7efff0005c10 2023-06-09T04:37:39.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7efffa7fc700 1 -- 172.21.15.149:0/1663328298 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00000044e0 con 0x7efff0005c10 2023-06-09T04:37:39.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000415ba80 con 0x7efff0005c10 2023-06-09T04:37:39.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.166+0000 7efffa7fc700 1 -- 172.21.15.149:0/1663328298 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000e6c0 con 0x7efff0005c10 2023-06-09T04:37:39.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.167+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000415b710 con 0x7efff0005c10 2023-06-09T04:37:39.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.168+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000415b8a0 con 0x7efff0005c10 2023-06-09T04:37:39.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.168+0000 7efffa7fc700 1 -- 172.21.15.149:0/1663328298 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0000025070 con 0x7efff0005c10 2023-06-09T04:37:39.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.168+0000 7efffa7fc700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7effe806ace0 0x7effe806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.168+0000 7efffa7fc700 1 -- 172.21.15.149:0/1663328298 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f000008a970 con 0x7efff0005c10 2023-06-09T04:37:39.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.168+0000 7f00096c5700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7effe806ace0 0x7effe806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.169+0000 7f00096c5700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7effe806ace0 0x7effe806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00040b1ae0 tx=0x7efff4009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.172+0000 7efffa7fc700 1 -- 172.21.15.149:0/1663328298 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f00000558e0 con 0x7efff0005c10 2023-06-09T04:37:39.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.358+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f000415bd60 con 0x7efff0005c10 2023-06-09T04:37:39.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.358+0000 7efffa7fc700 1 -- 172.21.15.149:0/1663328298 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0000058f00 con 0x7efff0005c10 2023-06-09T04:37:39.360 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:39.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7effe806ace0 msgr2=0x7effe806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7effe806ace0 0x7effe806d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00040b1ae0 tx=0x7efff4009210 comp rx=0 tx=0).stop 2023-06-09T04:37:39.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 msgr2=0x7f000415a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7f000415a7e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00000090b0 tx=0x7f00000047c0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 shutdown_connections 2023-06-09T04:37:39.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7effe806ace0 0x7effe806d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00041ed230 0x7f0004145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efff0005c10 0x7f000415a7e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 --2- 172.21.15.149:0/1663328298 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f000415bf10 0x7f00041494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.360+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 >> 172.21.15.149:0/1663328298 conn(0x7f00040cf220 msgr2=0x7f00040c7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:39.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.361+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 shutdown_connections 2023-06-09T04:37:39.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.361+0000 7f000c12a700 1 -- 172.21.15.149:0/1663328298 wait complete. 2023-06-09T04:37:39.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:39.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.496+0000 7fdf0e317700 1 Processor -- start 2023-06-09T04:37:39.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.496+0000 7fdf0e317700 1 -- start start 2023-06-09T04:37:39.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.496+0000 7fdf0e317700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf080ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.496+0000 7fdf0e317700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf0806a9c0 0x7fdf0806ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.496+0000 7fdf0e317700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0815c5d0 con 0x7fdf080ce480 2023-06-09T04:37:39.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.496+0000 7fdf0e317700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0806b340 con 0x7fdf0806a9c0 2023-06-09T04:37:39.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.496+0000 7fdf0e317700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080cec20 con 0x7fdf0815c200 2023-06-09T04:37:39.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf0806a9c0 0x7fdf0806ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf0806a9c0 0x7fdf0806ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37220/0 (socket says 172.21.15.149:37220) 2023-06-09T04:37:39.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 -- 172.21.15.149:0/2592287500 learned_addr learned my addr 172.21.15.149:0/2592287500 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:39.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf07fff700 1 --2- 172.21.15.149:0/2592287500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf080ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 -- 172.21.15.149:0/2592287500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 msgr2=0x7fdf080ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 --2- 172.21.15.149:0/2592287500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf080ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 -- 172.21.15.149:0/2592287500 >> v1:172.21.15.184:6789/0 conn(0x7fdf080ce480 legacy=0x7fdf0806c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 -- 172.21.15.149:0/2592287500 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf080ce940 con 0x7fdf0806a9c0 2023-06-09T04:37:39.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf0c8b4700 1 --2- 172.21.15.149:0/2592287500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0806a9c0 0x7fdf0806ae00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009e50 tx=0x7fdf0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f48e25b56e7a949 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf06ffd700 1 -- 172.21.15.149:0/2592287500 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000e070 con 0x7fdf0806a9c0 2023-06-09T04:37:39.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf06ffd700 1 -- 172.21.15.149:0/2592287500 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf00003a20 con 0x7fdf0806a9c0 2023-06-09T04:37:39.501 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.497+0000 7fdf06ffd700 1 -- 172.21.15.149:0/2592287500 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00003dd0 con 0x7fdf0806a9c0 2023-06-09T04:37:39.502 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 -- 172.21.15.149:0/2592287500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0806a9c0 msgr2=0x7fdf0806ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 --2- 172.21.15.149:0/2592287500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0806a9c0 0x7fdf0806ae00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009e50 tx=0x7fdf0000b330 comp rx=0 tx=0).stop 2023-06-09T04:37:39.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 -- 172.21.15.149:0/2592287500 shutdown_connections 2023-06-09T04:37:39.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 --2- 172.21.15.149:0/2592287500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0806a9c0 0x7fdf0806ae00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 --2- 172.21.15.149:0/2592287500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf080ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 -- 172.21.15.149:0/2592287500 >> 172.21.15.149:0/2592287500 conn(0x7fdf080cee30 msgr2=0x7fdf080cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:39.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 -- 172.21.15.149:0/2592287500 shutdown_connections 2023-06-09T04:37:39.503 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.498+0000 7fdf0e317700 1 -- 172.21.15.149:0/2592287500 wait complete. 2023-06-09T04:37:39.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.499+0000 7fdf0e317700 1 Processor -- start 2023-06-09T04:37:39.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.499+0000 7fdf0e317700 1 -- start start 2023-06-09T04:37:39.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf0e317700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf0806a9c0 0x7fdf080ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf0e317700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf080ce480 0x7fdf081f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf0e317700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf081f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf0e317700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081f2f70 con 0x7fdf080ce480 2023-06-09T04:37:39.504 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf0e317700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081f25d0 con 0x7fdf0806a9c0 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf0e317700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081f28b0 con 0x7fdf0815c200 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf077fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf080ce480 0x7fdf081f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf077fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf080ce480 0x7fdf081f1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37224/0 (socket says 172.21.15.149:37224) 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf077fe700 1 -- 172.21.15.149:0/174338500 learned_addr learned my addr 172.21.15.149:0/174338500 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf0c8b4700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf081f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.500+0000 7fdf07fff700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf0806a9c0 0x7fdf080ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf077fe700 1 -- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 msgr2=0x7fdf081f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.505 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf077fe700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf081f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf077fe700 1 -- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf0806a9c0 msgr2=0x7fdf080ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf077fe700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf0806a9c0 0x7fdf080ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf077fe700 1 -- 172.21.15.149:0/174338500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00009b30 con 0x7fdf080ce480 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf077fe700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf080ce480 0x7fdf081f1ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c4a0 tx=0x7fdefc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf04ff9700 1 -- 172.21.15.149:0/174338500 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc011790 con 0x7fdf080ce480 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf04ff9700 1 -- 172.21.15.149:0/174338500 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc0118f0 con 0x7fdf080ce480 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf081f2b90 con 0x7fdf080ce480 2023-06-09T04:37:39.506 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf04ff9700 1 -- 172.21.15.149:0/174338500 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc011ca0 con 0x7fdf080ce480 2023-06-09T04:37:39.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.501+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf081f3390 con 0x7fdf080ce480 2023-06-09T04:37:39.507 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.502+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf081f3520 con 0x7fdf080ce480 2023-06-09T04:37:39.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.502+0000 7fdf04ff9700 1 -- 172.21.15.149:0/174338500 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdefc01c460 con 0x7fdf080ce480 2023-06-09T04:37:39.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.503+0000 7fdf04ff9700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdef406ace0 0x7fdef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.503+0000 7fdf04ff9700 1 -- 172.21.15.149:0/174338500 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdefc089390 con 0x7fdf080ce480 2023-06-09T04:37:39.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.503+0000 7fdf07fff700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdef406ace0 0x7fdef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.503+0000 7fdf07fff700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdef406ace0 0x7fdef406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdef8006b20 tx=0x7fdef8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.508 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.507+0000 7fdf04ff9700 1 -- 172.21.15.149:0/174338500 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf081f3520 con 0x7fdf080ce480 2023-06-09T04:37:39.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.696+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdf081f30b0 con 0x7fdf080ce480 2023-06-09T04:37:39.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.697+0000 7fdf04ff9700 1 -- 172.21.15.149:0/174338500 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdf081f30b0 con 0x7fdf080ce480 2023-06-09T04:37:39.698 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:39.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdef406ace0 msgr2=0x7fdef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdef406ace0 0x7fdef406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdef8006b20 tx=0x7fdef8008040 comp rx=0 tx=0).stop 2023-06-09T04:37:39.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf080ce480 msgr2=0x7fdf081f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf080ce480 0x7fdf081f1ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00c4a0 tx=0x7fdefc00c7b0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 shutdown_connections 2023-06-09T04:37:39.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdef406ace0 0x7fdef406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf0815c200 0x7fdf081f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf0806a9c0 0x7fdf080ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 --2- 172.21.15.149:0/174338500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf080ce480 0x7fdf081f1ab0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 >> 172.21.15.149:0/174338500 conn(0x7fdf080cee30 msgr2=0x7fdf080cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:39.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 shutdown_connections 2023-06-09T04:37:39.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.699+0000 7fdf0e317700 1 -- 172.21.15.149:0/174338500 wait complete. 2023-06-09T04:37:39.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:39.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.831+0000 7fdbc7360700 1 Processor -- start 2023-06-09T04:37:39.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.831+0000 7fdbc7360700 1 -- start start 2023-06-09T04:37:39.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc7360700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdbc015c590 0x7fdbc00af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc7360700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbc006a4c0 0x7fdbc00b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc7360700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc00af050 con 0x7fdbc00ccba0 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc7360700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc00afae0 con 0x7fdbc006a4c0 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc7360700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc00af800 con 0x7fdbc015c590 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbc006a4c0 0x7fdbc00b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbc006a4c0 0x7fdbc00b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37232/0 (socket says 172.21.15.149:37232) 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 -- 172.21.15.149:0/3069458577 learned_addr learned my addr 172.21.15.149:0/3069458577 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:39.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc50fc700 1 --2- 172.21.15.149:0/3069458577 >> v2:172.21.15.184:3300/0 conn(0x7fdbc015c590 0x7fdbc00af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 -- 172.21.15.149:0/3069458577 >> v2:172.21.15.184:3300/0 conn(0x7fdbc015c590 msgr2=0x7fdbc00af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 --2- 172.21.15.149:0/3069458577 >> v2:172.21.15.184:3300/0 conn(0x7fdbc015c590 0x7fdbc00af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 -- 172.21.15.149:0/3069458577 >> v1:172.21.15.184:6789/0 conn(0x7fdbc00ccba0 legacy=0x7fdbc0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:39.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 -- 172.21.15.149:0/3069458577 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc00cc0c0 con 0x7fdbc006a4c0 2023-06-09T04:37:39.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbc58fd700 1 --2- 172.21.15.149:0/3069458577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc00b06d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006fcd0 tx=0x7fdbb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac2d492cf1ac3b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbb7fff700 1 -- 172.21.15.149:0/3069458577 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800e070 con 0x7fdbc006a4c0 2023-06-09T04:37:39.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbb7fff700 1 -- 172.21.15.149:0/3069458577 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8003a20 con 0x7fdbc006a4c0 2023-06-09T04:37:39.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.832+0000 7fdbb7fff700 1 -- 172.21.15.149:0/3069458577 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8003dd0 con 0x7fdbc006a4c0 2023-06-09T04:37:39.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 -- 172.21.15.149:0/3069458577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 msgr2=0x7fdbc00b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 --2- 172.21.15.149:0/3069458577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc00b06d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006fcd0 tx=0x7fdbb800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:39.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 -- 172.21.15.149:0/3069458577 shutdown_connections 2023-06-09T04:37:39.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 --2- 172.21.15.149:0/3069458577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc00b06d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 --2- 172.21.15.149:0/3069458577 >> v2:172.21.15.184:3300/0 conn(0x7fdbc015c590 0x7fdbc00af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 -- 172.21.15.149:0/3069458577 >> 172.21.15.149:0/3069458577 conn(0x7fdbc006b7e0 msgr2=0x7fdbc00cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:39.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 -- 172.21.15.149:0/3069458577 shutdown_connections 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.833+0000 7fdbc7360700 1 -- 172.21.15.149:0/3069458577 wait complete. 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.835+0000 7fdbc7360700 1 Processor -- start 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.835+0000 7fdbc7360700 1 -- start start 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.835+0000 7fdbc7360700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc01f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.835+0000 7fdbc7360700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc00ccba0 0x7fdbc00b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc7360700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc015c590 0x7fdbc00b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc7360700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0156450 con 0x7fdbc006a4c0 2023-06-09T04:37:39.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc7360700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00b3880 con 0x7fdbc015c590 2023-06-09T04:37:39.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc7360700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc00b2a10 con 0x7fdbc00ccba0 2023-06-09T04:37:39.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc01f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc01f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37234/0 (socket says 172.21.15.149:37234) 2023-06-09T04:37:39.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 -- 172.21.15.149:0/1560650804 learned_addr learned my addr 172.21.15.149:0/1560650804 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:39.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc48fb700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc00ccba0 0x7fdbc00b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc58fd700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc015c590 0x7fdbc00b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 -- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc00ccba0 msgr2=0x7fdbc00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc00ccba0 0x7fdbc00b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 -- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc015c590 msgr2=0x7fdbc00b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc015c590 0x7fdbc00b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 -- 172.21.15.149:0/1560650804 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb8009b30 con 0x7fdbc006a4c0 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc58fd700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc015c590 0x7fdbc00b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc50fc700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc01f2580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00d7d0 tx=0x7fdbbc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbb5ffb700 1 -- 172.21.15.149:0/1560650804 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0125f0 con 0x7fdbc006a4c0 2023-06-09T04:37:39.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbb5ffb700 1 -- 172.21.15.149:0/1560650804 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc012750 con 0x7fdbc006a4c0 2023-06-09T04:37:39.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc00b2c70 con 0x7fdbc006a4c0 2023-06-09T04:37:39.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbb5ffb700 1 -- 172.21.15.149:0/1560650804 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc012b00 con 0x7fdbc006a4c0 2023-06-09T04:37:39.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.836+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc00b3230 con 0x7fdbc006a4c0 2023-06-09T04:37:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.837+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc00cd9d0 con 0x7fdbc006a4c0 2023-06-09T04:37:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.838+0000 7fdbb5ffb700 1 -- 172.21.15.149:0/1560650804 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbbc012c60 con 0x7fdbc006a4c0 2023-06-09T04:37:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.838+0000 7fdbb5ffb700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba406ace0 0x7fdba406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.838+0000 7fdbb5ffb700 1 -- 172.21.15.149:0/1560650804 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdbbc0896f0 con 0x7fdbc006a4c0 2023-06-09T04:37:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.838+0000 7fdbc48fb700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba406ace0 0x7fdba406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:39.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.839+0000 7fdbc48fb700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba406ace0 0x7fdba406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00b55d0 tx=0x7fdbb0007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:39.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:39.842+0000 7fdbb5ffb700 1 -- 172.21.15.149:0/1560650804 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdbbc054540 con 0x7fdbc006a4c0 2023-06-09T04:37:40.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.029+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbc0073fa0 con 0x7fdbc006a4c0 2023-06-09T04:37:40.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.030+0000 7fdbb5ffb700 1 -- 172.21.15.149:0/1560650804 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20074 (secure 0 0 0) 0x7fdbbc057b60 con 0x7fdbc006a4c0 2023-06-09T04:37:40.032 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:40.032 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":26,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:36:57.496164+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba406ace0 msgr2=0x7fdba406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba406ace0 0x7fdba406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbc00b55d0 tx=0x7fdbb0007ec0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 msgr2=0x7fdbc01f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc01f2580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00d7d0 tx=0x7fdbbc00dae0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 shutdown_connections 2023-06-09T04:37:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba406ace0 0x7fdba406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbc015c590 0x7fdbc00b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbc006a4c0 0x7fdbc01f2580 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 --2- 172.21.15.149:0/1560650804 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbc00ccba0 0x7fdbc00b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 >> 172.21.15.149:0/1560650804 conn(0x7fdbc006b7e0 msgr2=0x7fdbc0069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 shutdown_connections 2023-06-09T04:37:40.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.033+0000 7fdbc7360700 1 -- 172.21.15.149:0/1560650804 wait complete. 2023-06-09T04:37:40.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:40.047 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:40.169 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.168+0000 7f1d16a7c700 1 Processor -- start 2023-06-09T04:37:40.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.169+0000 7f1d16a7c700 1 -- start start 2023-06-09T04:37:40.170 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.169+0000 7f1d16a7c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1d1015b180 0x7f1d10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.169+0000 7f1d16a7c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1015a520 con 0x7f1d1015a150 2023-06-09T04:37:40.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.169+0000 7f1d16a7c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1015b620 con 0x7f1d1006a2f0 2023-06-09T04:37:40.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.169+0000 7f1d16a7c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1006a6f0 con 0x7f1d1015b180 2023-06-09T04:37:40.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.169+0000 7f1d0ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1d1015b180 0x7f1d10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d14818700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1d1015a150 0x7f1d100cb690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32874/0 (socket says 172.21.15.149:32874) 2023-06-09T04:37:40.171 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d14818700 1 -- 172.21.15.149:0/2886066683 learned_addr learned my addr 172.21.15.149:0/2886066683 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:40.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0ffff700 1 -- 172.21.15.149:0/2886066683 >> v1:172.21.15.184:6789/0 conn(0x7f1d1006a2f0 legacy=0x7f1d100711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:40.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0ffff700 1 -- 172.21.15.149:0/2886066683 >> v1:172.21.15.149:6789/0 conn(0x7f1d1015a150 legacy=0x7f1d100cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0f7fe700 1 -- 172.21.15.149:0/2886066683 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631528272 0 0) 0x7f1d1015a520 con 0x7f1d1015a150 2023-06-09T04:37:40.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0ffff700 1 -- 172.21.15.149:0/2886066683 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1006ed00 con 0x7f1d1015b180 2023-06-09T04:37:40.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0ffff700 1 --2- 172.21.15.149:0/2886066683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d10069db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009840 tx=0x7f1cfc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8d4d642581b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.173 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0f7fe700 1 -- 172.21.15.149:0/2886066683 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc004230 con 0x7f1d1015b180 2023-06-09T04:37:40.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0f7fe700 1 -- 172.21.15.149:0/2886066683 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc004390 con 0x7f1d1015b180 2023-06-09T04:37:40.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.170+0000 7f1d0f7fe700 1 -- 172.21.15.149:0/2886066683 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc0036a0 con 0x7f1d1015b180 2023-06-09T04:37:40.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.171+0000 7f1d16a7c700 1 -- 172.21.15.149:0/2886066683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 msgr2=0x7f1d10069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.171+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/2886066683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d10069db0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009840 tx=0x7f1cfc009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:40.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.171+0000 7f1d16a7c700 1 -- 172.21.15.149:0/2886066683 shutdown_connections 2023-06-09T04:37:40.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.171+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/2886066683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d10069db0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.174 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.171+0000 7f1d16a7c700 1 -- 172.21.15.149:0/2886066683 >> 172.21.15.149:0/2886066683 conn(0x7f1d1006aec0 msgr2=0x7f1d1006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:40.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.171+0000 7f1d16a7c700 1 -- 172.21.15.149:0/2886066683 shutdown_connections 2023-06-09T04:37:40.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.171+0000 7f1d16a7c700 1 -- 172.21.15.149:0/2886066683 wait complete. 2023-06-09T04:37:40.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.172+0000 7f1d16a7c700 1 Processor -- start 2023-06-09T04:37:40.175 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.172+0000 7f1d16a7c700 1 -- start start 2023-06-09T04:37:40.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d1006a2f0 0x7f1d100b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d1015a150 0x7f1d10151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d100c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.177 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100b36e0 con 0x7f1d1015b180 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100b39c0 con 0x7f1d1015a150 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100b3ca0 con 0x7f1d1006a2f0 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d100c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d100c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37252/0 (socket says 172.21.15.149:37252) 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 -- 172.21.15.149:0/3486822505 learned_addr learned my addr 172.21.15.149:0/3486822505 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d14818700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d1006a2f0 0x7f1d100b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d0ffff700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d1015a150 0x7f1d10151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.178 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 -- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d1006a2f0 msgr2=0x7f1d100b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d1006a2f0 0x7f1d100b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 -- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d1015a150 msgr2=0x7f1d10151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d1015a150 0x7f1d10151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 -- 172.21.15.149:0/3486822505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0094a0 con 0x7f1d1015b180 2023-06-09T04:37:40.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d14818700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d1006a2f0 0x7f1d100b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:40.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d15019700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d100c8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800cc10 tx=0x7f1d0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.179 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d0d7fa700 1 -- 172.21.15.149:0/3486822505 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0800abb0 con 0x7f1d1015b180 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d0d7fa700 1 -- 172.21.15.149:0/3486822505 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0800ad10 con 0x7f1d1015b180 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d10153790 con 0x7f1d1015b180 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d0d7fa700 1 -- 172.21.15.149:0/3486822505 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d08012660 con 0x7f1d1015b180 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.173+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d101533f0 con 0x7f1d1015b180 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.174+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d101539d0 con 0x7f1d1015b180 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.175+0000 7f1d0d7fa700 1 -- 172.21.15.149:0/3486822505 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d080127c0 con 0x7f1d1015b180 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.175+0000 7f1d0d7fa700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1cf406ace0 0x7f1cf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.180 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.175+0000 7f1d0d7fa700 1 -- 172.21.15.149:0/3486822505 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1d08089e90 con 0x7f1d1015b180 2023-06-09T04:37:40.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.175+0000 7f1d14818700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1cf406ace0 0x7f1cf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.176+0000 7f1d14818700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1cf406ace0 0x7f1cf406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d04000f60 tx=0x7f1d04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.181 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.180+0000 7f1d0d7fa700 1 -- 172.21.15.149:0/3486822505 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d101539d0 con 0x7f1d1015b180 2023-06-09T04:37:40.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.371+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1d101539d0 con 0x7f1d1015b180 2023-06-09T04:37:40.372 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.372+0000 7f1d0d7fa700 1 -- 172.21.15.149:0/3486822505 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1d101539d0 con 0x7f1d1015b180 2023-06-09T04:37:40.373 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:40.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1cf406ace0 msgr2=0x7f1cf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1cf406ace0 0x7f1cf406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d04000f60 tx=0x7f1d04009040 comp rx=0 tx=0).stop 2023-06-09T04:37:40.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 msgr2=0x7f1d100c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d100c8aa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800cc10 tx=0x7f1d0800a060 comp rx=0 tx=0).stop 2023-06-09T04:37:40.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 shutdown_connections 2023-06-09T04:37:40.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1cf406ace0 0x7f1cf406d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1d1006a2f0 0x7f1d100b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d1015b180 0x7f1d100c8aa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 --2- 172.21.15.149:0/3486822505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d1015a150 0x7f1d10151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 >> 172.21.15.149:0/3486822505 conn(0x7f1d1006aec0 msgr2=0x7f1d1006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:40.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 shutdown_connections 2023-06-09T04:37:40.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.374+0000 7f1d16a7c700 1 -- 172.21.15.149:0/3486822505 wait complete. 2023-06-09T04:37:40.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:40.512 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.511+0000 7f8eb5bb7700 1 Processor -- start 2023-06-09T04:37:40.513 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.511+0000 7f8eb5bb7700 1 -- start start 2023-06-09T04:37:40.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eb5bb7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8eb015c270 0x7f8eb00d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eb5bb7700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8eb00ce310 0x7f8eb00cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eb5bb7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb00d0d30 con 0x7f8eb00cd670 2023-06-09T04:37:40.514 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eb5bb7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb006aec0 con 0x7f8eb015c270 2023-06-09T04:37:40.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eb5bb7700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb00d1520 con 0x7f8eb00ce310 2023-06-09T04:37:40.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eaf7fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8eb015c270 0x7f8eb00d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eaffff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f8eb00cd670 0x7f8eb015fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32896/0 (socket says 172.21.15.149:32896) 2023-06-09T04:37:40.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eaffff700 1 -- 172.21.15.149:0/4037381026 learned_addr learned my addr 172.21.15.149:0/4037381026 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:40.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.512+0000 7f8eaeffd700 1 --2- 172.21.15.149:0/4037381026 >> v2:172.21.15.184:3300/0 conn(0x7f8eb00ce310 0x7f8eb00cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eaf7fe700 1 -- 172.21.15.149:0/4037381026 >> v2:172.21.15.184:3300/0 conn(0x7f8eb00ce310 msgr2=0x7f8eb00cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:40.515 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eaf7fe700 1 --2- 172.21.15.149:0/4037381026 >> v2:172.21.15.184:3300/0 conn(0x7f8eb00ce310 0x7f8eb00cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eaf7fe700 1 -- 172.21.15.149:0/4037381026 >> v1:172.21.15.149:6789/0 conn(0x7f8eb00cd670 legacy=0x7f8eb015fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eaf7fe700 1 -- 172.21.15.149:0/4037381026 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb00cdad0 con 0x7f8eb015c270 2023-06-09T04:37:40.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eae7fc700 1 -- 172.21.15.149:0/4037381026 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174396941 0 0) 0x7f8eb00d0d30 con 0x7f8eb00cd670 2023-06-09T04:37:40.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eaf7fe700 1 --2- 172.21.15.149:0/4037381026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb015c270 0x7f8eb00d07f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006e0c0 tx=0x7f8ea4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85a496afdaecad0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eae7fc700 1 -- 172.21.15.149:0/4037381026 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011830 con 0x7f8eb015c270 2023-06-09T04:37:40.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eae7fc700 1 -- 172.21.15.149:0/4037381026 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4011990 con 0x7f8eb015c270 2023-06-09T04:37:40.516 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eae7fc700 1 -- 172.21.15.149:0/4037381026 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4011d20 con 0x7f8eb015c270 2023-06-09T04:37:40.518 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4037381026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb015c270 msgr2=0x7f8eb00d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4037381026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb015c270 0x7f8eb00d07f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8eb006e0c0 tx=0x7f8ea4009b20 comp rx=0 tx=0).stop 2023-06-09T04:37:40.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4037381026 shutdown_connections 2023-06-09T04:37:40.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4037381026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb015c270 0x7f8eb00d07f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4037381026 >> v2:172.21.15.184:3300/0 conn(0x7f8eb00ce310 0x7f8eb00cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4037381026 >> 172.21.15.149:0/4037381026 conn(0x7f8eb0069db0 msgr2=0x7f8eb006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:40.519 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.513+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4037381026 shutdown_connections 2023-06-09T04:37:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.514+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4037381026 wait complete. 2023-06-09T04:37:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.515+0000 7f8eb5bb7700 1 Processor -- start 2023-06-09T04:37:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.515+0000 7f8eb5bb7700 1 -- start start 2023-06-09T04:37:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.515+0000 7f8eb5bb7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb00cd670 0x7f8eb0155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eb5bb7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb00ce310 0x7f8eb00b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eb5bb7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb015c270 0x7f8eb00b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eb5bb7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00b4430 con 0x7f8eb00ce310 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eb5bb7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00b3e70 con 0x7f8eb00cd670 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eb5bb7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb00b4150 con 0x7f8eb015c270 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb00ce310 0x7f8eb00b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb00ce310 0x7f8eb00b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37268/0 (socket says 172.21.15.149:37268) 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 -- 172.21.15.149:0/4144646116 learned_addr learned my addr 172.21.15.149:0/4144646116 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaf7fe700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb00cd670 0x7f8eb0155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaffff700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb015c270 0x7f8eb00b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.521 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 -- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb015c270 msgr2=0x7f8eb00b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb015c270 0x7f8eb00b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 -- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb00cd670 msgr2=0x7f8eb0155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb00cd670 0x7f8eb0155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 -- 172.21.15.149:0/4144646116 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40094a0 con 0x7f8eb00ce310 2023-06-09T04:37:40.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaf7fe700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb00cd670 0x7f8eb0155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:40.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eaeffd700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb00ce310 0x7f8eb00b3570 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000e9d0 tx=0x7f8ea000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.522 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8e97fff700 1 -- 172.21.15.149:0/4144646116 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0009730 con 0x7f8eb00ce310 2023-06-09T04:37:40.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8e97fff700 1 -- 172.21.15.149:0/4144646116 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000c850 con 0x7f8eb00ce310 2023-06-09T04:37:40.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb00b5460 con 0x7f8eb00ce310 2023-06-09T04:37:40.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8e97fff700 1 -- 172.21.15.149:0/4144646116 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000cbe0 con 0x7f8eb00ce310 2023-06-09T04:37:40.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.516+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb0156170 con 0x7f8eb00ce310 2023-06-09T04:37:40.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.517+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb0066680 con 0x7f8eb00ce310 2023-06-09T04:37:40.523 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.518+0000 7f8e97fff700 1 -- 172.21.15.149:0/4144646116 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ea000cd40 con 0x7f8eb00ce310 2023-06-09T04:37:40.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.518+0000 7f8e97fff700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e9c06ace0 0x7f8e9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.518+0000 7f8e97fff700 1 -- 172.21.15.149:0/4144646116 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8ea0089900 con 0x7f8eb00ce310 2023-06-09T04:37:40.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.518+0000 7f8eaf7fe700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e9c06ace0 0x7f8e9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.519+0000 7f8eaf7fe700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e9c06ace0 0x7f8e9c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40090b0 tx=0x7f8ea401c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.523+0000 7f8e97fff700 1 -- 172.21.15.149:0/4144646116 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8eb0066680 con 0x7f8eb00ce310 2023-06-09T04:37:40.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.718+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8eb0066680 con 0x7f8eb00ce310 2023-06-09T04:37:40.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.719+0000 7f8e97fff700 1 -- 172.21.15.149:0/4144646116 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8eb0066680 con 0x7f8eb00ce310 2023-06-09T04:37:40.720 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:40.722 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e9c06ace0 msgr2=0x7f8e9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e9c06ace0 0x7f8e9c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40090b0 tx=0x7f8ea401c040 comp rx=0 tx=0).stop 2023-06-09T04:37:40.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb00ce310 msgr2=0x7f8eb00b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb00ce310 0x7f8eb00b3570 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000e9d0 tx=0x7f8ea000ed90 comp rx=0 tx=0).stop 2023-06-09T04:37:40.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 shutdown_connections 2023-06-09T04:37:40.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8e9c06ace0 0x7f8e9c06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8eb015c270 0x7f8eb00b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8eb00cd670 0x7f8eb0155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 --2- 172.21.15.149:0/4144646116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8eb00ce310 0x7f8eb00b3570 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 >> 172.21.15.149:0/4144646116 conn(0x7f8eb0069db0 msgr2=0x7f8eb00cfce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:40.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 shutdown_connections 2023-06-09T04:37:40.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.721+0000 7f8eb5bb7700 1 -- 172.21.15.149:0/4144646116 wait complete. 2023-06-09T04:37:40.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:40.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.856+0000 7fefab41d700 1 Processor -- start 2023-06-09T04:37:40.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.856+0000 7fefab41d700 1 -- start start 2023-06-09T04:37:40.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefab41d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fefa415c270 0x7fefa40d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefab41d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa40cd840 0x7fefa40cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefab41d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa40d0d30 con 0x7fefa40ce310 2023-06-09T04:37:40.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefab41d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa406aec0 con 0x7fefa415c270 2023-06-09T04:37:40.858 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefab41d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa40d1520 con 0x7fefa40cd840 2023-06-09T04:37:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefa99ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa40cd840 0x7fefa40cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefa91b9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fefa415c270 0x7fefa40d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefa89b8700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fefa40ce310 0x7fefa40cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:38904/0 (socket says 172.21.15.149:38904) 2023-06-09T04:37:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefa99ba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa40cd840 0x7fefa40cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42890/0 (socket says 172.21.15.149:42890) 2023-06-09T04:37:40.860 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefa91b9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fefa415c270 0x7fefa40d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:56538/0 (socket says 172.21.15.149:56538) 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fefa89b8700 1 -- 172.21.15.149:0/499619588 learned_addr learned my addr 172.21.15.149:0/499619588 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fef9bfff700 1 -- 172.21.15.149:0/499619588 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261510003 0 0) 0x7fefa40d0d30 con 0x7fefa40ce310 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.857+0000 7fef9bfff700 1 -- 172.21.15.149:0/499619588 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef900035b0 con 0x7fefa40ce310 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefa99ba700 1 -- 172.21.15.149:0/499619588 >> v2:172.21.15.184:3300/0 conn(0x7fefa415c270 msgr2=0x7fefa40d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefa99ba700 1 --2- 172.21.15.149:0/499619588 >> v2:172.21.15.184:3300/0 conn(0x7fefa415c270 0x7fefa40d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefa99ba700 1 -- 172.21.15.149:0/499619588 >> v1:172.21.15.184:6789/0 conn(0x7fefa40ce310 legacy=0x7fefa40cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefa99ba700 1 -- 172.21.15.149:0/499619588 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa40cb1a0 con 0x7fefa40cd840 2023-06-09T04:37:40.861 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefa91b9700 1 --2- 172.21.15.149:0/499619588 >> v2:172.21.15.184:3300/0 conn(0x7fefa415c270 0x7fefa40d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefa99ba700 1 --2- 172.21.15.149:0/499619588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa40cd840 0x7fefa40cb630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009d90 tx=0x7fef9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d33737264f320dc6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fef9bfff700 1 -- 172.21.15.149:0/499619588 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00e070 con 0x7fefa40cd840 2023-06-09T04:37:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fef9bfff700 1 -- 172.21.15.149:0/499619588 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9c00bb20 con 0x7fefa40cd840 2023-06-09T04:37:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fef9bfff700 1 -- 172.21.15.149:0/499619588 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9c00be90 con 0x7fefa40cd840 2023-06-09T04:37:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefab41d700 1 -- 172.21.15.149:0/499619588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa40cd840 msgr2=0x7fefa40cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefab41d700 1 --2- 172.21.15.149:0/499619588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa40cd840 0x7fefa40cb630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef9c009d90 tx=0x7fef9c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:40.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefab41d700 1 -- 172.21.15.149:0/499619588 shutdown_connections 2023-06-09T04:37:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefab41d700 1 --2- 172.21.15.149:0/499619588 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa40cd840 0x7fefa40cb630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefab41d700 1 --2- 172.21.15.149:0/499619588 >> v2:172.21.15.184:3300/0 conn(0x7fefa415c270 0x7fefa40d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.858+0000 7fefab41d700 1 -- 172.21.15.149:0/499619588 >> 172.21.15.149:0/499619588 conn(0x7fefa4069db0 msgr2=0x7fefa406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.859+0000 7fefab41d700 1 -- 172.21.15.149:0/499619588 shutdown_connections 2023-06-09T04:37:40.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.859+0000 7fefab41d700 1 -- 172.21.15.149:0/499619588 wait complete. 2023-06-09T04:37:40.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 Processor -- start 2023-06-09T04:37:40.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 -- start start 2023-06-09T04:37:40.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa40cd840 0x7fefa40c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefa40ce310 0x7fefa41564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa415c270 0x7fefa4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa415cfe0 con 0x7fefa40cd840 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa40c9850 con 0x7fefa40ce310 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.860+0000 7fefab41d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa40c9b30 con 0x7fefa415c270 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa40cd840 0x7fefa40c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa40cd840 0x7fefa40c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37280/0 (socket says 172.21.15.149:37280) 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 -- 172.21.15.149:0/4268474109 learned_addr learned my addr 172.21.15.149:0/4268474109 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:40.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa89b8700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefa40ce310 0x7fefa41564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa99ba700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa415c270 0x7fefa4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 -- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa415c270 msgr2=0x7fefa4157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa415c270 0x7fefa4157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 -- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefa40ce310 msgr2=0x7fefa41564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefa40ce310 0x7fefa41564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 -- 172.21.15.149:0/4268474109 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00094a0 con 0x7fefa40cd840 2023-06-09T04:37:40.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefa91b9700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa40cd840 0x7fefa40c9270 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefa000ebe0 tx=0x7fefa0009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fef99ffb700 1 -- 172.21.15.149:0/4268474109 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000c8b0 con 0x7fefa40cd840 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9c009a70 con 0x7fefa40cd840 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fef99ffb700 1 -- 172.21.15.149:0/4268474109 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa000ca10 con 0x7fefa40cd840 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fef99ffb700 1 -- 172.21.15.149:0/4268474109 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa000cda0 con 0x7fefa40cd840 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.861+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa41573b0 con 0x7fefa40cd840 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.862+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa4073fa0 con 0x7fefa40cd840 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.863+0000 7fef99ffb700 1 -- 172.21.15.149:0/4268474109 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefa0013470 con 0x7fefa40cd840 2023-06-09T04:37:40.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.863+0000 7fef99ffb700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fef8806ad10 0x7fef8806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:40.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.863+0000 7fef99ffb700 1 -- 172.21.15.149:0/4268474109 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fefa0089ac0 con 0x7fefa40cd840 2023-06-09T04:37:40.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.863+0000 7fefa89b8700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fef8806ad10 0x7fef8806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:40.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.864+0000 7fefa89b8700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fef8806ad10 0x7fef8806d1c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fefa40cca20 tx=0x7fef94009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:40.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:40.868+0000 7fef99ffb700 1 -- 172.21.15.149:0/4268474109 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fefa0054690 con 0x7fefa40cd840 2023-06-09T04:37:41.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.053+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefa40b2790 con 0x7fefa40cd840 2023-06-09T04:37:41.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.053+0000 7fef99ffb700 1 -- 172.21.15.149:0/4268474109 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefa0057cb0 con 0x7fefa40cd840 2023-06-09T04:37:41.054 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:41.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fef8806ad10 msgr2=0x7fef8806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fef8806ad10 0x7fef8806d1c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fefa40cca20 tx=0x7fef94009040 comp rx=0 tx=0).stop 2023-06-09T04:37:41.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa40cd840 msgr2=0x7fefa40c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa40cd840 0x7fefa40c9270 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fefa000ebe0 tx=0x7fefa0009e20 comp rx=0 tx=0).stop 2023-06-09T04:37:41.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 shutdown_connections 2023-06-09T04:37:41.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fef8806ad10 0x7fef8806d1c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fefa415c270 0x7fefa4157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fefa40cd840 0x7fefa40c9270 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 --2- 172.21.15.149:0/4268474109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fefa40ce310 0x7fefa41564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 >> 172.21.15.149:0/4268474109 conn(0x7fefa4069db0 msgr2=0x7fefa40b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:41.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 shutdown_connections 2023-06-09T04:37:41.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.055+0000 7fefab41d700 1 -- 172.21.15.149:0/4268474109 wait complete. 2023-06-09T04:37:41.068 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:41.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.192+0000 7f846d783700 1 Processor -- start 2023-06-09T04:37:41.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.193+0000 7f846d783700 1 -- start start 2023-06-09T04:37:41.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.193+0000 7f846d783700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f84680ccb00 0x7f84680d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.193+0000 7f846d783700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846815c750 con 0x7f84680b43f0 2023-06-09T04:37:41.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.193+0000 7f846d783700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84680cf740 con 0x7f84680b4ed0 2023-06-09T04:37:41.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.193+0000 7f846d783700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84680ccfc0 con 0x7f84680ccb00 2023-06-09T04:37:41.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.193+0000 7f8466ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f84680b43f0 0x7f84680b47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32920/0 (socket says 172.21.15.149:32920) 2023-06-09T04:37:41.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8466ffd700 1 -- 172.21.15.149:0/510247294 learned_addr learned my addr 172.21.15.149:0/510247294 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:41.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f84667fc700 1 --2- 172.21.15.149:0/510247294 >> v2:172.21.15.184:3300/0 conn(0x7f84680ccb00 0x7f84680d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543938651 0 0) 0x7f845c001110 con 0x7f84680b43f0 2023-06-09T04:37:41.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84500035b0 con 0x7f84680b43f0 2023-06-09T04:37:41.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2549776366 0 0) 0x7f84500035b0 con 0x7f84680b43f0 2023-06-09T04:37:41.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 >> v2:172.21.15.184:3300/0 conn(0x7f84680ccb00 msgr2=0x7f84680d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:41.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 --2- 172.21.15.149:0/510247294 >> v2:172.21.15.184:3300/0 conn(0x7f84680ccb00 0x7f84680d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 >> v1:172.21.15.184:6789/0 conn(0x7f84680b4ed0 legacy=0x7f84680d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680cd540 con 0x7f84680b43f0 2023-06-09T04:37:41.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f845c001800 con 0x7f84680b43f0 2023-06-09T04:37:41.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 >> v1:172.21.15.149:6789/0 conn(0x7f84680b43f0 legacy=0x7f84680b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8450003a00 0x7f8450003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8450004850 0x7f8450004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f845000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680ccfc0 con 0x7f8450005200 2023-06-09T04:37:41.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845000c110 con 0x7f8450003a00 2023-06-09T04:37:41.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845000c2d0 con 0x7f8450004850 2023-06-09T04:37:41.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f8466ffd700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8450003a00 0x7f8450003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f84677fe700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f845000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f84667fc700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8450004850 0x7f8450004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f84677fe700 1 -- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8450004850 msgr2=0x7f8450004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:41.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f84677fe700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8450004850 0x7f8450004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f84677fe700 1 -- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8450003a00 msgr2=0x7f8450003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:41.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.194+0000 7f84677fe700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8450003a00 0x7f8450003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f84677fe700 1 -- 172.21.15.149:0/510247294 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500035b0 con 0x7f8450005200 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f8466ffd700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8450003a00 0x7f8450003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f84677fe700 1 -- 172.21.15.149:0/510247294 reap_dead start 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f84677fe700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f845000ba10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f846000c190 tx=0x7f8450005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4202ef319540c31e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460001db0 con 0x7f8450005200 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000ccf0 con 0x7f8450005200 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f8465ffb700 1 -- 172.21.15.149:0/510247294 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460003c40 con 0x7f8450005200 2023-06-09T04:37:41.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f846d783700 1 -- 172.21.15.149:0/510247294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 msgr2=0x7f845000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f846d783700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f845000ba10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f846000c190 tx=0x7f8450005880 comp rx=0 tx=0).stop 2023-06-09T04:37:41.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f846d783700 1 -- 172.21.15.149:0/510247294 shutdown_connections 2023-06-09T04:37:41.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f846d783700 1 --2- 172.21.15.149:0/510247294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f845000ba10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f846d783700 1 -- 172.21.15.149:0/510247294 >> 172.21.15.149:0/510247294 conn(0x7f8468072120 msgr2=0x7f846806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:41.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f846d783700 1 -- 172.21.15.149:0/510247294 shutdown_connections 2023-06-09T04:37:41.202 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.195+0000 7f846d783700 1 -- 172.21.15.149:0/510247294 wait complete. 2023-06-09T04:37:41.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 Processor -- start 2023-06-09T04:37:41.204 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 -- start start 2023-06-09T04:37:41.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f84680cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84680caa90 0x7f84680d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84680d0b80 0x7f8468140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680d0fd0 con 0x7f8450005200 2023-06-09T04:37:41.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680cbb60 con 0x7f84680d0b80 2023-06-09T04:37:41.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.197+0000 7f846d783700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8468144740 con 0x7f84680caa90 2023-06-09T04:37:41.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f84680cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f84680cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37300/0 (socket says 172.21.15.149:37300) 2023-06-09T04:37:41.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 -- 172.21.15.149:0/2537393552 learned_addr learned my addr 172.21.15.149:0/2537393552 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:41.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f84667fc700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84680caa90 0x7f84680d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f84677fe700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84680d0b80 0x7f8468140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 -- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84680caa90 msgr2=0x7f84680d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84680caa90 0x7f84680d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 -- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84680d0b80 msgr2=0x7f8468140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84680d0b80 0x7f8468140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 -- 172.21.15.149:0/2537393552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680caf50 con 0x7f8450005200 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f84677fe700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84680d0b80 0x7f8468140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f8466ffd700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f84680cbff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f845c007340 tx=0x7f845c007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f844f7fe700 1 -- 172.21.15.149:0/2537393552 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c007820 con 0x7f8450005200 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f844f7fe700 1 -- 172.21.15.149:0/2537393552 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00f870 con 0x7f8450005200 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84680cb230 con 0x7f8450005200 2023-06-09T04:37:41.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f844f7fe700 1 -- 172.21.15.149:0/2537393552 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00fbe0 con 0x7f8450005200 2023-06-09T04:37:41.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.198+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84680cb7f0 con 0x7f8450005200 2023-06-09T04:37:41.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.199+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8468073fa0 con 0x7f8450005200 2023-06-09T04:37:41.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.200+0000 7f844f7fe700 1 -- 172.21.15.149:0/2537393552 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f845c00fd40 con 0x7f8450005200 2023-06-09T04:37:41.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.200+0000 7f844f7fe700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f845406ace0 0x7f845406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.200+0000 7f844f7fe700 1 -- 172.21.15.149:0/2537393552 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f845c0894c0 con 0x7f8450005200 2023-06-09T04:37:41.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.200+0000 7f84667fc700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f845406ace0 0x7f845406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.200+0000 7f84667fc700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f845406ace0 0x7f845406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f84680d2550 tx=0x7f8458008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.204+0000 7f844f7fe700 1 -- 172.21.15.149:0/2537393552 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f845c057cd0 con 0x7f8450005200 2023-06-09T04:37:41.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.391+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84680b1e10 con 0x7f8450005200 2023-06-09T04:37:41.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.392+0000 7f844f7fe700 1 -- 172.21.15.149:0/2537393552 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f845c057860 con 0x7f8450005200 2023-06-09T04:37:41.393 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:41.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f845406ace0 msgr2=0x7f845406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f845406ace0 0x7f845406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f84680d2550 tx=0x7f8458008040 comp rx=0 tx=0).stop 2023-06-09T04:37:41.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 msgr2=0x7f84680cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f84680cbff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f845c007340 tx=0x7f845c007700 comp rx=0 tx=0).stop 2023-06-09T04:37:41.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 shutdown_connections 2023-06-09T04:37:41.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f845406ace0 0x7f845406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84680d0b80 0x7f8468140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8450005200 0x7f84680cbff0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 --2- 172.21.15.149:0/2537393552 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84680caa90 0x7f84680d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 >> 172.21.15.149:0/2537393552 conn(0x7f8468072120 msgr2=0x7f84680c6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:41.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 shutdown_connections 2023-06-09T04:37:41.397 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.394+0000 7f846d783700 1 -- 172.21.15.149:0/2537393552 wait complete. 2023-06-09T04:37:41.407 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:41.530 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.529+0000 7f2fcbbae700 1 Processor -- start 2023-06-09T04:37:41.531 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.530+0000 7f2fcbbae700 1 -- start start 2023-06-09T04:37:41.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fcbbae700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2fc40cd930 0x7f2fc40716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.535 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fcbbae700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc406f480 con 0x7f2fc4159380 2023-06-09T04:37:41.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fcbbae700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc406f760 con 0x7f2fc40b1dc0 2023-06-09T04:37:41.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fcbbae700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40b10d0 con 0x7f2fc40cd930 2023-06-09T04:37:41.536 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc994a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2fc4159380 0x7f2fc40cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32940/0 (socket says 172.21.15.149:32940) 2023-06-09T04:37:41.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc994a700 1 -- 172.21.15.149:0/285008172 learned_addr learned my addr 172.21.15.149:0/285008172 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:41.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc9149700 1 --2- 172.21.15.149:0/285008172 >> v2:172.21.15.184:3300/0 conn(0x7f2fc40cd930 0x7f2fc40716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652696228 0 0) 0x7f2fc406f480 con 0x7f2fc4159380 2023-06-09T04:37:41.537 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb00035b0 con 0x7f2fc4159380 2023-06-09T04:37:41.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2143604502 0 0) 0x7f2fb00035b0 con 0x7f2fc4159380 2023-06-09T04:37:41.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 >> v2:172.21.15.184:3300/0 conn(0x7f2fc40cd930 msgr2=0x7f2fc40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:41.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 --2- 172.21.15.149:0/285008172 >> v2:172.21.15.184:3300/0 conn(0x7f2fc40cd930 0x7f2fc40716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.538 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 >> v1:172.21.15.184:6789/0 conn(0x7f2fc40b1dc0 legacy=0x7f2fc40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40b12e0 con 0x7f2fc4159380 2023-06-09T04:37:41.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f2fb4001670 con 0x7f2fc4159380 2023-06-09T04:37:41.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 >> v1:172.21.15.149:6789/0 conn(0x7f2fc4159380 legacy=0x7f2fc40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.539 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb0003a00 0x7f2fb0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.531+0000 7f2fc8948700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc8948700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb0005200 0x7f2fb000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40b10d0 con 0x7f2fb0004850 2023-06-09T04:37:41.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000c110 con 0x7f2fb0003a00 2023-06-09T04:37:41.540 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb000c2d0 con 0x7f2fb0005200 2023-06-09T04:37:41.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc9149700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc994a700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb0003a00 0x7f2fb0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fca14b700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb0005200 0x7f2fb000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.541 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc9149700 1 -- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb0005200 msgr2=0x7f2fb000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:41.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc9149700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fb0005200 0x7f2fb000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc9149700 1 -- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb0003a00 msgr2=0x7f2fb0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:41.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc9149700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fb0003a00 0x7f2fb0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.542 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc9149700 1 -- 172.21.15.149:0/285008172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00035b0 con 0x7f2fb0004850 2023-06-09T04:37:41.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fca14b700 1 -- 172.21.15.149:0/285008172 reap_dead start 2023-06-09T04:37:41.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc9149700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009b30 tx=0x7f2fb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f981c9118c27fa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000e6c0 con 0x7f2fb0004850 2023-06-09T04:37:41.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000e820 con 0x7f2fb0004850 2023-06-09T04:37:41.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.532+0000 7f2fc8948700 1 -- 172.21.15.149:0/285008172 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000eb90 con 0x7f2fb0004850 2023-06-09T04:37:41.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.533+0000 7f2fcbbae700 1 -- 172.21.15.149:0/285008172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 msgr2=0x7f2fb0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.533+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009b30 tx=0x7f2fb0005880 comp rx=0 tx=0).stop 2023-06-09T04:37:41.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.533+0000 7f2fcbbae700 1 -- 172.21.15.149:0/285008172 shutdown_connections 2023-06-09T04:37:41.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.533+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/285008172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fb0004cc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.533+0000 7f2fcbbae700 1 -- 172.21.15.149:0/285008172 >> 172.21.15.149:0/285008172 conn(0x7f2fc406aec0 msgr2=0x7f2fc406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:41.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.533+0000 7f2fcbbae700 1 -- 172.21.15.149:0/285008172 shutdown_connections 2023-06-09T04:37:41.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.533+0000 7f2fcbbae700 1 -- 172.21.15.149:0/285008172 wait complete. 2023-06-09T04:37:41.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.534+0000 7f2fcbbae700 1 Processor -- start 2023-06-09T04:37:41.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.534+0000 7f2fcbbae700 1 -- start start 2023-06-09T04:37:41.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fcbbae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fc40ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fcbbae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fc4153350 0x7f2fc41516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fcbbae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc4151c20 0x7f2fc4143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fcbbae700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41ed800 con 0x7f2fb0004850 2023-06-09T04:37:41.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fcbbae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc4154890 con 0x7f2fc4151c20 2023-06-09T04:37:41.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fcbbae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41537f0 con 0x7f2fc4153350 2023-06-09T04:37:41.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fc40ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fc40ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37320/0 (socket says 172.21.15.149:37320) 2023-06-09T04:37:41.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 -- 172.21.15.149:0/4030122703 learned_addr learned my addr 172.21.15.149:0/4030122703 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:41.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc9149700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fc4153350 0x7f2fc41516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fca14b700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc4151c20 0x7f2fc4143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 -- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fc4153350 msgr2=0x7f2fc41516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fc4153350 0x7f2fc41516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 -- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc4151c20 msgr2=0x7f2fc4143b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.551 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc4151c20 0x7f2fc4143b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 -- 172.21.15.149:0/4030122703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4153ad0 con 0x7f2fb0004850 2023-06-09T04:37:41.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc9149700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fc4153350 0x7f2fc41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:41.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fca14b700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc4151c20 0x7f2fc4143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:41.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fc994a700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fc40ccc50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4007290 tx=0x7f2fb4007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fba7fc700 1 -- 172.21.15.149:0/4030122703 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4007830 con 0x7f2fb0004850 2023-06-09T04:37:41.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fba7fc700 1 -- 172.21.15.149:0/4030122703 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb400f8d0 con 0x7f2fb0004850 2023-06-09T04:37:41.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc4153db0 con 0x7f2fb0004850 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.535+0000 7f2fba7fc700 1 -- 172.21.15.149:0/4030122703 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400fc80 con 0x7f2fb0004850 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.536+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc4154370 con 0x7f2fb0004850 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.536+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc4073fa0 con 0x7f2fb0004850 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.537+0000 7f2fba7fc700 1 -- 172.21.15.149:0/4030122703 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fb401d460 con 0x7f2fb0004850 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.537+0000 7f2fba7fc700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2fa806ace0 0x7f2fa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.537+0000 7f2fc9149700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2fa806ace0 0x7f2fa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.537+0000 7f2fba7fc700 1 -- 172.21.15.149:0/4030122703 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2fb4089770 con 0x7f2fb0004850 2023-06-09T04:37:41.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.538+0000 7f2fc9149700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2fa806ace0 0x7f2fa806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00090b0 tx=0x7f2fc0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.542+0000 7f2fba7fc700 1 -- 172.21.15.149:0/4030122703 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fb4054580 con 0x7f2fb0004850 2023-06-09T04:37:41.733 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.732+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2fc40714a0 con 0x7f2fb0004850 2023-06-09T04:37:41.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.732+0000 7f2fba7fc700 1 -- 172.21.15.149:0/4030122703 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2fb4057ba0 con 0x7f2fb0004850 2023-06-09T04:37:41.734 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:41.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.734+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2fa806ace0 msgr2=0x7f2fa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.734+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2fa806ace0 0x7f2fa806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00090b0 tx=0x7f2fc0008030 comp rx=0 tx=0).stop 2023-06-09T04:37:41.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.734+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 msgr2=0x7f2fc40ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.734+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fc40ccc50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4007290 tx=0x7f2fb4007650 comp rx=0 tx=0).stop 2023-06-09T04:37:41.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 shutdown_connections 2023-06-09T04:37:41.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2fa806ace0 0x7f2fa806d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2fc4151c20 0x7f2fc4143b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fb0004850 0x7f2fc40ccc50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 --2- 172.21.15.149:0/4030122703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2fc4153350 0x7f2fc41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 >> 172.21.15.149:0/4030122703 conn(0x7f2fc406aec0 msgr2=0x7f2fc40c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:41.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 shutdown_connections 2023-06-09T04:37:41.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.735+0000 7f2fcbbae700 1 -- 172.21.15.149:0/4030122703 wait complete. 2023-06-09T04:37:41.748 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:41.868 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.867+0000 7fabe0667700 1 Processor -- start 2023-06-09T04:37:41.869 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.867+0000 7fabe0667700 1 -- start start 2023-06-09T04:37:41.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.868+0000 7fabe0667700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fabd815c590 0x7fabd80af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.868+0000 7fabe0667700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fabd80ccba0 0x7fabd80b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.868+0000 7fabe0667700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd80af050 con 0x7fabd8069db0 2023-06-09T04:37:41.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.868+0000 7fabe0667700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80afae0 con 0x7fabd815c590 2023-06-09T04:37:41.871 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.868+0000 7fabe0667700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80af800 con 0x7fabd80ccba0 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabdec04700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fabd8069db0 0x7fabd815fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32964/0 (socket says 172.21.15.149:32964) 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabdec04700 1 -- 172.21.15.149:0/1678291060 learned_addr learned my addr 172.21.15.149:0/1678291060 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabde403700 1 --2- 172.21.15.149:0/1678291060 >> v2:172.21.15.149:3300/0 conn(0x7fabd815c590 0x7fabd80af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabddc02700 1 --2- 172.21.15.149:0/1678291060 >> v2:172.21.15.184:3300/0 conn(0x7fabd80ccba0 0x7fabd80b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabde403700 1 -- 172.21.15.149:0/1678291060 >> v2:172.21.15.184:3300/0 conn(0x7fabd80ccba0 msgr2=0x7fabd80b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabde403700 1 --2- 172.21.15.149:0/1678291060 >> v2:172.21.15.184:3300/0 conn(0x7fabd80ccba0 0x7fabd80b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabde403700 1 -- 172.21.15.149:0/1678291060 >> v1:172.21.15.149:6789/0 conn(0x7fabd8069db0 legacy=0x7fabd815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.872 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabde403700 1 -- 172.21.15.149:0/1678291060 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80cc0c0 con 0x7fabd815c590 2023-06-09T04:37:41.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabdd401700 1 -- 172.21.15.149:0/1678291060 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603012793 0 0) 0x7fabd80af050 con 0x7fabd8069db0 2023-06-09T04:37:41.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabde403700 1 --2- 172.21.15.149:0/1678291060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd815c590 0x7fabd80af220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabd80b21e0 tx=0x7fabc8009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec7d05d85636aef server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.869+0000 7fabdd401700 1 -- 172.21.15.149:0/1678291060 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011830 con 0x7fabd815c590 2023-06-09T04:37:41.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabdd401700 1 -- 172.21.15.149:0/1678291060 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8011990 con 0x7fabd815c590 2023-06-09T04:37:41.873 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabdd401700 1 -- 172.21.15.149:0/1678291060 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8011d40 con 0x7fabd815c590 2023-06-09T04:37:41.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 -- 172.21.15.149:0/1678291060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd815c590 msgr2=0x7fabd80af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.875 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 --2- 172.21.15.149:0/1678291060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd815c590 0x7fabd80af220 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fabd80b21e0 tx=0x7fabc8009b10 comp rx=0 tx=0).stop 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 -- 172.21.15.149:0/1678291060 shutdown_connections 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 --2- 172.21.15.149:0/1678291060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd815c590 0x7fabd80af220 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 --2- 172.21.15.149:0/1678291060 >> v2:172.21.15.184:3300/0 conn(0x7fabd80ccba0 0x7fabd80b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 -- 172.21.15.149:0/1678291060 >> 172.21.15.149:0/1678291060 conn(0x7fabd806b7e0 msgr2=0x7fabd80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 -- 172.21.15.149:0/1678291060 shutdown_connections 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.870+0000 7fabe0667700 1 -- 172.21.15.149:0/1678291060 wait complete. 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 Processor -- start 2023-06-09T04:37:41.876 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 -- start start 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8069db0 0x7fabd815a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabd80ccba0 0x7fabd80c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabd815c590 0x7fabd80c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80b5100 con 0x7fabd8069db0 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80b44f0 con 0x7fabd80ccba0 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.872+0000 7fabe0667700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80b47d0 con 0x7fabd815c590 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8069db0 0x7fabd815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8069db0 0x7fabd815a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37334/0 (socket says 172.21.15.149:37334) 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 -- 172.21.15.149:0/3376468408 learned_addr learned my addr 172.21.15.149:0/3376468408 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 -- 172.21.15.149:0/3376468408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabd815c590 msgr2=0x7fabd80c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabd815c590 0x7fabd80c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 -- 172.21.15.149:0/3376468408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabd80ccba0 msgr2=0x7fabd80c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabddc02700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabd80ccba0 0x7fabd80c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabd80ccba0 0x7fabd80c3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:41.878 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 -- 172.21.15.149:0/3376468408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8009440 con 0x7fabd8069db0 2023-06-09T04:37:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabde403700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8069db0 0x7fabd815a230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fabc80090b0 tx=0x7fabc8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabceffd700 1 -- 172.21.15.149:0/3376468408 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80042f0 con 0x7fabd8069db0 2023-06-09T04:37:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabceffd700 1 -- 172.21.15.149:0/3376468408 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8004470 con 0x7fabd8069db0 2023-06-09T04:37:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabceffd700 1 -- 172.21.15.149:0/3376468408 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80038e0 con 0x7fabd8069db0 2023-06-09T04:37:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd80b4ab0 con 0x7fabd8069db0 2023-06-09T04:37:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.873+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd80b37c0 con 0x7fabd8069db0 2023-06-09T04:37:41.879 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.874+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd8073fa0 con 0x7fabd8069db0 2023-06-09T04:37:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.875+0000 7fabceffd700 1 -- 172.21.15.149:0/3376468408 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabc8022030 con 0x7fabd8069db0 2023-06-09T04:37:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.875+0000 7fabceffd700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fabbc06ace0 0x7fabbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.875+0000 7fabddc02700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fabbc06ace0 0x7fabbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:41.880 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.875+0000 7fabceffd700 1 -- 172.21.15.149:0/3376468408 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fabc808ada0 con 0x7fabd8069db0 2023-06-09T04:37:41.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.875+0000 7fabddc02700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fabbc06ace0 0x7fabbc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabd80c7120 tx=0x7fabd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:41.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:41.880+0000 7fabceffd700 1 -- 172.21.15.149:0/3376468408 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fabc8055bb0 con 0x7fabd8069db0 2023-06-09T04:37:42.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.068+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabd8073fa0 con 0x7fabd8069db0 2023-06-09T04:37:42.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.069+0000 7fabceffd700 1 -- 172.21.15.149:0/3376468408 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7fabc8006cc0 con 0x7fabd8069db0 2023-06-09T04:37:42.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:42.071 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fabbc06ace0 msgr2=0x7fabbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fabbc06ace0 0x7fabbc06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabd80c7120 tx=0x7fabd4008040 comp rx=0 tx=0).stop 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8069db0 msgr2=0x7fabd815a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8069db0 0x7fabd815a230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fabc80090b0 tx=0x7fabc8004750 comp rx=0 tx=0).stop 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 shutdown_connections 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fabbc06ace0 0x7fabbc06d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fabd815c590 0x7fabd80c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fabd8069db0 0x7fabd815a230 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 --2- 172.21.15.149:0/3376468408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabd80ccba0 0x7fabd80c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 >> 172.21.15.149:0/3376468408 conn(0x7fabd806b7e0 msgr2=0x7fabd80b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:42.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 shutdown_connections 2023-06-09T04:37:42.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.071+0000 7fabe0667700 1 -- 172.21.15.149:0/3376468408 wait complete. 2023-06-09T04:37:42.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:42.085 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:42.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.208+0000 7f0e3ac22700 1 Processor -- start 2023-06-09T04:37:42.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.208+0000 7f0e3ac22700 1 -- start start 2023-06-09T04:37:42.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e3ac22700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0e3415c320 0x7f0e340cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e3ac22700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0e3406a4c0 0x7f0e340b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e3ac22700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e34071290 con 0x7f0e34071770 2023-06-09T04:37:42.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e3ac22700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e340b2050 con 0x7f0e3415c320 2023-06-09T04:37:42.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e3ac22700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e340cd2c0 con 0x7f0e3406a4c0 2023-06-09T04:37:42.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e33fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f0e34071770 0x7f0e34069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:32976/0 (socket says 172.21.15.149:32976) 2023-06-09T04:37:42.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e389be700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f0e3415c320 0x7f0e340cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e33fff700 1 -- 172.21.15.149:0/2107665623 learned_addr learned my addr 172.21.15.149:0/2107665623 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:42.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e391bf700 1 --2- 172.21.15.149:0/2107665623 >> v2:172.21.15.184:3300/0 conn(0x7f0e3406a4c0 0x7f0e340b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e389be700 1 -- 172.21.15.149:0/2107665623 >> v2:172.21.15.184:3300/0 conn(0x7f0e3406a4c0 msgr2=0x7f0e340b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:42.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e389be700 1 --2- 172.21.15.149:0/2107665623 >> v2:172.21.15.184:3300/0 conn(0x7f0e3406a4c0 0x7f0e340b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e389be700 1 -- 172.21.15.149:0/2107665623 >> v1:172.21.15.149:6789/0 conn(0x7f0e34071770 legacy=0x7f0e34069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e337fe700 1 -- 172.21.15.149:0/2107665623 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676600616 0 0) 0x7f0e34071290 con 0x7f0e34071770 2023-06-09T04:37:42.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.209+0000 7f0e389be700 1 -- 172.21.15.149:0/2107665623 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e340cd5a0 con 0x7f0e3415c320 2023-06-09T04:37:42.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e389be700 1 --2- 172.21.15.149:0/2107665623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340cee20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e340c9c30 tx=0x7f0e28009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cd042de46a3660 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e337fe700 1 -- 172.21.15.149:0/2107665623 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28011830 con 0x7f0e3415c320 2023-06-09T04:37:42.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e337fe700 1 -- 172.21.15.149:0/2107665623 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e28011990 con 0x7f0e3415c320 2023-06-09T04:37:42.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e337fe700 1 -- 172.21.15.149:0/2107665623 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28011d20 con 0x7f0e3415c320 2023-06-09T04:37:42.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2107665623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 msgr2=0x7f0e340cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2107665623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340cee20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e340c9c30 tx=0x7f0e28009b20 comp rx=0 tx=0).stop 2023-06-09T04:37:42.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2107665623 shutdown_connections 2023-06-09T04:37:42.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2107665623 >> v2:172.21.15.184:3300/0 conn(0x7f0e3406a4c0 0x7f0e340b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2107665623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340cee20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2107665623 >> 172.21.15.149:0/2107665623 conn(0x7f0e3406aec0 msgr2=0x7f0e3406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:42.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2107665623 shutdown_connections 2023-06-09T04:37:42.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.210+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2107665623 wait complete. 2023-06-09T04:37:42.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 Processor -- start 2023-06-09T04:37:42.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 -- start start 2023-06-09T04:37:42.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e3406a4c0 0x7f0e340c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e34071770 0x7f0e340cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340c5be0 con 0x7f0e3415c320 2023-06-09T04:37:42.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340c4600 con 0x7f0e3406a4c0 2023-06-09T04:37:42.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.212+0000 7f0e3ac22700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340c48e0 con 0x7f0e34071770 2023-06-09T04:37:42.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340b2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37352/0 (socket says 172.21.15.149:37352) 2023-06-09T04:37:42.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 -- 172.21.15.149:0/2926590696 learned_addr learned my addr 172.21.15.149:0/2926590696 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:42.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e389be700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e3406a4c0 0x7f0e340c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e33fff700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e34071770 0x7f0e340cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 -- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e34071770 msgr2=0x7f0e340cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e34071770 0x7f0e340cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 -- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e3406a4c0 msgr2=0x7f0e340c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e3406a4c0 0x7f0e340c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 -- 172.21.15.149:0/2926590696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e280094a0 con 0x7f0e3415c320 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e391bf700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340b2730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c007e40 tx=0x7f0e2c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e317fa700 1 -- 172.21.15.149:0/2926590696 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c00eea0 con 0x7f0e3415c320 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e317fa700 1 -- 172.21.15.149:0/2926590696 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c014420 con 0x7f0e3415c320 2023-06-09T04:37:42.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e340c4bc0 con 0x7f0e3415c320 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e317fa700 1 -- 172.21.15.149:0/2926590696 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0147b0 con 0x7f0e3415c320 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.213+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e340c5180 con 0x7f0e3415c320 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.214+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e340cf2e0 con 0x7f0e3415c320 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.215+0000 7f0e317fa700 1 -- 172.21.15.149:0/2926590696 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e2c014910 con 0x7f0e3415c320 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.215+0000 7f0e317fa700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0e1806ace0 0x7f0e1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.215+0000 7f0e317fa700 1 -- 172.21.15.149:0/2926590696 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0e2c089ff0 con 0x7f0e3415c320 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.215+0000 7f0e389be700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0e1806ace0 0x7f0e1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.216+0000 7f0e389be700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0e1806ace0 0x7f0e1806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0e280090b0 tx=0x7f0e2801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.220+0000 7f0e317fa700 1 -- 172.21.15.149:0/2926590696 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0e2c054d70 con 0x7f0e3415c320 2023-06-09T04:37:42.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.406+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e34073fa0 con 0x7f0e3415c320 2023-06-09T04:37:42.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.406+0000 7f0e317fa700 1 -- 172.21.15.149:0/2926590696 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e2c058390 con 0x7f0e3415c320 2023-06-09T04:37:42.407 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:42.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0e1806ace0 msgr2=0x7f0e1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0e1806ace0 0x7f0e1806d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0e280090b0 tx=0x7f0e2801c040 comp rx=0 tx=0).stop 2023-06-09T04:37:42.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 msgr2=0x7f0e340b2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340b2730 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c007e40 tx=0x7f0e2c00e3c0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 shutdown_connections 2023-06-09T04:37:42.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f0e1806ace0 0x7f0e1806d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0e3415c320 0x7f0e340b2730 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0e3406a4c0 0x7f0e340c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 --2- 172.21.15.149:0/2926590696 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0e34071770 0x7f0e340cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 >> 172.21.15.149:0/2926590696 conn(0x7f0e3406aec0 msgr2=0x7f0e3406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:42.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 shutdown_connections 2023-06-09T04:37:42.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.408+0000 7f0e3ac22700 1 -- 172.21.15.149:0/2926590696 wait complete. 2023-06-09T04:37:42.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:42.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.544+0000 7f3bbb515700 1 Processor -- start 2023-06-09T04:37:42.545 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.544+0000 7f3bbb515700 1 -- start start 2023-06-09T04:37:42.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bbb515700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb415c320 0x7f3bb40cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bbb515700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3bb406a4c0 0x7f3bb40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bbb515700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb4071290 con 0x7f3bb4071770 2023-06-09T04:37:42.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bbb515700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40b2050 con 0x7f3bb406a4c0 2023-06-09T04:37:42.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bbb515700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40cd2c0 con 0x7f3bb415c320 2023-06-09T04:37:42.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bb92b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb415c320 0x7f3bb40cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bb9ab2700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3bb406a4c0 0x7f3bb40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bb92b1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb415c320 0x7f3bb40cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:42968/0 (socket says 172.21.15.149:42968) 2023-06-09T04:37:42.548 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.545+0000 7f3bb92b1700 1 -- 172.21.15.149:0/1276020724 learned_addr learned my addr 172.21.15.149:0/1276020724 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3bb92b1700 1 -- 172.21.15.149:0/1276020724 >> v2:172.21.15.184:3300/0 conn(0x7f3bb406a4c0 msgr2=0x7f3bb40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3bb92b1700 1 --2- 172.21.15.149:0/1276020724 >> v2:172.21.15.184:3300/0 conn(0x7f3bb406a4c0 0x7f3bb40b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3bb92b1700 1 -- 172.21.15.149:0/1276020724 >> v1:172.21.15.184:6789/0 conn(0x7f3bb4071770 legacy=0x7f3bb4069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3bb92b1700 1 -- 172.21.15.149:0/1276020724 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40cd5a0 con 0x7f3bb415c320 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3bb92b1700 1 --2- 172.21.15.149:0/1276020724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb415c320 0x7f3bb40cee20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40098f0 tx=0x7f3ba4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22aa68adb8d3b182 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3babfff700 1 -- 172.21.15.149:0/1276020724 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4011830 con 0x7f3bb415c320 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3babfff700 1 -- 172.21.15.149:0/1276020724 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba4011990 con 0x7f3bb415c320 2023-06-09T04:37:42.549 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.546+0000 7f3babfff700 1 -- 172.21.15.149:0/1276020724 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4011d20 con 0x7f3bb415c320 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 -- 172.21.15.149:0/1276020724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb415c320 msgr2=0x7f3bb40cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1276020724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb415c320 0x7f3bb40cee20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40098f0 tx=0x7f3ba4009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 -- 172.21.15.149:0/1276020724 shutdown_connections 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1276020724 >> v2:172.21.15.184:3300/0 conn(0x7f3bb406a4c0 0x7f3bb40b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1276020724 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb415c320 0x7f3bb40cee20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 -- 172.21.15.149:0/1276020724 >> 172.21.15.149:0/1276020724 conn(0x7f3bb406aec0 msgr2=0x7f3bb406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 -- 172.21.15.149:0/1276020724 shutdown_connections 2023-06-09T04:37:42.550 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.547+0000 7f3bbb515700 1 -- 172.21.15.149:0/1276020724 wait complete. 2023-06-09T04:37:42.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.548+0000 7f3bbb515700 1 Processor -- start 2023-06-09T04:37:42.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.548+0000 7f3bbb515700 1 -- start start 2023-06-09T04:37:42.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bbb515700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb406a4c0 0x7f3bb41572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bbb515700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb4071770 0x7f3bb40c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bbb515700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bb415c320 0x7f3bb40caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bbb515700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41e88b0 con 0x7f3bb415c320 2023-06-09T04:37:42.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bbb515700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb41e7fc0 con 0x7f3bb4071770 2023-06-09T04:37:42.553 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bbb515700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4157810 con 0x7f3bb406a4c0 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bb415c320 0x7f3bb40caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bb415c320 0x7f3bb40caae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37366/0 (socket says 172.21.15.149:37366) 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 -- 172.21.15.149:0/1738501041 learned_addr learned my addr 172.21.15.149:0/1738501041 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb92b1700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb406a4c0 0x7f3bb41572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb8ab0700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb4071770 0x7f3bb40c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 -- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb406a4c0 msgr2=0x7f3bb41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb406a4c0 0x7f3bb41572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 -- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb4071770 msgr2=0x7f3bb40c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb4071770 0x7f3bb40c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 -- 172.21.15.149:0/1738501041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4009550 con 0x7f3bb415c320 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3bb9ab2700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bb415c320 0x7f3bb40caae0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00efc0 tx=0x7f3bac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.549+0000 7f3ba9ffb700 1 -- 172.21.15.149:0/1738501041 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac009ea0 con 0x7f3bb415c320 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.550+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb40c4cc0 con 0x7f3bb415c320 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.550+0000 7f3ba9ffb700 1 -- 172.21.15.149:0/1738501041 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00f040 con 0x7f3bb415c320 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.550+0000 7f3ba9ffb700 1 -- 172.21.15.149:0/1738501041 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac014480 con 0x7f3bb415c320 2023-06-09T04:37:42.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.550+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb41e8540 con 0x7f3bb415c320 2023-06-09T04:37:42.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.551+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb41e8a60 con 0x7f3bb415c320 2023-06-09T04:37:42.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.551+0000 7f3ba9ffb700 1 -- 172.21.15.149:0/1738501041 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bac0145e0 con 0x7f3bb415c320 2023-06-09T04:37:42.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.551+0000 7f3ba9ffb700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3b9806ace0 0x7f3b9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.552+0000 7f3ba9ffb700 1 -- 172.21.15.149:0/1738501041 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3bac08a330 con 0x7f3bb415c320 2023-06-09T04:37:42.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.552+0000 7f3bb92b1700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3b9806ace0 0x7f3b9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.552+0000 7f3bb92b1700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3b9806ace0 0x7f3b9806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4014040 tx=0x7f3ba4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.556+0000 7f3ba9ffb700 1 -- 172.21.15.149:0/1738501041 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bb41e8a60 con 0x7f3bb415c320 2023-06-09T04:37:42.746 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.745+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bb4073fa0 con 0x7f3bb415c320 2023-06-09T04:37:42.747 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.746+0000 7f3ba9ffb700 1 -- 172.21.15.149:0/1738501041 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bac0550b0 con 0x7f3bb415c320 2023-06-09T04:37:42.747 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:42.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3b9806ace0 msgr2=0x7f3b9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.749 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3b9806ace0 0x7f3b9806d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4014040 tx=0x7f3ba4008030 comp rx=0 tx=0).stop 2023-06-09T04:37:42.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bb415c320 msgr2=0x7f3bb40caae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bb415c320 0x7f3bb40caae0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00efc0 tx=0x7f3bac00c3a0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 shutdown_connections 2023-06-09T04:37:42.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3b9806ace0 0x7f3b9806d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3bb406a4c0 0x7f3bb41572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3bb415c320 0x7f3bb40caae0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.750 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 --2- 172.21.15.149:0/1738501041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3bb4071770 0x7f3bb40c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 >> 172.21.15.149:0/1738501041 conn(0x7f3bb406aec0 msgr2=0x7f3bb40b1890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:42.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 shutdown_connections 2023-06-09T04:37:42.751 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.748+0000 7f3bbb515700 1 -- 172.21.15.149:0/1738501041 wait complete. 2023-06-09T04:37:42.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:42.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.884+0000 7f2033d50700 1 Processor -- start 2023-06-09T04:37:42.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.884+0000 7f2033d50700 1 -- start start 2023-06-09T04:37:42.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2033d50700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 0x7f202c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2033d50700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f202c0b1dc0 0x7f202c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2033d50700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c06f480 con 0x7f202c071d50 2023-06-09T04:37:42.888 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2033d50700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0b10d0 con 0x7f202c0b1dc0 2023-06-09T04:37:42.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2033d50700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0cb590 con 0x7f202c159380 2023-06-09T04:37:42.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f20322ed700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f202c071d50 0x7f202c15cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33004/0 (socket says 172.21.15.149:33004) 2023-06-09T04:37:42.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f20322ed700 1 -- 172.21.15.149:0/4198362448 learned_addr learned my addr 172.21.15.149:0/4198362448 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:42.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f20312eb700 1 --2- 172.21.15.149:0/4198362448 >> v2:172.21.15.184:3300/0 conn(0x7f202c0b1dc0 0x7f202c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2031aec700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 0x7f202c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834211204 0 0) 0x7f202c06f480 con 0x7f202c071d50 2023-06-09T04:37:42.889 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.885+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20180035b0 con 0x7f202c071d50 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2946162029 0 0) 0x7f20180035b0 con 0x7f202c071d50 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 msgr2=0x7f202c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 0x7f202c0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 >> v2:172.21.15.184:3300/0 conn(0x7f202c0b1dc0 msgr2=0x7f202c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 --2- 172.21.15.149:0/4198362448 >> v2:172.21.15.184:3300/0 conn(0x7f202c0b1dc0 0x7f202c0cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c06f760 con 0x7f202c071d50 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f20240019f0 con 0x7f202c071d50 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 >> v1:172.21.15.149:6789/0 conn(0x7f202c071d50 legacy=0x7f202c15cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2018003a00 0x7f2018003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 0x7f2018004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2018004d90 0x7f2018005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b10d0 con 0x7f2018004d90 2023-06-09T04:37:42.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0cb590 con 0x7f2018003a00 2023-06-09T04:37:42.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201800dc20 con 0x7f202c159380 2023-06-09T04:37:42.891 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20322ed700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2018004d90 0x7f2018005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2031aec700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2018003a00 0x7f2018003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20312eb700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 0x7f2018004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20322ed700 1 -- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 msgr2=0x7f2018004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20322ed700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c159380 0x7f2018004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20322ed700 1 -- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2018003a00 msgr2=0x7f2018003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20322ed700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2018003a00 0x7f2018003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20322ed700 1 -- 172.21.15.149:0/4198362448 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20180035b0 con 0x7f2018004d90 2023-06-09T04:37:42.892 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f20322ed700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2018004d90 0x7f2018005200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f202c072190 tx=0x7f2018005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f18debab72b7b33 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400a340 con 0x7f2018004d90 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2024012600 con 0x7f2018004d90 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.886+0000 7f2030aea700 1 -- 172.21.15.149:0/4198362448 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20240129b0 con 0x7f2018004d90 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.887+0000 7f2033d50700 1 -- 172.21.15.149:0/4198362448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2018004d90 msgr2=0x7f2018005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.887+0000 7f2033d50700 1 --2- 172.21.15.149:0/4198362448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2018004d90 0x7f2018005200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f202c072190 tx=0x7f2018005880 comp rx=0 tx=0).stop 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.887+0000 7f20322ed700 1 -- 172.21.15.149:0/4198362448 reap_dead start 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.887+0000 7f2033d50700 1 -- 172.21.15.149:0/4198362448 shutdown_connections 2023-06-09T04:37:42.893 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.887+0000 7f2033d50700 1 -- 172.21.15.149:0/4198362448 >> 172.21.15.149:0/4198362448 conn(0x7f202c06aec0 msgr2=0x7f202c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:42.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.887+0000 7f2033d50700 1 -- 172.21.15.149:0/4198362448 shutdown_connections 2023-06-09T04:37:42.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.887+0000 7f2033d50700 1 -- 172.21.15.149:0/4198362448 wait complete. 2023-06-09T04:37:42.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.888+0000 7f2033d50700 1 Processor -- start 2023-06-09T04:37:42.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.888+0000 7f2033d50700 1 -- start start 2023-06-09T04:37:42.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f2033d50700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f202c152ab0 0x7f202c0c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f2033d50700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c152e80 0x7f202c0c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f2033d50700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f202c0c4fc0 0x7f202c0c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f2033d50700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0c60e0 con 0x7f202c0c4fc0 2023-06-09T04:37:42.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f2033d50700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0c54d0 con 0x7f202c152ab0 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f2033d50700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0c57b0 con 0x7f202c152e80 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f202c0c4fc0 0x7f202c0c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f202c0c4fc0 0x7f202c0c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37386/0 (socket says 172.21.15.149:37386) 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f2031aec700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f202c152ab0 0x7f202c0c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 -- 172.21.15.149:0/360188533 learned_addr learned my addr 172.21.15.149:0/360188533 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20312eb700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c152e80 0x7f202c0c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 -- 172.21.15.149:0/360188533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c152e80 msgr2=0x7f202c0c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c152e80 0x7f202c0c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 -- 172.21.15.149:0/360188533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f202c152ab0 msgr2=0x7f202c0c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:42.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f202c152ab0 0x7f202c0c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:42.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.889+0000 7f20322ed700 1 -- 172.21.15.149:0/360188533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0c5a90 con 0x7f202c0c4fc0 2023-06-09T04:37:42.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.890+0000 7f20322ed700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f202c0c4fc0 0x7f202c0c36c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2024015040 tx=0x7f2024001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.890+0000 7f20227fc700 1 -- 172.21.15.149:0/360188533 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202400a340 con 0x7f202c0c4fc0 2023-06-09T04:37:42.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.890+0000 7f20227fc700 1 -- 172.21.15.149:0/360188533 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20240019c0 con 0x7f202c0c4fc0 2023-06-09T04:37:42.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.890+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c0c5d70 con 0x7f202c0c4fc0 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.890+0000 7f20227fc700 1 -- 172.21.15.149:0/360188533 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024027410 con 0x7f202c0c4fc0 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.890+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c1565f0 con 0x7f202c0c4fc0 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.891+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c0c5f00 con 0x7f202c0c4fc0 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.892+0000 7f20227fc700 1 -- 172.21.15.149:0/360188533 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2024019070 con 0x7f202c0c4fc0 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.892+0000 7f20227fc700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f201006ace0 0x7f201006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.892+0000 7f20227fc700 1 -- 172.21.15.149:0/360188533 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f202408af10 con 0x7f202c0c4fc0 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.892+0000 7f2031aec700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f201006ace0 0x7f201006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:42.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.893+0000 7f2031aec700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f201006ace0 0x7f201006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f201c009be0 tx=0x7f201c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:42.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:42.896+0000 7f20227fc700 1 -- 172.21.15.149:0/360188533 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2024055dc0 con 0x7f202c0c4fc0 2023-06-09T04:37:43.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.082+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f202c073fa0 con 0x7f202c0c4fc0 2023-06-09T04:37:43.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.082+0000 7f20227fc700 1 -- 172.21.15.149:0/360188533 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2024017020 con 0x7f202c0c4fc0 2023-06-09T04:37:43.084 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:43.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f201006ace0 msgr2=0x7f201006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f201006ace0 0x7f201006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f201c009be0 tx=0x7f201c009210 comp rx=0 tx=0).stop 2023-06-09T04:37:43.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f202c0c4fc0 msgr2=0x7f202c0c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f202c0c4fc0 0x7f202c0c36c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2024015040 tx=0x7f2024001360 comp rx=0 tx=0).stop 2023-06-09T04:37:43.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 shutdown_connections 2023-06-09T04:37:43.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f201006ace0 0x7f201006d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f202c0c4fc0 0x7f202c0c36c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f202c152ab0 0x7f202c0c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 --2- 172.21.15.149:0/360188533 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f202c152e80 0x7f202c0c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 >> 172.21.15.149:0/360188533 conn(0x7f202c06aec0 msgr2=0x7f202c069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 shutdown_connections 2023-06-09T04:37:43.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.084+0000 7f2033d50700 1 -- 172.21.15.149:0/360188533 wait complete. 2023-06-09T04:37:43.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:43.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.220+0000 7f80ed5e9700 1 Processor -- start 2023-06-09T04:37:43.221 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.220+0000 7f80ed5e9700 1 -- start start 2023-06-09T04:37:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80ed5e9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80e80b4ed0 0x7f80e80d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80ed5e9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e815c750 con 0x7f80e80b43f0 2023-06-09T04:37:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80ed5e9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80cf740 con 0x7f80e80ccb00 2023-06-09T04:37:43.222 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80ed5e9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80ccfc0 con 0x7f80e80b4ed0 2023-06-09T04:37:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80e77fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80e80b4ed0 0x7f80e80d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80e6ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f80e80b43f0 0x7f80e80b47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33022/0 (socket says 172.21.15.149:33022) 2023-06-09T04:37:43.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80e6ffd700 1 -- 172.21.15.149:0/263405724 learned_addr learned my addr 172.21.15.149:0/263405724 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:43.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80e77fe700 1 -- 172.21.15.149:0/263405724 >> v1:172.21.15.184:6789/0 conn(0x7f80e80ccb00 legacy=0x7f80e80d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:43.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80e77fe700 1 -- 172.21.15.149:0/263405724 >> v1:172.21.15.149:6789/0 conn(0x7f80e80b43f0 legacy=0x7f80e80b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80e77fe700 1 -- 172.21.15.149:0/263405724 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80cd540 con 0x7f80e80b4ed0 2023-06-09T04:37:43.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.221+0000 7f80e5ffb700 1 -- 172.21.15.149:0/263405724 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464447520 0 0) 0x7f80d8001110 con 0x7f80e80b43f0 2023-06-09T04:37:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80e77fe700 1 --2- 172.21.15.149:0/263405724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80b4ed0 0x7f80e80d0d50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009d90 tx=0x7f80e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6299075cd0cc24 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80e5ffb700 1 -- 172.21.15.149:0/263405724 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000e070 con 0x7f80e80b4ed0 2023-06-09T04:37:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80e5ffb700 1 -- 172.21.15.149:0/263405724 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000bb90 con 0x7f80e80b4ed0 2023-06-09T04:37:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80e5ffb700 1 -- 172.21.15.149:0/263405724 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0003a20 con 0x7f80e80b4ed0 2023-06-09T04:37:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80ed5e9700 1 -- 172.21.15.149:0/263405724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80b4ed0 msgr2=0x7f80e80d0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/263405724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80b4ed0 0x7f80e80d0d50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f80e0009d90 tx=0x7f80e000b330 comp rx=0 tx=0).stop 2023-06-09T04:37:43.225 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80ed5e9700 1 -- 172.21.15.149:0/263405724 shutdown_connections 2023-06-09T04:37:43.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/263405724 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80b4ed0 0x7f80e80d0d50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80ed5e9700 1 -- 172.21.15.149:0/263405724 >> 172.21.15.149:0/263405724 conn(0x7f80e8072120 msgr2=0x7f80e806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:43.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80ed5e9700 1 -- 172.21.15.149:0/263405724 shutdown_connections 2023-06-09T04:37:43.226 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.222+0000 7f80ed5e9700 1 -- 172.21.15.149:0/263405724 wait complete. 2023-06-09T04:37:43.227 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 Processor -- start 2023-06-09T04:37:43.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 -- start start 2023-06-09T04:37:43.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e80b43f0 0x7f80e80cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e80b4ed0 0x7f80e8150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80ccb00 0x7f80e80c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81513f0 con 0x7f80e80ccb00 2023-06-09T04:37:43.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80d33f0 con 0x7f80e80b43f0 2023-06-09T04:37:43.228 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.224+0000 7f80ed5e9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e815ee00 con 0x7f80e80b4ed0 2023-06-09T04:37:43.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80ccb00 0x7f80e80c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80ccb00 0x7f80e80c9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37400/0 (socket says 172.21.15.149:37400) 2023-06-09T04:37:43.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 -- 172.21.15.149:0/2995702703 learned_addr learned my addr 172.21.15.149:0/2995702703 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:43.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 -- 172.21.15.149:0/2995702703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e80b4ed0 msgr2=0x7f80e8150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e80b4ed0 0x7f80e8150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 -- 172.21.15.149:0/2995702703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e80b43f0 msgr2=0x7f80e80cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.229 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e80b43f0 0x7f80e80cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 -- 172.21.15.149:0/2995702703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e0009a70 con 0x7f80e80ccb00 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80e77fe700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80ccb00 0x7f80e80c9a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f80e000b730 tx=0x7f80e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80cf7fe700 1 -- 172.21.15.149:0/2995702703 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0003a20 con 0x7f80e80ccb00 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80cf7fe700 1 -- 172.21.15.149:0/2995702703 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0012860 con 0x7f80e80ccb00 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e815eb20 con 0x7f80e80ccb00 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80cf7fe700 1 -- 172.21.15.149:0/2995702703 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0012c10 con 0x7f80e80ccb00 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.225+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80d0d30 con 0x7f80e80ccb00 2023-06-09T04:37:43.230 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.226+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e80d08b0 con 0x7f80e80ccb00 2023-06-09T04:37:43.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.226+0000 7f80cf7fe700 1 -- 172.21.15.149:0/2995702703 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80e001d420 con 0x7f80e80ccb00 2023-06-09T04:37:43.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.227+0000 7f80cf7fe700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f80d406ace0 0x7f80d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.227+0000 7f80cf7fe700 1 -- 172.21.15.149:0/2995702703 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f80e008bb00 con 0x7f80e80ccb00 2023-06-09T04:37:43.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.227+0000 7f80e6ffd700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f80d406ace0 0x7f80d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.227+0000 7f80e6ffd700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f80d406ace0 0x7f80d406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80d8001370 tx=0x7f80d8001300 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.232 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.231+0000 7f80cf7fe700 1 -- 172.21.15.149:0/2995702703 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f80e80d08b0 con 0x7f80e80ccb00 2023-06-09T04:37:43.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.419+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80e80d08b0 con 0x7f80e80ccb00 2023-06-09T04:37:43.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.420+0000 7f80cf7fe700 1 -- 172.21.15.149:0/2995702703 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80e80d08b0 con 0x7f80e80ccb00 2023-06-09T04:37:43.421 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:43.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f80d406ace0 msgr2=0x7f80d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f80d406ace0 0x7f80d406d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80d8001370 tx=0x7f80d8001300 comp rx=0 tx=0).stop 2023-06-09T04:37:43.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80ccb00 msgr2=0x7f80e80c9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80ccb00 0x7f80e80c9a40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f80e000b730 tx=0x7f80e0004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 shutdown_connections 2023-06-09T04:37:43.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f80d406ace0 0x7f80d406d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80e80ccb00 0x7f80e80c9a40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80e80b43f0 0x7f80e80cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 --2- 172.21.15.149:0/2995702703 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80e80b4ed0 0x7f80e8150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 >> 172.21.15.149:0/2995702703 conn(0x7f80e8072120 msgr2=0x7f80e80c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:43.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 shutdown_connections 2023-06-09T04:37:43.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.422+0000 7f80ed5e9700 1 -- 172.21.15.149:0/2995702703 wait complete. 2023-06-09T04:37:43.436 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:43.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.558+0000 7fb81e1e2700 1 Processor -- start 2023-06-09T04:37:43.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.558+0000 7fb81e1e2700 1 -- start start 2023-06-09T04:37:43.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb81e1e2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 0x7fb8180cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb81e1e2700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180cd990 con 0x7fb818069db0 2023-06-09T04:37:43.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb81e1e2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180cdc70 con 0x7fb818070d50 2023-06-09T04:37:43.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb81e1e2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb818070550 con 0x7fb8180c9500 2023-06-09T04:37:43.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb8177fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb818069db0 0x7fb81806a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33036/0 (socket says 172.21.15.149:33036) 2023-06-09T04:37:43.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb8177fe700 1 -- 172.21.15.149:0/1166356528 learned_addr learned my addr 172.21.15.149:0/1166356528 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb816ffd700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 0x7fb8180cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.559+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021820424 0 0) 0x7fb8180cd990 con 0x7fb818069db0 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8000046c0 con 0x7fb818069db0 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1688083219 0 0) 0x7fb8000046c0 con 0x7fb818069db0 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 msgr2=0x7fb8180cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 0x7fb8180cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 >> v1:172.21.15.184:6789/0 conn(0x7fb818070d50 legacy=0x7fb8180711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818070830 con 0x7fb818069db0 2023-06-09T04:37:43.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7fb80c001670 con 0x7fb818069db0 2023-06-09T04:37:43.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 >> v1:172.21.15.149:6789/0 conn(0x7fb818069db0 legacy=0x7fb81806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb800004b40 0x7fb800004f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 0x7fb800005960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb800005ea0 0x7fb800006310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818070550 con 0x7fb800005ea0 2023-06-09T04:37:43.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80000cb20 con 0x7fb800004b40 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80000ccb0 con 0x7fb8180c9500 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb817fff700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb800005ea0 0x7fb800006310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb816ffd700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 0x7fb800005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb8177fe700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb800004b40 0x7fb800004f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb817fff700 1 -- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 msgr2=0x7fb800005960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb817fff700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8180c9500 0x7fb800005960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb817fff700 1 -- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb800004b40 msgr2=0x7fb800004f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:43.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb817fff700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb800004b40 0x7fb800004f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb817fff700 1 -- 172.21.15.149:0/1166356528 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000046c0 con 0x7fb800005ea0 2023-06-09T04:37:43.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.560+0000 7fb817fff700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb800005ea0 0x7fb800006310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c290 tx=0x7fb800006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2d368031f9066b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810001e70 con 0x7fb800005ea0 2023-06-09T04:37:43.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81000ce50 con 0x7fb800005ea0 2023-06-09T04:37:43.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb8167fc700 1 -- 172.21.15.149:0/1166356528 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810012660 con 0x7fb800005ea0 2023-06-09T04:37:43.568 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb81e1e2700 1 -- 172.21.15.149:0/1166356528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb800005ea0 msgr2=0x7fb800006310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb81e1e2700 1 --2- 172.21.15.149:0/1166356528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb800005ea0 0x7fb800006310 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c290 tx=0x7fb800006990 comp rx=0 tx=0).stop 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb817fff700 1 -- 172.21.15.149:0/1166356528 reap_dead start 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb81e1e2700 1 -- 172.21.15.149:0/1166356528 shutdown_connections 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb81e1e2700 1 -- 172.21.15.149:0/1166356528 >> 172.21.15.149:0/1166356528 conn(0x7fb8180cf220 msgr2=0x7fb8180cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb81e1e2700 1 -- 172.21.15.149:0/1166356528 shutdown_connections 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.561+0000 7fb81e1e2700 1 -- 172.21.15.149:0/1166356528 wait complete. 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.562+0000 7fb81e1e2700 1 Processor -- start 2023-06-09T04:37:43.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb81e1e2700 1 -- start start 2023-06-09T04:37:43.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb81e1e2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8181596c0 0x7fb818158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb81e1e2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb818159a90 0x7fb81815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb81e1e2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8181f2490 0x7fb8181506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb81e1e2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81815bec0 con 0x7fb818159a90 2023-06-09T04:37:43.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb81e1e2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180abda0 con 0x7fb8181f2490 2023-06-09T04:37:43.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb81e1e2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180ac080 con 0x7fb8181596c0 2023-06-09T04:37:43.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb816ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb818159a90 0x7fb81815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb816ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb818159a90 0x7fb81815b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37418/0 (socket says 172.21.15.149:37418) 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb816ffd700 1 -- 172.21.15.149:0/3912847827 learned_addr learned my addr 172.21.15.149:0/3912847827 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.563+0000 7fb817fff700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8181f2490 0x7fb8181506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb8177fe700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8181596c0 0x7fb818158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb816ffd700 1 -- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8181596c0 msgr2=0x7fb818158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb816ffd700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8181596c0 0x7fb818158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb816ffd700 1 -- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8181f2490 msgr2=0x7fb8181506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb816ffd700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8181f2490 0x7fb8181506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb816ffd700 1 -- 172.21.15.149:0/3912847827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180ac360 con 0x7fb818159a90 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb8177fe700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8181596c0 0x7fb818158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb817fff700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8181f2490 0x7fb8181506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb816ffd700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb818159a90 0x7fb81815b620 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb808011aa0 tx=0x7fb808011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb7fffff700 1 -- 172.21.15.149:0/3912847827 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800f980 con 0x7fb818159a90 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb7fffff700 1 -- 172.21.15.149:0/3912847827 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80800fae0 con 0x7fb818159a90 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8180ac640 con 0x7fb818159a90 2023-06-09T04:37:43.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb7fffff700 1 -- 172.21.15.149:0/3912847827 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80800fe90 con 0x7fb818159a90 2023-06-09T04:37:43.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.564+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8181f2900 con 0x7fb818159a90 2023-06-09T04:37:43.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.565+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818073fa0 con 0x7fb818159a90 2023-06-09T04:37:43.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.565+0000 7fb7fffff700 1 -- 172.21.15.149:0/3912847827 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb808014440 con 0x7fb818159a90 2023-06-09T04:37:43.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.566+0000 7fb7fffff700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb80406ad10 0x7fb80406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.566+0000 7fb7fffff700 1 -- 172.21.15.149:0/3912847827 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb808089f90 con 0x7fb818159a90 2023-06-09T04:37:43.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.566+0000 7fb8177fe700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb80406ad10 0x7fb80406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.566+0000 7fb8177fe700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb80406ad10 0x7fb80406d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0048d0 tx=0x7fb80c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.570+0000 7fb7fffff700 1 -- 172.21.15.149:0/3912847827 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8080bc310 con 0x7fb818159a90 2023-06-09T04:37:43.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.759+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb8180ce1a0 con 0x7fb818159a90 2023-06-09T04:37:43.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.759+0000 7fb7fffff700 1 -- 172.21.15.149:0/3912847827 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb808058860 con 0x7fb818159a90 2023-06-09T04:37:43.761 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb80406ad10 msgr2=0x7fb80406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb80406ad10 0x7fb80406d1c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0048d0 tx=0x7fb80c009040 comp rx=0 tx=0).stop 2023-06-09T04:37:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb818159a90 msgr2=0x7fb81815b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb818159a90 0x7fb81815b620 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb808011aa0 tx=0x7fb808011e60 comp rx=0 tx=0).stop 2023-06-09T04:37:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 shutdown_connections 2023-06-09T04:37:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb80406ad10 0x7fb80406d1c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb8181596c0 0x7fb818158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8181f2490 0x7fb8181506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 --2- 172.21.15.149:0/3912847827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb818159a90 0x7fb81815b620 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.761+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 >> 172.21.15.149:0/3912847827 conn(0x7fb8180cf220 msgr2=0x7fb8180ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:43.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.762+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 shutdown_connections 2023-06-09T04:37:43.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.762+0000 7fb81e1e2700 1 -- 172.21.15.149:0/3912847827 wait complete. 2023-06-09T04:37:43.775 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:43.894 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.893+0000 7ff72e0de700 1 Processor -- start 2023-06-09T04:37:43.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff72e0de700 1 -- start start 2023-06-09T04:37:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff72e0de700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff728157d30 0x7ff7280cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff72e0de700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff72815adb0 0x7ff7280ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff72e0de700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7280cd770 con 0x7ff7280ce3a0 2023-06-09T04:37:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff72e0de700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7280ced60 con 0x7ff728157d30 2023-06-09T04:37:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff72e0de700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff728158100 con 0x7ff72815adb0 2023-06-09T04:37:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff7277fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff728157d30 0x7ff7280cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff7277fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff728157d30 0x7ff7280cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37424/0 (socket says 172.21.15.149:37424) 2023-06-09T04:37:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.894+0000 7ff7277fe700 1 -- 172.21.15.149:0/4253540435 learned_addr learned my addr 172.21.15.149:0/4253540435 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7277fe700 1 -- 172.21.15.149:0/4253540435 >> v2:172.21.15.184:3300/0 conn(0x7ff72815adb0 msgr2=0x7ff7280ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7277fe700 1 --2- 172.21.15.149:0/4253540435 >> v2:172.21.15.184:3300/0 conn(0x7ff72815adb0 0x7ff7280ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7277fe700 1 -- 172.21.15.149:0/4253540435 >> v1:172.21.15.184:6789/0 conn(0x7ff7280ce3a0 legacy=0x7ff72815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7277fe700 1 -- 172.21.15.149:0/4253540435 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72815b2d0 con 0x7ff728157d30 2023-06-09T04:37:43.897 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7277fe700 1 --2- 172.21.15.149:0/4253540435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728157d30 0x7ff7280cdc00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff728072080 tx=0x7ff71c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ba72866482a79e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7267fc700 1 -- 172.21.15.149:0/4253540435 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c005e30 con 0x7ff728157d30 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7267fc700 1 -- 172.21.15.149:0/4253540435 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c006030 con 0x7ff728157d30 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff7267fc700 1 -- 172.21.15.149:0/4253540435 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0063e0 con 0x7ff728157d30 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff72e0de700 1 -- 172.21.15.149:0/4253540435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728157d30 msgr2=0x7ff7280cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.895+0000 7ff72e0de700 1 --2- 172.21.15.149:0/4253540435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728157d30 0x7ff7280cdc00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff728072080 tx=0x7ff71c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.896+0000 7ff72e0de700 1 -- 172.21.15.149:0/4253540435 shutdown_connections 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.896+0000 7ff72e0de700 1 --2- 172.21.15.149:0/4253540435 >> v2:172.21.15.184:3300/0 conn(0x7ff72815adb0 0x7ff7280ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.896+0000 7ff72e0de700 1 --2- 172.21.15.149:0/4253540435 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728157d30 0x7ff7280cdc00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.896+0000 7ff72e0de700 1 -- 172.21.15.149:0/4253540435 >> 172.21.15.149:0/4253540435 conn(0x7ff72806a6d0 msgr2=0x7ff728099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.896+0000 7ff72e0de700 1 -- 172.21.15.149:0/4253540435 shutdown_connections 2023-06-09T04:37:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.896+0000 7ff72e0de700 1 -- 172.21.15.149:0/4253540435 wait complete. 2023-06-09T04:37:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.897+0000 7ff72e0de700 1 Processor -- start 2023-06-09T04:37:43.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.897+0000 7ff72e0de700 1 -- start start 2023-06-09T04:37:43.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff72e0de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280ce3a0 0x7ff7280b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff72e0de700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff728157d30 0x7ff7280c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff72e0de700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff72815adb0 0x7ff7280c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff72e0de700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff728151520 con 0x7ff7280ce3a0 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff72e0de700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72815b7f0 con 0x7ff728157d30 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff72e0de700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72815bad0 con 0x7ff72815adb0 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff7277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280ce3a0 0x7ff7280b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff7277fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280ce3a0 0x7ff7280b4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37430/0 (socket says 172.21.15.149:37430) 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.898+0000 7ff7277fe700 1 -- 172.21.15.149:0/3320263648 learned_addr learned my addr 172.21.15.149:0/3320263648 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff726ffd700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff728157d30 0x7ff7280c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff727fff700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff72815adb0 0x7ff7280c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff7277fe700 1 -- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff72815adb0 msgr2=0x7ff7280c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff7277fe700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff72815adb0 0x7ff7280c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff7277fe700 1 -- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff728157d30 msgr2=0x7ff7280c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff7277fe700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff728157d30 0x7ff7280c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff7277fe700 1 -- 172.21.15.149:0/3320263648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c009500 con 0x7ff7280ce3a0 2023-06-09T04:37:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff726ffd700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff728157d30 0x7ff7280c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff727fff700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff72815adb0 0x7ff7280c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:43.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff7277fe700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280ce3a0 0x7ff7280b4010 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff71c006000 tx=0x7ff71c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff70ffff700 1 -- 172.21.15.149:0/3320263648 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c004250 con 0x7ff7280ce3a0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff70ffff700 1 -- 172.21.15.149:0/3320263648 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0043b0 con 0x7ff7280ce3a0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72815bdb0 con 0x7ff7280ce3a0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff70ffff700 1 -- 172.21.15.149:0/3320263648 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c0036a0 con 0x7ff7280ce3a0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.899+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72815c370 con 0x7ff7280ce3a0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.900+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72815a800 con 0x7ff7280ce3a0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.900+0000 7ff70ffff700 1 -- 172.21.15.149:0/3320263648 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff71c022070 con 0x7ff7280ce3a0 2023-06-09T04:37:43.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.901+0000 7ff70ffff700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff71406ace0 0x7ff71406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.901+0000 7ff70ffff700 1 -- 172.21.15.149:0/3320263648 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff71c08b3c0 con 0x7ff7280ce3a0 2023-06-09T04:37:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.901+0000 7ff726ffd700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff71406ace0 0x7ff71406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.901+0000 7ff726ffd700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff71406ace0 0x7ff71406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff718006fd0 tx=0x7ff718008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:43.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:43.905+0000 7ff70ffff700 1 -- 172.21.15.149:0/3320263648 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff71c0561d0 con 0x7ff7280ce3a0 2023-06-09T04:37:44.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.091+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff72815a520 con 0x7ff7280ce3a0 2023-06-09T04:37:44.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.092+0000 7ff70ffff700 1 -- 172.21.15.149:0/3320263648 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7ff71c0597f0 con 0x7ff7280ce3a0 2023-06-09T04:37:44.094 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:44.094 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:44.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff71406ace0 msgr2=0x7ff71406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff71406ace0 0x7ff71406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff718006fd0 tx=0x7ff718008040 comp rx=0 tx=0).stop 2023-06-09T04:37:44.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280ce3a0 msgr2=0x7ff7280b4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280ce3a0 0x7ff7280b4010 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff71c006000 tx=0x7ff71c004750 comp rx=0 tx=0).stop 2023-06-09T04:37:44.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 shutdown_connections 2023-06-09T04:37:44.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff71406ace0 0x7ff71406d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff72815adb0 0x7ff7280c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7280ce3a0 0x7ff7280b4010 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 --2- 172.21.15.149:0/3320263648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff728157d30 0x7ff7280c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 >> 172.21.15.149:0/3320263648 conn(0x7ff72806a6d0 msgr2=0x7ff7280d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:44.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.094+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 shutdown_connections 2023-06-09T04:37:44.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.095+0000 7ff72e0de700 1 -- 172.21.15.149:0/3320263648 wait complete. 2023-06-09T04:37:44.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:44.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:44.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.230+0000 7f7b30fdf700 1 Processor -- start 2023-06-09T04:37:44.231 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.230+0000 7f7b30fdf700 1 -- start start 2023-06-09T04:37:44.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.231+0000 7f7b30fdf700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b2c0ce310 0x7f7b2c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.231+0000 7f7b30fdf700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c0d0d30 con 0x7f7b2c15c270 2023-06-09T04:37:44.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.231+0000 7f7b30fdf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c0d1520 con 0x7f7b2c0cd840 2023-06-09T04:37:44.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.231+0000 7f7b30fdf700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c06aec0 con 0x7f7b2c0ce310 2023-06-09T04:37:44.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.231+0000 7f7b2ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b2c0ce310 0x7f7b2c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.231+0000 7f7b2a59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f7b2c15c270 0x7f7b2c0cd130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33070/0 (socket says 172.21.15.149:33070) 2023-06-09T04:37:44.233 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.231+0000 7f7b2a59c700 1 -- 172.21.15.149:0/237419283 learned_addr learned my addr 172.21.15.149:0/237419283 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:44.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.232+0000 7f7b2ad9d700 1 -- 172.21.15.149:0/237419283 >> v1:172.21.15.184:6789/0 conn(0x7f7b2c0cd840 legacy=0x7f7b2c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.232+0000 7f7b2ad9d700 1 -- 172.21.15.149:0/237419283 >> v1:172.21.15.149:6789/0 conn(0x7f7b2c15c270 legacy=0x7f7b2c0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.232+0000 7f7b2ad9d700 1 -- 172.21.15.149:0/237419283 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0cb1a0 con 0x7f7b2c0ce310 2023-06-09T04:37:44.234 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.232+0000 7f7b2ad9d700 1 --2- 172.21.15.149:0/237419283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c0ce310 0x7f7b2c0d07f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009d90 tx=0x7f7b2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1750d65c1b0f6429 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.232+0000 7f7b2959a700 1 -- 172.21.15.149:0/237419283 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2400e070 con 0x7f7b2c0ce310 2023-06-09T04:37:44.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.232+0000 7f7b2959a700 1 -- 172.21.15.149:0/237419283 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2400bbd0 con 0x7f7b2c0ce310 2023-06-09T04:37:44.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.232+0000 7f7b2959a700 1 -- 172.21.15.149:0/237419283 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24012430 con 0x7f7b2c0ce310 2023-06-09T04:37:44.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.233+0000 7f7b30fdf700 1 -- 172.21.15.149:0/237419283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c0ce310 msgr2=0x7f7b2c0d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.233+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/237419283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c0ce310 0x7f7b2c0d07f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009d90 tx=0x7f7b2400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:44.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.233+0000 7f7b30fdf700 1 -- 172.21.15.149:0/237419283 shutdown_connections 2023-06-09T04:37:44.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.233+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/237419283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c0ce310 0x7f7b2c0d07f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.233+0000 7f7b30fdf700 1 -- 172.21.15.149:0/237419283 >> 172.21.15.149:0/237419283 conn(0x7f7b2c069db0 msgr2=0x7f7b2c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:44.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.233+0000 7f7b30fdf700 1 -- 172.21.15.149:0/237419283 shutdown_connections 2023-06-09T04:37:44.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.233+0000 7f7b30fdf700 1 -- 172.21.15.149:0/237419283 wait complete. 2023-06-09T04:37:44.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.234+0000 7f7b30fdf700 1 Processor -- start 2023-06-09T04:37:44.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.234+0000 7f7b30fdf700 1 -- start start 2023-06-09T04:37:44.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b30fdf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0cd840 0x7f7b2c154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b30fdf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0ce310 0x7f7b2c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b30fdf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c15c270 0x7f7b2c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.238 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b30fdf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c0c4250 con 0x7f7b2c15c270 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b30fdf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c155410 con 0x7f7b2c0cd840 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b30fdf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15eca0 con 0x7f7b2c0ce310 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c15c270 0x7f7b2c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c15c270 0x7f7b2c0b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37444/0 (socket says 172.21.15.149:37444) 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 -- 172.21.15.149:0/1057526057 learned_addr learned my addr 172.21.15.149:0/1057526057 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2a59c700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0cd840 0x7f7b2c154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b29d9b700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0ce310 0x7f7b2c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 -- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0ce310 msgr2=0x7f7b2c0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0ce310 0x7f7b2c0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 -- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0cd840 msgr2=0x7f7b2c154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0cd840 0x7f7b2c154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 -- 172.21.15.149:0/1057526057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24009a70 con 0x7f7b2c15c270 2023-06-09T04:37:44.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b2ad9d700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c15c270 0x7f7b2c0b45f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b24014040 tx=0x7f7b24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.235+0000 7f7b1affd700 1 -- 172.21.15.149:0/1057526057 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24012430 con 0x7f7b2c15c270 2023-06-09T04:37:44.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.236+0000 7f7b1affd700 1 -- 172.21.15.149:0/1057526057 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b24020070 con 0x7f7b2c15c270 2023-06-09T04:37:44.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.236+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c15ef80 con 0x7f7b2c15c270 2023-06-09T04:37:44.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.236+0000 7f7b1affd700 1 -- 172.21.15.149:0/1057526057 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24004040 con 0x7f7b2c15c270 2023-06-09T04:37:44.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.236+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c15f540 con 0x7f7b2c15c270 2023-06-09T04:37:44.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.236+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c0c43c0 con 0x7f7b2c15c270 2023-06-09T04:37:44.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.237+0000 7f7b1affd700 1 -- 172.21.15.149:0/1057526057 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b240041a0 con 0x7f7b2c15c270 2023-06-09T04:37:44.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.237+0000 7f7b1affd700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b0c06ace0 0x7f7b0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.237+0000 7f7b1affd700 1 -- 172.21.15.149:0/1057526057 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b24022070 con 0x7f7b2c15c270 2023-06-09T04:37:44.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.238+0000 7f7b2a59c700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b0c06ace0 0x7f7b0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.238+0000 7f7b2a59c700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b0c06ace0 0x7f7b0c06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b20005910 tx=0x7f7b20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.242+0000 7f7b1affd700 1 -- 172.21.15.149:0/1057526057 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b24056780 con 0x7f7b2c15c270 2023-06-09T04:37:44.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.427+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b2c073fa0 con 0x7f7b2c15c270 2023-06-09T04:37:44.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.428+0000 7f7b1affd700 1 -- 172.21.15.149:0/1057526057 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b24059da0 con 0x7f7b2c15c270 2023-06-09T04:37:44.429 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b0c06ace0 msgr2=0x7f7b0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b0c06ace0 0x7f7b0c06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b20005910 tx=0x7f7b20009040 comp rx=0 tx=0).stop 2023-06-09T04:37:44.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c15c270 msgr2=0x7f7b2c0b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c15c270 0x7f7b2c0b45f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b24014040 tx=0x7f7b24004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 shutdown_connections 2023-06-09T04:37:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b0c06ace0 0x7f7b0c06d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b2c15c270 0x7f7b2c0b45f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b2c0cd840 0x7f7b2c154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 --2- 172.21.15.149:0/1057526057 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b2c0ce310 0x7f7b2c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 >> 172.21.15.149:0/1057526057 conn(0x7f7b2c069db0 msgr2=0x7f7b2c06b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:44.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 shutdown_connections 2023-06-09T04:37:44.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.430+0000 7f7b30fdf700 1 -- 172.21.15.149:0/1057526057 wait complete. 2023-06-09T04:37:44.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:44.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.566+0000 7f2f1f540700 1 Processor -- start 2023-06-09T04:37:44.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.566+0000 7f2f1f540700 1 -- start start 2023-06-09T04:37:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1f540700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f18071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1f540700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f180aea80 0x7f2f180cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1f540700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f180cc580 0x7f2f180b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1f540700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180723d0 con 0x7f2f180aea80 2023-06-09T04:37:44.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1f540700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f180cca00 con 0x7f2f180cc580 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1f540700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1815d900 con 0x7f2f18159070 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f180aea80 0x7f2f180cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2f180aea80 0x7f2f180cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37448/0 (socket says 172.21.15.149:37448) 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 -- 172.21.15.149:0/2076225106 learned_addr learned my addr 172.21.15.149:0/2076225106 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1dadd700 1 --2- 172.21.15.149:0/2076225106 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cc580 0x7f2f180b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1d2dc700 1 --2- 172.21.15.149:0/2076225106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f18071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 -- 172.21.15.149:0/2076225106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 msgr2=0x7f2f18071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:44.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 --2- 172.21.15.149:0/2076225106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f18071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 -- 172.21.15.149:0/2076225106 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cc580 msgr2=0x7f2f180b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 --2- 172.21.15.149:0/2076225106 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cc580 0x7f2f180b10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.567+0000 7f2f1cadb700 1 -- 172.21.15.149:0/2076225106 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18071480 con 0x7f2f180aea80 2023-06-09T04:37:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1cadb700 1 --2- 172.21.15.149:0/2076225106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180aea80 0x7f2f180cc040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cce70 tx=0x7f2f14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b4dbf09cd60b26 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f0ffff700 1 -- 172.21.15.149:0/2076225106 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400b870 con 0x7f2f180aea80 2023-06-09T04:37:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f0ffff700 1 -- 172.21.15.149:0/2076225106 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1400b9d0 con 0x7f2f180aea80 2023-06-09T04:37:44.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f0ffff700 1 -- 172.21.15.149:0/2076225106 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400bd60 con 0x7f2f180aea80 2023-06-09T04:37:44.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 -- 172.21.15.149:0/2076225106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180aea80 msgr2=0x7f2f180cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 --2- 172.21.15.149:0/2076225106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180aea80 0x7f2f180cc040 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2f180cce70 tx=0x7f2f14009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 -- 172.21.15.149:0/2076225106 shutdown_connections 2023-06-09T04:37:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 --2- 172.21.15.149:0/2076225106 >> v2:172.21.15.184:3300/0 conn(0x7f2f180cc580 0x7f2f180b10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 --2- 172.21.15.149:0/2076225106 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f18071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 --2- 172.21.15.149:0/2076225106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180aea80 0x7f2f180cc040 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 -- 172.21.15.149:0/2076225106 >> 172.21.15.149:0/2076225106 conn(0x7f2f1806d0f0 msgr2=0x7f2f1806d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 -- 172.21.15.149:0/2076225106 shutdown_connections 2023-06-09T04:37:44.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.568+0000 7f2f1f540700 1 -- 172.21.15.149:0/2076225106 wait complete. 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 Processor -- start 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 -- start start 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180aea80 0x7f2f1814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180cc580 0x7f2f181f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f181f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181f33a0 con 0x7f2f180cc580 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1815a720 con 0x7f2f180aea80 2023-06-09T04:37:44.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1f540700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f181f2d70 con 0x7f2f18159070 2023-06-09T04:37:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1cadb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180cc580 0x7f2f181f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1cadb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180cc580 0x7f2f181f1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37454/0 (socket says 172.21.15.149:37454) 2023-06-09T04:37:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.570+0000 7f2f1cadb700 1 -- 172.21.15.149:0/1267171058 learned_addr learned my addr 172.21.15.149:0/1267171058 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1d2dc700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180aea80 0x7f2f1814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1dadd700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f181f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1cadb700 1 -- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 msgr2=0x7f2f181f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1cadb700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f181f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1cadb700 1 -- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180aea80 msgr2=0x7f2f1814ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1cadb700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180aea80 0x7f2f1814ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1cadb700 1 -- 172.21.15.149:0/1267171058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14009550 con 0x7f2f180cc580 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1cadb700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180cc580 0x7f2f181f1bb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f0dffb700 1 -- 172.21.15.149:0/1267171058 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14004520 con 0x7f2f180cc580 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f0dffb700 1 -- 172.21.15.149:0/1267171058 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1401e070 con 0x7f2f180cc580 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1814f2c0 con 0x7f2f180cc580 2023-06-09T04:37:44.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f0dffb700 1 -- 172.21.15.149:0/1267171058 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140038e0 con 0x7f2f180cc580 2023-06-09T04:37:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.571+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f181f27b0 con 0x7f2f180cc580 2023-06-09T04:37:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.572+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f181f34e0 con 0x7f2f180cc580 2023-06-09T04:37:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.573+0000 7f2f0dffb700 1 -- 172.21.15.149:0/1267171058 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f14003a40 con 0x7f2f180cc580 2023-06-09T04:37:44.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.573+0000 7f2f0dffb700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2efc06ace0 0x7f2efc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.573+0000 7f2f0dffb700 1 -- 172.21.15.149:0/1267171058 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f14020070 con 0x7f2f180cc580 2023-06-09T04:37:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.573+0000 7f2f1d2dc700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2efc06ace0 0x7f2efc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.574+0000 7f2f1d2dc700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2efc06ace0 0x7f2efc06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800b9b0 tx=0x7f2f08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.578+0000 7f2f0dffb700 1 -- 172.21.15.149:0/1267171058 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f181f34e0 con 0x7f2f180cc580 2023-06-09T04:37:44.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.765+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f181f34e0 con 0x7f2f180cc580 2023-06-09T04:37:44.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.766+0000 7f2f0dffb700 1 -- 172.21.15.149:0/1267171058 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f181f34e0 con 0x7f2f180cc580 2023-06-09T04:37:44.767 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:44.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2efc06ace0 msgr2=0x7f2efc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2efc06ace0 0x7f2efc06d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2f0800b9b0 tx=0x7f2f08008040 comp rx=0 tx=0).stop 2023-06-09T04:37:44.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180cc580 msgr2=0x7f2f181f1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180cc580 0x7f2f181f1bb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2f14000c00 tx=0x7f2f14004750 comp rx=0 tx=0).stop 2023-06-09T04:37:44.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 shutdown_connections 2023-06-09T04:37:44.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2efc06ace0 0x7f2efc06d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2f18159070 0x7f2f181f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f180aea80 0x7f2f1814ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 --2- 172.21.15.149:0/1267171058 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f180cc580 0x7f2f181f1bb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 >> 172.21.15.149:0/1267171058 conn(0x7f2f1806d0f0 msgr2=0x7f2f180af0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:44.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 shutdown_connections 2023-06-09T04:37:44.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.768+0000 7f2f1f540700 1 -- 172.21.15.149:0/1267171058 wait complete. 2023-06-09T04:37:44.781 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:44.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.904+0000 7f735b362700 1 Processor -- start 2023-06-09T04:37:44.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.904+0000 7f735b362700 1 -- start start 2023-06-09T04:37:44.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f735b362700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7354159380 0x7f73540716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f735b362700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73540cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f735b362700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7354071d50 0x7f73540cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f735b362700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540b10d0 con 0x7f7354159380 2023-06-09T04:37:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f735b362700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f735406f480 con 0x7f7354071d50 2023-06-09T04:37:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f735b362700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f735406f760 con 0x7f73540b1dc0 2023-06-09T04:37:44.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7354159380 0x7f73540716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7354159380 0x7f73540716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37460/0 (socket says 172.21.15.149:37460) 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 -- 172.21.15.149:0/1829345310 learned_addr learned my addr 172.21.15.149:0/1829345310 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 -- 172.21.15.149:0/1829345310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 msgr2=0x7f73540cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73598ff700 1 --2- 172.21.15.149:0/1829345310 >> v2:172.21.15.184:3300/0 conn(0x7f7354071d50 0x7f73540cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73588fd700 1 --2- 172.21.15.149:0/1829345310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73540cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 --2- 172.21.15.149:0/1829345310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73540cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 -- 172.21.15.149:0/1829345310 >> v2:172.21.15.184:3300/0 conn(0x7f7354071d50 msgr2=0x7f73540cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:44.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 --2- 172.21.15.149:0/1829345310 >> v2:172.21.15.184:3300/0 conn(0x7f7354071d50 0x7f73540cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 -- 172.21.15.149:0/1829345310 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73540b12e0 con 0x7f7354159380 2023-06-09T04:37:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f73590fe700 1 --2- 172.21.15.149:0/1829345310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354159380 0x7f73540716c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f73540704f0 tx=0x7f7344009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89d72f90f5c053f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.905+0000 7f734bfff700 1 -- 172.21.15.149:0/1829345310 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400b870 con 0x7f7354159380 2023-06-09T04:37:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f734bfff700 1 -- 172.21.15.149:0/1829345310 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734400b9d0 con 0x7f7354159380 2023-06-09T04:37:44.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f734bfff700 1 -- 172.21.15.149:0/1829345310 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400bd60 con 0x7f7354159380 2023-06-09T04:37:44.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 -- 172.21.15.149:0/1829345310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354159380 msgr2=0x7f73540716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 --2- 172.21.15.149:0/1829345310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354159380 0x7f73540716c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f73540704f0 tx=0x7f7344009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 -- 172.21.15.149:0/1829345310 shutdown_connections 2023-06-09T04:37:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 --2- 172.21.15.149:0/1829345310 >> v2:172.21.15.184:3300/0 conn(0x7f7354071d50 0x7f73540cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 --2- 172.21.15.149:0/1829345310 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354159380 0x7f73540716c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 --2- 172.21.15.149:0/1829345310 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73540cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 -- 172.21.15.149:0/1829345310 >> 172.21.15.149:0/1829345310 conn(0x7f735406aec0 msgr2=0x7f735406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:44.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 -- 172.21.15.149:0/1829345310 shutdown_connections 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.906+0000 7f735b362700 1 -- 172.21.15.149:0/1829345310 wait complete. 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.908+0000 7f735b362700 1 Processor -- start 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.908+0000 7f735b362700 1 -- start start 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f735b362700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354071d50 0x7f73540cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f735b362700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73541f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f735b362700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7354159380 0x7f7354153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f735b362700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73540c3180 con 0x7f7354071d50 2023-06-09T04:37:44.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f735b362700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73541f1700 con 0x7f7354159380 2023-06-09T04:37:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f735b362700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7354154300 con 0x7f73540b1dc0 2023-06-09T04:37:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354071d50 0x7f73540cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354071d50 0x7f73540cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37466/0 (socket says 172.21.15.149:37466) 2023-06-09T04:37:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 -- 172.21.15.149:0/3844099743 learned_addr learned my addr 172.21.15.149:0/3844099743 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73598ff700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7354159380 0x7f7354153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73588fd700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73541f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 -- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 msgr2=0x7f73541f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73541f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 -- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7354159380 msgr2=0x7f7354153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7354159380 0x7f7354153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 -- 172.21.15.149:0/3844099743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009550 con 0x7f7354071d50 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73598ff700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7354159380 0x7f7354153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73588fd700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73541f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f73590fe700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354071d50 0x7f73540cd570 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7344014040 tx=0x7f7344004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f7349ffb700 1 -- 172.21.15.149:0/3844099743 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344004520 con 0x7f7354071d50 2023-06-09T04:37:44.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f7349ffb700 1 -- 172.21.15.149:0/3844099743 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734401e070 con 0x7f7354071d50 2023-06-09T04:37:44.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f7349ffb700 1 -- 172.21.15.149:0/3844099743 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440038e0 con 0x7f7354071d50 2023-06-09T04:37:44.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.909+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73541f1910 con 0x7f7354071d50 2023-06-09T04:37:44.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.910+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73541f1ed0 con 0x7f7354071d50 2023-06-09T04:37:44.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.911+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354073fa0 con 0x7f7354071d50 2023-06-09T04:37:44.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.911+0000 7f7349ffb700 1 -- 172.21.15.149:0/3844099743 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7344003a40 con 0x7f7354071d50 2023-06-09T04:37:44.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.912+0000 7f7349ffb700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f733806ad10 0x7f733806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:44.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.912+0000 7f7349ffb700 1 -- 172.21.15.149:0/3844099743 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7344020070 con 0x7f7354071d50 2023-06-09T04:37:44.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.912+0000 7f73588fd700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f733806ad10 0x7f733806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:44.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.912+0000 7f73588fd700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f733806ad10 0x7f733806d1c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73541eec90 tx=0x7f7350008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:44.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:44.916+0000 7f7349ffb700 1 -- 172.21.15.149:0/3844099743 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7344055e20 con 0x7f7354071d50 2023-06-09T04:37:45.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.100+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73540714a0 con 0x7f7354071d50 2023-06-09T04:37:45.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.100+0000 7f7349ffb700 1 -- 172.21.15.149:0/3844099743 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7344015020 con 0x7f7354071d50 2023-06-09T04:37:45.101 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:45.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f733806ad10 msgr2=0x7f733806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f733806ad10 0x7f733806d1c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73541eec90 tx=0x7f7350008040 comp rx=0 tx=0).stop 2023-06-09T04:37:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354071d50 msgr2=0x7f73540cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354071d50 0x7f73540cd570 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7344014040 tx=0x7f7344004750 comp rx=0 tx=0).stop 2023-06-09T04:37:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 shutdown_connections 2023-06-09T04:37:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f733806ad10 0x7f733806d1c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7354159380 0x7f7354153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7354071d50 0x7f73540cd570 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 --2- 172.21.15.149:0/3844099743 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f73540b1dc0 0x7f73541f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 >> 172.21.15.149:0/3844099743 conn(0x7f735406aec0 msgr2=0x7f73540b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:45.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 shutdown_connections 2023-06-09T04:37:45.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.102+0000 7f735b362700 1 -- 172.21.15.149:0/3844099743 wait complete. 2023-06-09T04:37:45.116 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:45.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.238+0000 7fb409aba700 1 Processor -- start 2023-06-09T04:37:45.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.238+0000 7fb409aba700 1 -- start start 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb409aba700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb4040b60a0 0x7fb4040cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb409aba700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4040cf5b0 0x7fb40415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb409aba700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4040cda20 con 0x7fb40415e170 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb409aba700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040b6470 con 0x7fb4040cf5b0 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb409aba700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40415a520 con 0x7fb4040b60a0 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb3faffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4040cf5b0 0x7fb40415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb3faffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb4040cf5b0 0x7fb40415dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37476/0 (socket says 172.21.15.149:37476) 2023-06-09T04:37:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb403fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb40415e170 0x7fb4040ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33110/0 (socket says 172.21.15.149:33110) 2023-06-09T04:37:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb3faffd700 1 -- 172.21.15.149:0/875369298 learned_addr learned my addr 172.21.15.149:0/875369298 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb4037fe700 1 --2- 172.21.15.149:0/875369298 >> v2:172.21.15.184:3300/0 conn(0x7fb4040b60a0 0x7fb4040cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb3faffd700 1 -- 172.21.15.149:0/875369298 >> v2:172.21.15.184:3300/0 conn(0x7fb4040b60a0 msgr2=0x7fb4040cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb3faffd700 1 --2- 172.21.15.149:0/875369298 >> v2:172.21.15.184:3300/0 conn(0x7fb4040b60a0 0x7fb4040cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb3faffd700 1 -- 172.21.15.149:0/875369298 >> v1:172.21.15.149:6789/0 conn(0x7fb40415e170 legacy=0x7fb4040ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb3faffd700 1 -- 172.21.15.149:0/875369298 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40415ea40 con 0x7fb4040cf5b0 2023-06-09T04:37:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.239+0000 7fb402ffd700 1 -- 172.21.15.149:0/875369298 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161558118 0 0) 0x7fb4040cda20 con 0x7fb40415e170 2023-06-09T04:37:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb3faffd700 1 --2- 172.21.15.149:0/875369298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb40415dc30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb40406f5e0 tx=0x7fb3ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0182a55e4cdfe8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb402ffd700 1 -- 172.21.15.149:0/875369298 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00b870 con 0x7fb4040cf5b0 2023-06-09T04:37:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb402ffd700 1 -- 172.21.15.149:0/875369298 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec00b9d0 con 0x7fb4040cf5b0 2023-06-09T04:37:45.243 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb402ffd700 1 -- 172.21.15.149:0/875369298 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00bd60 con 0x7fb4040cf5b0 2023-06-09T04:37:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 -- 172.21.15.149:0/875369298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 msgr2=0x7fb40415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 --2- 172.21.15.149:0/875369298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb40415dc30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb40406f5e0 tx=0x7fb3ec009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 -- 172.21.15.149:0/875369298 shutdown_connections 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 --2- 172.21.15.149:0/875369298 >> v2:172.21.15.184:3300/0 conn(0x7fb4040b60a0 0x7fb4040cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 --2- 172.21.15.149:0/875369298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb40415dc30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 -- 172.21.15.149:0/875369298 >> 172.21.15.149:0/875369298 conn(0x7fb404069db0 msgr2=0x7fb40406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 -- 172.21.15.149:0/875369298 shutdown_connections 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.240+0000 7fb409aba700 1 -- 172.21.15.149:0/875369298 wait complete. 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.241+0000 7fb409aba700 1 Processor -- start 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb409aba700 1 -- start start 2023-06-09T04:37:45.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb409aba700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4040b60a0 0x7fb40415a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb409aba700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb404149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb409aba700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb40415e170 0x7fb40406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb409aba700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40415ba00 con 0x7fb4040cf5b0 2023-06-09T04:37:45.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb409aba700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40406bf10 con 0x7fb4040b60a0 2023-06-09T04:37:45.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb409aba700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40415adf0 con 0x7fb40415e170 2023-06-09T04:37:45.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb3faffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb404149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb3faffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb404149c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37480/0 (socket says 172.21.15.149:37480) 2023-06-09T04:37:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.242+0000 7fb3faffd700 1 -- 172.21.15.149:0/2503306235 learned_addr learned my addr 172.21.15.149:0/2503306235 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb3faffd700 1 -- 172.21.15.149:0/2503306235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb40415e170 msgr2=0x7fb40406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb3faffd700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb40415e170 0x7fb40406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb3faffd700 1 -- 172.21.15.149:0/2503306235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4040b60a0 msgr2=0x7fb40415a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb4037fe700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4040b60a0 0x7fb40415a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb3faffd700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4040b60a0 0x7fb40415a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb3faffd700 1 -- 172.21.15.149:0/2503306235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec009550 con 0x7fb4040cf5b0 2023-06-09T04:37:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb3faffd700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb404149c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000c00 tx=0x7fb3ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb400ff9700 1 -- 172.21.15.149:0/2503306235 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec004520 con 0x7fb4040cf5b0 2023-06-09T04:37:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb400ff9700 1 -- 172.21.15.149:0/2503306235 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec01e070 con 0x7fb4040cf5b0 2023-06-09T04:37:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40415b0d0 con 0x7fb4040cf5b0 2023-06-09T04:37:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb400ff9700 1 -- 172.21.15.149:0/2503306235 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec0038a0 con 0x7fb4040cf5b0 2023-06-09T04:37:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.243+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40415b690 con 0x7fb4040cf5b0 2023-06-09T04:37:45.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.244+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40415b820 con 0x7fb4040cf5b0 2023-06-09T04:37:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.244+0000 7fb400ff9700 1 -- 172.21.15.149:0/2503306235 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3ec003a00 con 0x7fb4040cf5b0 2023-06-09T04:37:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.245+0000 7fb400ff9700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3e406ace0 0x7fb3e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.245+0000 7fb400ff9700 1 -- 172.21.15.149:0/2503306235 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb3ec020070 con 0x7fb4040cf5b0 2023-06-09T04:37:45.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.245+0000 7fb4037fe700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3e406ace0 0x7fb3e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.245+0000 7fb4037fe700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3e406ace0 0x7fb3e406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009770 tx=0x7fb3f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.249+0000 7fb400ff9700 1 -- 172.21.15.149:0/2503306235 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb3ec055ba0 con 0x7fb4040cf5b0 2023-06-09T04:37:45.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.432+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb40415a110 con 0x7fb4040cf5b0 2023-06-09T04:37:45.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.432+0000 7fb400ff9700 1 -- 172.21.15.149:0/2503306235 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3ec003cb0 con 0x7fb4040cf5b0 2023-06-09T04:37:45.435 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.434+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3e406ace0 msgr2=0x7fb3e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.434+0000 7fb409aba700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3e406ace0 0x7fb3e406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009770 tx=0x7fb3f4008040 comp rx=0 tx=0).stop 2023-06-09T04:37:45.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.434+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 msgr2=0x7fb404149c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.434+0000 7fb409aba700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb404149c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec000c00 tx=0x7fb3ec004750 comp rx=0 tx=0).stop 2023-06-09T04:37:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.434+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 shutdown_connections 2023-06-09T04:37:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.434+0000 7fb409aba700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb3e406ace0 0x7fb3e406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.434+0000 7fb409aba700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb40415e170 0x7fb40406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.435+0000 7fb409aba700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb4040b60a0 0x7fb40415a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.435+0000 7fb409aba700 1 --2- 172.21.15.149:0/2503306235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb4040cf5b0 0x7fb404149c70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.435+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 >> 172.21.15.149:0/2503306235 conn(0x7fb404069db0 msgr2=0x7fb4040b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:45.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.435+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 shutdown_connections 2023-06-09T04:37:45.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.435+0000 7fb409aba700 1 -- 172.21.15.149:0/2503306235 wait complete. 2023-06-09T04:37:45.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:45.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.570+0000 7f7392513700 1 Processor -- start 2023-06-09T04:37:45.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.570+0000 7f7392513700 1 -- start start 2023-06-09T04:37:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.571+0000 7f7392513700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f738c159380 0x7f738c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.571+0000 7f7392513700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.571+0000 7f7392513700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c06f480 con 0x7f738c0b1dc0 2023-06-09T04:37:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.571+0000 7f7392513700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0b10d0 con 0x7f738c159380 2023-06-09T04:37:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.571+0000 7f7392513700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c06f760 con 0x7f738c0cd930 2023-06-09T04:37:45.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:43104/0 (socket says 172.21.15.149:43104) 2023-06-09T04:37:45.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 -- 172.21.15.149:0/2581789100 learned_addr learned my addr 172.21.15.149:0/2581789100 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:45.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f738bfff700 1 --2- 172.21.15.149:0/2581789100 >> v2:172.21.15.184:3300/0 conn(0x7f738c159380 0x7f738c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f738b7fe700 1 --1- 172.21.15.149:0/2581789100 >> v1:172.21.15.184:6789/0 conn(0x7f738c0b1dc0 0x7f738c0cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:39118/0 (socket says 172.21.15.149:39118) 2023-06-09T04:37:45.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 -- 172.21.15.149:0/2581789100 >> v2:172.21.15.184:3300/0 conn(0x7f738c159380 msgr2=0x7f738c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:45.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 --2- 172.21.15.149:0/2581789100 >> v2:172.21.15.184:3300/0 conn(0x7f738c159380 0x7f738c0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 -- 172.21.15.149:0/2581789100 >> v1:172.21.15.184:6789/0 conn(0x7f738c0b1dc0 legacy=0x7f738c0cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 -- 172.21.15.149:0/2581789100 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0b12e0 con 0x7f738c0cd930 2023-06-09T04:37:45.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f738bfff700 1 --2- 172.21.15.149:0/2581789100 >> v2:172.21.15.184:3300/0 conn(0x7f738c159380 0x7f738c0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:45.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f7390ab0700 1 --2- 172.21.15.149:0/2581789100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7384009e50 tx=0x7f738400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600eca5f55d6c73c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f738affd700 1 -- 172.21.15.149:0/2581789100 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738400e070 con 0x7f738c0cd930 2023-06-09T04:37:45.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f738affd700 1 -- 172.21.15.149:0/2581789100 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384003a20 con 0x7f738c0cd930 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.572+0000 7f738affd700 1 -- 172.21.15.149:0/2581789100 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384003dd0 con 0x7f738c0cd930 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 -- 172.21.15.149:0/2581789100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 msgr2=0x7f738c0ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 --2- 172.21.15.149:0/2581789100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7384009e50 tx=0x7f738400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 -- 172.21.15.149:0/2581789100 shutdown_connections 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 --2- 172.21.15.149:0/2581789100 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 --2- 172.21.15.149:0/2581789100 >> v2:172.21.15.184:3300/0 conn(0x7f738c159380 0x7f738c0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 -- 172.21.15.149:0/2581789100 >> 172.21.15.149:0/2581789100 conn(0x7f738c06aec0 msgr2=0x7f738c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:45.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 -- 172.21.15.149:0/2581789100 shutdown_connections 2023-06-09T04:37:45.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.573+0000 7f7392513700 1 -- 172.21.15.149:0/2581789100 wait complete. 2023-06-09T04:37:45.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.574+0000 7f7392513700 1 Processor -- start 2023-06-09T04:37:45.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.574+0000 7f7392513700 1 -- start start 2023-06-09T04:37:45.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7392513700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0b1dc0 0x7f738c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7392513700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7392513700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f738c159380 0x7f738c0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7392513700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0c3a50 con 0x7f738c159380 2023-06-09T04:37:45.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7392513700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0b4eb0 con 0x7f738c0b1dc0 2023-06-09T04:37:45.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7392513700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0c6170 con 0x7f738c0cd930 2023-06-09T04:37:45.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7390ab0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f738c159380 0x7f738c0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7390ab0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f738c159380 0x7f738c0caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37498/0 (socket says 172.21.15.149:37498) 2023-06-09T04:37:45.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f7390ab0700 1 -- 172.21.15.149:0/2601661260 learned_addr learned my addr 172.21.15.149:0/2601661260 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:45.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f738b7fe700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.575+0000 7f738bfff700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0b1dc0 0x7f738c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7390ab0700 1 -- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 msgr2=0x7f738c0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7390ab0700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7390ab0700 1 -- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0b1dc0 msgr2=0x7f738c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7390ab0700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0b1dc0 0x7f738c0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7390ab0700 1 -- 172.21.15.149:0/2601661260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73800094a0 con 0x7f738c159380 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7390ab0700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f738c159380 0x7f738c0caa80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f738c0b1210 tx=0x7f7384004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7388ff9700 1 -- 172.21.15.149:0/2601661260 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384004440 con 0x7f738c159380 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7388ff9700 1 -- 172.21.15.149:0/2601661260 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73840092e0 con 0x7f738c159380 2023-06-09T04:37:45.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7388ff9700 1 -- 172.21.15.149:0/2601661260 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840047e0 con 0x7f738c159380 2023-06-09T04:37:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7384009b30 con 0x7f738c159380 2023-06-09T04:37:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.576+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c0b4610 con 0x7f738c159380 2023-06-09T04:37:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.577+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0c3c00 con 0x7f738c159380 2023-06-09T04:37:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.577+0000 7f7388ff9700 1 -- 172.21.15.149:0/2601661260 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7384019070 con 0x7f738c159380 2023-06-09T04:37:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.578+0000 7f7388ff9700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f737806ace0 0x7f737806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.578+0000 7f7388ff9700 1 -- 172.21.15.149:0/2601661260 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f738408a5f0 con 0x7f738c159380 2023-06-09T04:37:45.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.578+0000 7f738bfff700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f737806ace0 0x7f737806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.578+0000 7f738bfff700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f737806ace0 0x7f737806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7380009cd0 tx=0x7f7380009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.582+0000 7f7388ff9700 1 -- 172.21.15.149:0/2601661260 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f738c0c3c00 con 0x7f738c159380 2023-06-09T04:37:45.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.770+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f738c0c3c00 con 0x7f738c159380 2023-06-09T04:37:45.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.770+0000 7f7388ff9700 1 -- 172.21.15.149:0/2601661260 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f738c0c3c00 con 0x7f738c159380 2023-06-09T04:37:45.771 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:45.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f737806ace0 msgr2=0x7f737806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f737806ace0 0x7f737806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7380009cd0 tx=0x7f7380009210 comp rx=0 tx=0).stop 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f738c159380 msgr2=0x7f738c0caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f738c159380 0x7f738c0caa80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f738c0b1210 tx=0x7f7384004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 shutdown_connections 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f737806ace0 0x7f737806d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f738c159380 0x7f738c0caa80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f738c0b1dc0 0x7f738c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 --2- 172.21.15.149:0/2601661260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f738c0cd930 0x7f738c0ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 >> 172.21.15.149:0/2601661260 conn(0x7f738c06aec0 msgr2=0x7f738c155400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:45.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 shutdown_connections 2023-06-09T04:37:45.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.772+0000 7f7392513700 1 -- 172.21.15.149:0/2601661260 wait complete. 2023-06-09T04:37:45.793 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T04:37:45.794 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-09T04:37:45.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.913+0000 7f226abc1700 1 Processor -- start 2023-06-09T04:37:45.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.913+0000 7f226abc1700 1 -- start start 2023-06-09T04:37:45.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.914+0000 7f226abc1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f226415c590 0x7f22640af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.914+0000 7f226abc1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f22640ccba0 0x7f22640b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.914+0000 7f226abc1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22640af050 con 0x7f2264069db0 2023-06-09T04:37:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.914+0000 7f226abc1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22640afae0 con 0x7f22640ccba0 2023-06-09T04:37:45.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.914+0000 7f226abc1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22640ccff0 con 0x7f226415c590 2023-06-09T04:37:45.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f226415c590 0x7f22640af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f226415c590 0x7f22640af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:43114/0 (socket says 172.21.15.149:43114) 2023-06-09T04:37:45.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 -- 172.21.15.149:0/4030145001 learned_addr learned my addr 172.21.15.149:0/4030145001 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f2263fff700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f22640ccba0 0x7f22640b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226915e700 1 --1- 172.21.15.149:0/4030145001 >> v1:172.21.15.184:6789/0 conn(0x7f2264069db0 0x7f226415fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:39132/0 (socket says 172.21.15.149:39132) 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 -- 172.21.15.149:0/4030145001 >> v2:172.21.15.184:3300/0 conn(0x7f22640ccba0 msgr2=0x7f22640b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 --2- 172.21.15.149:0/4030145001 >> v2:172.21.15.184:3300/0 conn(0x7f22640ccba0 0x7f22640b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 -- 172.21.15.149:0/4030145001 >> v1:172.21.15.184:6789/0 conn(0x7f2264069db0 legacy=0x7f226415fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 -- 172.21.15.149:0/4030145001 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22640af800 con 0x7f226415c590 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f22637fe700 1 -- 172.21.15.149:0/4030145001 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272236146 0 0) 0x7f22640af050 con 0x7f2264069db0 2023-06-09T04:37:45.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f2263fff700 1 --2- 172.21.15.149:0/4030145001 >> v2:172.21.15.184:3300/0 conn(0x7f22640ccba0 0x7f22640b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:45.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f226895d700 1 --2- 172.21.15.149:0/4030145001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f226415c590 0x7f22640af220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2258006fd0 tx=0x7f2258009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb4cf31564a60836 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f22637fe700 1 -- 172.21.15.149:0/4030145001 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258005e30 con 0x7f226415c590 2023-06-09T04:37:45.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f22637fe700 1 -- 172.21.15.149:0/4030145001 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2258004030 con 0x7f226415c590 2023-06-09T04:37:45.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.915+0000 7f22637fe700 1 -- 172.21.15.149:0/4030145001 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580043e0 con 0x7f226415c590 2023-06-09T04:37:45.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 -- 172.21.15.149:0/4030145001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f226415c590 msgr2=0x7f22640af220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 --2- 172.21.15.149:0/4030145001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f226415c590 0x7f22640af220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2258006fd0 tx=0x7f2258009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 -- 172.21.15.149:0/4030145001 shutdown_connections 2023-06-09T04:37:45.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 --2- 172.21.15.149:0/4030145001 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f226415c590 0x7f22640af220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 --2- 172.21.15.149:0/4030145001 >> v2:172.21.15.184:3300/0 conn(0x7f22640ccba0 0x7f22640b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 -- 172.21.15.149:0/4030145001 >> 172.21.15.149:0/4030145001 conn(0x7f226406b7e0 msgr2=0x7f22640cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:45.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 -- 172.21.15.149:0/4030145001 shutdown_connections 2023-06-09T04:37:45.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.916+0000 7f226abc1700 1 -- 172.21.15.149:0/4030145001 wait complete. 2023-06-09T04:37:45.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.917+0000 7f226abc1700 1 Processor -- start 2023-06-09T04:37:45.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.917+0000 7f226abc1700 1 -- start start 2023-06-09T04:37:45.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226abc1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2264069db0 0x7f22640c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226abc1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22640ccba0 0x7f22640c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226abc1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f226415c590 0x7f22641593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226abc1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640c7070 con 0x7f226415c590 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226abc1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22640c7350 con 0x7f22640ccba0 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226abc1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22640c7630 con 0x7f2264069db0 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226895d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2264069db0 0x7f22640c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226915e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f226415c590 0x7f22641593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226895d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2264069db0 0x7f22640c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:43120/0 (socket says 172.21.15.149:43120) 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226895d700 1 -- 172.21.15.149:0/1945713914 learned_addr learned my addr 172.21.15.149:0/1945713914 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:45.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f2263fff700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22640ccba0 0x7f22640c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226915e700 1 -- 172.21.15.149:0/1945713914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2264069db0 msgr2=0x7f22640c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226915e700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2264069db0 0x7f22640c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226915e700 1 -- 172.21.15.149:0/1945713914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22640ccba0 msgr2=0x7f22640c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226915e700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22640ccba0 0x7f22640c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.918+0000 7f226915e700 1 -- 172.21.15.149:0/1945713914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500094a0 con 0x7f226415c590 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.919+0000 7f226915e700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f226415c590 0x7f22641593c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f225c00caa0 tx=0x7f225c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.919+0000 7f22617fa700 1 -- 172.21.15.149:0/1945713914 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00a9e0 con 0x7f226415c590 2023-06-09T04:37:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.919+0000 7f22617fa700 1 -- 172.21.15.149:0/1945713914 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c00ab40 con 0x7f226415c590 2023-06-09T04:37:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.919+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2258009500 con 0x7f226415c590 2023-06-09T04:37:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.919+0000 7f22617fa700 1 -- 172.21.15.149:0/1945713914 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0070d0 con 0x7f226415c590 2023-06-09T04:37:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.919+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22640c7e00 con 0x7f226415c590 2023-06-09T04:37:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.920+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22640cc380 con 0x7f226415c590 2023-06-09T04:37:45.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.921+0000 7f22617fa700 1 -- 172.21.15.149:0/1945713914 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f225c007230 con 0x7f226415c590 2023-06-09T04:37:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.921+0000 7f22617fa700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f224806ace0 0x7f224806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.921+0000 7f22617fa700 1 -- 172.21.15.149:0/1945713914 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f225c089390 con 0x7f226415c590 2023-06-09T04:37:45.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.921+0000 7f226895d700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f224806ace0 0x7f224806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.922+0000 7f226895d700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f224806ace0 0x7f224806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f2258008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:45.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:45.925+0000 7f22617fa700 1 -- 172.21.15.149:0/1945713914 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f225c054260 con 0x7f226415c590 2023-06-09T04:37:46.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.192+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f22640cc380 con 0x7f226415c590 2023-06-09T04:37:46.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.697+0000 7f22617fa700 1 -- 172.21.15.149:0/1945713914 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v68) v1 ==== 147+0+0 (secure 0 0 0) 0x7f22640cc380 con 0x7f226415c590 2023-06-09T04:37:46.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f224806ace0 msgr2=0x7f224806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:46.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f224806ace0 0x7f224806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2258000c00 tx=0x7f2258008070 comp rx=0 tx=0).stop 2023-06-09T04:37:46.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f226415c590 msgr2=0x7f22641593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:46.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f226415c590 0x7f22641593c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f225c00caa0 tx=0x7f225c00cdb0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 shutdown_connections 2023-06-09T04:37:46.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f224806ace0 0x7f224806d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2264069db0 0x7f22640c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f226415c590 0x7f22641593c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 --2- 172.21.15.149:0/1945713914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22640ccba0 0x7f22640c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 >> 172.21.15.149:0/1945713914 conn(0x7f226406b7e0 msgr2=0x7f22640b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:46.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 shutdown_connections 2023-06-09T04:37:46.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.699+0000 7f226abc1700 1 -- 172.21.15.149:0/1945713914 wait complete. 2023-06-09T04:37:46.713 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-09T04:37:46.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.837+0000 7f1a9282d700 1 Processor -- start 2023-06-09T04:37:46.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.837+0000 7f1a9282d700 1 -- start start 2023-06-09T04:37:46.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.837+0000 7f1a9282d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1a8c0cf5b0 0x7f1a8c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:46.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.837+0000 7f1a9282d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1a8c15e340 0x7f1a8c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:46.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.837+0000 7f1a9282d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8c0cda20 con 0x7f1a8c0b60a0 2023-06-09T04:37:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.837+0000 7f1a9282d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c0b6470 con 0x7f1a8c15e340 2023-06-09T04:37:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.837+0000 7f1a9282d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c15e7a0 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a90dca700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1a8c15e340 0x7f1a8c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a8bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1a8c0b60a0 0x7f1a8c15dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33148/0 (socket says 172.21.15.149:33148) 2023-06-09T04:37:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a8bfff700 1 -- 172.21.15.149:0/2678107095 learned_addr learned my addr 172.21.15.149:0/2678107095 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a8b7fe700 1 --2- 172.21.15.149:0/2678107095 >> v2:172.21.15.184:3300/0 conn(0x7f1a8c0cf5b0 0x7f1a8c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:46.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a90dca700 1 -- 172.21.15.149:0/2678107095 >> v2:172.21.15.184:3300/0 conn(0x7f1a8c0cf5b0 msgr2=0x7f1a8c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:46.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a90dca700 1 --2- 172.21.15.149:0/2678107095 >> v2:172.21.15.184:3300/0 conn(0x7f1a8c0cf5b0 0x7f1a8c0cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a90dca700 1 -- 172.21.15.149:0/2678107095 >> v1:172.21.15.149:6789/0 conn(0x7f1a8c0b60a0 legacy=0x7f1a8c15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:46.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a90dca700 1 -- 172.21.15.149:0/2678107095 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c15a520 con 0x7f1a8c15e340 2023-06-09T04:37:46.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a8affd700 1 -- 172.21.15.149:0/2678107095 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810039601 0 0) 0x7f1a8c0cda20 con 0x7f1a8c0b60a0 2023-06-09T04:37:46.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a90dca700 1 --2- 172.21.15.149:0/2678107095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c15e340 0x7f1a8c0cfb00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0cbd90 tx=0x7f1a8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f758c845ee298616 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:46.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a8affd700 1 -- 172.21.15.149:0/2678107095 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400e070 con 0x7f1a8c15e340 2023-06-09T04:37:46.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a8affd700 1 -- 172.21.15.149:0/2678107095 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8400bbd0 con 0x7f1a8c15e340 2023-06-09T04:37:46.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.838+0000 7f1a8affd700 1 -- 172.21.15.149:0/2678107095 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84012430 con 0x7f1a8c15e340 2023-06-09T04:37:46.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 -- 172.21.15.149:0/2678107095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c15e340 msgr2=0x7f1a8c0cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:46.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 --2- 172.21.15.149:0/2678107095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c15e340 0x7f1a8c0cfb00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c0cbd90 tx=0x7f1a8400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:46.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 -- 172.21.15.149:0/2678107095 shutdown_connections 2023-06-09T04:37:46.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 --2- 172.21.15.149:0/2678107095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c15e340 0x7f1a8c0cfb00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 --2- 172.21.15.149:0/2678107095 >> v2:172.21.15.184:3300/0 conn(0x7f1a8c0cf5b0 0x7f1a8c0cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 -- 172.21.15.149:0/2678107095 >> 172.21.15.149:0/2678107095 conn(0x7f1a8c069db0 msgr2=0x7f1a8c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:46.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 -- 172.21.15.149:0/2678107095 shutdown_connections 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.839+0000 7f1a9282d700 1 -- 172.21.15.149:0/2678107095 wait complete. 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.840+0000 7f1a9282d700 1 Processor -- start 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a9282d700 1 -- start start 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a9282d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a8c0b60a0 0x7f1a8c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a9282d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c0cf5b0 0x7f1a8c06a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a9282d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a8c15e340 0x7f1a8c1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a9282d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0c7b10 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a9282d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c1efa00 con 0x7f1a8c15e340 2023-06-09T04:37:46.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a9282d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c1efce0 con 0x7f1a8c0b60a0 2023-06-09T04:37:46.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a8b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c0cf5b0 0x7f1a8c06a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:46.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a8b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c0cf5b0 0x7f1a8c06a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37524/0 (socket says 172.21.15.149:37524) 2023-06-09T04:37:46.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.841+0000 7f1a8b7fe700 1 -- 172.21.15.149:0/265135846 learned_addr learned my addr 172.21.15.149:0/265135846 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:46.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8bfff700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a8c0b60a0 0x7f1a8c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:46.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a90dca700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a8c15e340 0x7f1a8c1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:46.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8b7fe700 1 -- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a8c0b60a0 msgr2=0x7f1a8c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8b7fe700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a8c0b60a0 0x7f1a8c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8b7fe700 1 -- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a8c15e340 msgr2=0x7f1a8c1f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8b7fe700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a8c15e340 0x7f1a8c1f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8b7fe700 1 -- 172.21.15.149:0/265135846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a84009a70 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8bfff700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a8c0b60a0 0x7f1a8c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a8b7fe700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c0cf5b0 0x7f1a8c06a3f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d800 tx=0x7f1a7400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a88ff9700 1 -- 172.21.15.149:0/265135846 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740125f0 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a88ff9700 1 -- 172.21.15.149:0/265135846 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74012750 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c1effc0 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a88ff9700 1 -- 172.21.15.149:0/265135846 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74012b00 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.842+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c0c84d0 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.843+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c073fa0 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.844+0000 7f1a88ff9700 1 -- 172.21.15.149:0/265135846 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a74012c60 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.844+0000 7f1a88ff9700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1a6c06ace0 0x7f1a6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:46.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.844+0000 7f1a88ff9700 1 -- 172.21.15.149:0/265135846 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a74089ad0 con 0x7f1a8c0cf5b0 2023-06-09T04:37:46.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.844+0000 7f1a8bfff700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1a6c06ace0 0x7f1a6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:46.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.844+0000 7f1a8bfff700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1a6c06ace0 0x7f1a6c06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c007fd0 tx=0x7f1a7c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:46.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:46.848+0000 7f1a88ff9700 1 -- 172.21.15.149:0/265135846 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a740548e0 con 0x7f1a8c0cf5b0 2023-06-09T04:37:47.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.036+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1a8c0b2790 con 0x7f1a8c0cf5b0 2023-06-09T04:37:47.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.042+0000 7f1a88ff9700 1 -- 172.21.15.149:0/265135846 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1a74057f00 con 0x7f1a8c0cf5b0 2023-06-09T04:37:47.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1a6c06ace0 msgr2=0x7f1a6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1a6c06ace0 0x7f1a6c06d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c007fd0 tx=0x7f1a7c009040 comp rx=0 tx=0).stop 2023-06-09T04:37:47.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c0cf5b0 msgr2=0x7f1a8c06a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c0cf5b0 0x7f1a8c06a3f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d800 tx=0x7f1a7400dbc0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 shutdown_connections 2023-06-09T04:37:47.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1a6c06ace0 0x7f1a6c06d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1a8c0b60a0 0x7f1a8c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a8c15e340 0x7f1a8c1f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 --2- 172.21.15.149:0/265135846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a8c0cf5b0 0x7f1a8c06a3f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.044+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 >> 172.21.15.149:0/265135846 conn(0x7f1a8c069db0 msgr2=0x7f1a8c0b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.045+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 shutdown_connections 2023-06-09T04:37:47.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.045+0000 7f1a9282d700 1 -- 172.21.15.149:0/265135846 wait complete. 2023-06-09T04:37:47.058 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-09T04:37:47.058 DEBUG:teuthology.orchestra.run.smithi149:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:37:47.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:37:47.142 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-09T04:37:47.143 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:47.143 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:47.160 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:47.160 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:47.216 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:47.216 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:47.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:47.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.431+0000 7f05606f9700 1 Processor -- start 2023-06-09T04:37:47.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.431+0000 7f05606f9700 1 -- start start 2023-06-09T04:37:47.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.432+0000 7f05606f9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f055806b4b0 0x7f0558145710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.432+0000 7f05606f9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05580d16e0 con 0x7f05580d0e70 2023-06-09T04:37:47.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.432+0000 7f05606f9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05580cd050 con 0x7f0558145cd0 2023-06-09T04:37:47.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.432+0000 7f05606f9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05580cc1d0 con 0x7f055806b4b0 2023-06-09T04:37:47.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.432+0000 7f055ec96700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f05580d0e70 0x7f05580caf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33164/0 (socket says 172.21.15.149:33164) 2023-06-09T04:37:47.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.432+0000 7f055ec96700 1 -- 172.21.15.149:0/460728486 learned_addr learned my addr 172.21.15.149:0/460728486 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:47.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055e495700 1 --2- 172.21.15.149:0/460728486 >> v2:172.21.15.184:3300/0 conn(0x7f055806b4b0 0x7f0558145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054302885 0 0) 0x7f0550001490 con 0x7f05580d0e70 2023-06-09T04:37:47.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05440035b0 con 0x7f05580d0e70 2023-06-09T04:37:47.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3021046402 0 0) 0x7f05440035b0 con 0x7f05580d0e70 2023-06-09T04:37:47.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 >> v2:172.21.15.184:3300/0 conn(0x7f055806b4b0 msgr2=0x7f0558145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 --2- 172.21.15.149:0/460728486 >> v2:172.21.15.184:3300/0 conn(0x7f055806b4b0 0x7f0558145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 >> v1:172.21.15.184:6789/0 conn(0x7f0558145cd0 legacy=0x7f05580d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05580cd2a0 con 0x7f05580d0e70 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f0550001b80 con 0x7f05580d0e70 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 >> v1:172.21.15.149:6789/0 conn(0x7f05580d0e70 legacy=0x7f05580caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0544003a00 0x7f0544003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0544004850 0x7f0544004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544005200 0x7f054400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05580cc1d0 con 0x7f0544004850 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054400c080 con 0x7f0544003a00 2023-06-09T04:37:47.439 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054400c240 con 0x7f0544005200 2023-06-09T04:37:47.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055dc94700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0544004850 0x7f0544004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055e495700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0544003a00 0x7f0544003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055ec96700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544005200 0x7f054400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055dc94700 1 -- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544005200 msgr2=0x7f054400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055dc94700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544005200 0x7f054400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055dc94700 1 -- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0544003a00 msgr2=0x7f0544003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055dc94700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0544003a00 0x7f0544003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055dc94700 1 -- 172.21.15.149:0/460728486 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05440035b0 con 0x7f0544004850 2023-06-09T04:37:47.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.433+0000 7f055ec96700 1 -- 172.21.15.149:0/460728486 reap_dead start 2023-06-09T04:37:47.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f055dc94700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0544004850 0x7f0544004cc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f05540017c0 tx=0x7f0544005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71298db6f9b4aed server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540052d0 con 0x7f0544004850 2023-06-09T04:37:47.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554005430 con 0x7f0544004850 2023-06-09T04:37:47.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f055d493700 1 -- 172.21.15.149:0/460728486 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540038c0 con 0x7f0544004850 2023-06-09T04:37:47.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f05606f9700 1 -- 172.21.15.149:0/460728486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0544004850 msgr2=0x7f0544004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f05606f9700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0544004850 0x7f0544004cc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f05540017c0 tx=0x7f0544005880 comp rx=0 tx=0).stop 2023-06-09T04:37:47.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f05606f9700 1 -- 172.21.15.149:0/460728486 shutdown_connections 2023-06-09T04:37:47.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f05606f9700 1 --2- 172.21.15.149:0/460728486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0544004850 0x7f0544004cc0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f05606f9700 1 -- 172.21.15.149:0/460728486 >> 172.21.15.149:0/460728486 conn(0x7f055806a6d0 msgr2=0x7f0558099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f05606f9700 1 -- 172.21.15.149:0/460728486 shutdown_connections 2023-06-09T04:37:47.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.434+0000 7f05606f9700 1 -- 172.21.15.149:0/460728486 wait complete. 2023-06-09T04:37:47.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 Processor -- start 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 -- start start 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544004850 0x7f055815f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05580c5c50 0x7f05580c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f055815ca60 0x7f055815cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05581f5490 con 0x7f05580c5c50 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05580c6600 con 0x7f055815ca60 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f05606f9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055815d7e0 con 0x7f0544004850 2023-06-09T04:37:47.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f055dc94700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05580c5c50 0x7f05580c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f055dc94700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05580c5c50 0x7f05580c60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37542/0 (socket says 172.21.15.149:37542) 2023-06-09T04:37:47.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.436+0000 7f055dc94700 1 -- 172.21.15.149:0/2857083647 learned_addr learned my addr 172.21.15.149:0/2857083647 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:47.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055e495700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544004850 0x7f055815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055dc94700 1 -- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544004850 msgr2=0x7f055815f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055ec96700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f055815ca60 0x7f055815cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055dc94700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544004850 0x7f055815f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055dc94700 1 -- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f055815ca60 msgr2=0x7f055815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055dc94700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f055815ca60 0x7f055815cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055dc94700 1 -- 172.21.15.149:0/2857083647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055815dac0 con 0x7f05580c5c50 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055e495700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544004850 0x7f055815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f055dc94700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05580c5c50 0x7f05580c60c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f054400c050 tx=0x7f0554001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f054effd700 1 -- 172.21.15.149:0/2857083647 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554001290 con 0x7f05580c5c50 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f054effd700 1 -- 172.21.15.149:0/2857083647 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554007040 con 0x7f05580c5c50 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055815dda0 con 0x7f05580c5c50 2023-06-09T04:37:47.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f054effd700 1 -- 172.21.15.149:0/2857083647 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05540073d0 con 0x7f05580c5c50 2023-06-09T04:37:47.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.437+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055815e360 con 0x7f05580c5c50 2023-06-09T04:37:47.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.438+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0558073fa0 con 0x7f05580c5c50 2023-06-09T04:37:47.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.438+0000 7f054effd700 1 -- 172.21.15.149:0/2857083647 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0554007530 con 0x7f05580c5c50 2023-06-09T04:37:47.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.439+0000 7f054effd700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f053c06ace0 0x7f053c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.439+0000 7f055e495700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f053c06ace0 0x7f053c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.439+0000 7f054effd700 1 -- 172.21.15.149:0/2857083647 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f055408a120 con 0x7f05580c5c50 2023-06-09T04:37:47.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.439+0000 7f055e495700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f053c06ace0 0x7f053c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0558068af0 tx=0x7f0548008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.443+0000 7f054effd700 1 -- 172.21.15.149:0/2857083647 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0554054e90 con 0x7f05580c5c50 2023-06-09T04:37:47.632 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.631+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f055806bdf0 con 0x7f05580c5c50 2023-06-09T04:37:47.633 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.632+0000 7f054effd700 1 -- 172.21.15.149:0/2857083647 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f05540584b0 con 0x7f05580c5c50 2023-06-09T04:37:47.634 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:47.634 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f053c06ace0 msgr2=0x7f053c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f053c06ace0 0x7f053c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0558068af0 tx=0x7f0548008040 comp rx=0 tx=0).stop 2023-06-09T04:37:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05580c5c50 msgr2=0x7f05580c60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05580c5c50 0x7f05580c60c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f054400c050 tx=0x7f0554001120 comp rx=0 tx=0).stop 2023-06-09T04:37:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 shutdown_connections 2023-06-09T04:37:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f053c06ace0 0x7f053c06d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.636 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f0544004850 0x7f055815f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f055815ca60 0x7f055815cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 --2- 172.21.15.149:0/2857083647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05580c5c50 0x7f05580c60c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 >> 172.21.15.149:0/2857083647 conn(0x7f055806a6d0 msgr2=0x7f05580cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 shutdown_connections 2023-06-09T04:37:47.637 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.634+0000 7f05606f9700 1 -- 172.21.15.149:0/2857083647 wait complete. 2023-06-09T04:37:47.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:47.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:47.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.772+0000 7f893d191700 1 Processor -- start 2023-06-09T04:37:47.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.772+0000 7f893d191700 1 -- start start 2023-06-09T04:37:47.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.773+0000 7f893d191700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f89380716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.773+0000 7f893d191700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f89380cd930 0x7f89380ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.773+0000 7f893d191700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893806f480 con 0x7f89380b1dc0 2023-06-09T04:37:47.775 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.773+0000 7f893d191700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89380b10d0 con 0x7f89380cd930 2023-06-09T04:37:47.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.773+0000 7f893d191700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893806f760 con 0x7f8938159380 2023-06-09T04:37:47.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.773+0000 7f893759e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f89380cd930 0x7f89380ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f893759e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f89380cd930 0x7f89380ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37552/0 (socket says 172.21.15.149:37552) 2023-06-09T04:37:47.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f893759e700 1 -- 172.21.15.149:0/1800065712 learned_addr learned my addr 172.21.15.149:0/1800065712 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:47.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f893759e700 1 -- 172.21.15.149:0/1800065712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 msgr2=0x7f89380716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f893759e700 1 --2- 172.21.15.149:0/1800065712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f89380716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.776 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f893759e700 1 -- 172.21.15.149:0/1800065712 >> v1:172.21.15.184:6789/0 conn(0x7f89380b1dc0 legacy=0x7f89380cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:47.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f893759e700 1 -- 172.21.15.149:0/1800065712 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380b12e0 con 0x7f89380cd930 2023-06-09T04:37:47.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f893759e700 1 --2- 172.21.15.149:0/1800065712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380cd930 0x7f89380ca580 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f893000d150 tx=0x7f893000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787b996e933fa945 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f8935d9b700 1 -- 172.21.15.149:0/1800065712 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930010070 con 0x7f89380cd930 2023-06-09T04:37:47.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f8935d9b700 1 -- 172.21.15.149:0/1800065712 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893000dd80 con 0x7f89380cd930 2023-06-09T04:37:47.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.774+0000 7f8935d9b700 1 -- 172.21.15.149:0/1800065712 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893000b310 con 0x7f89380cd930 2023-06-09T04:37:47.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 -- 172.21.15.149:0/1800065712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380cd930 msgr2=0x7f89380ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 --2- 172.21.15.149:0/1800065712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380cd930 0x7f89380ca580 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f893000d150 tx=0x7f893000d460 comp rx=0 tx=0).stop 2023-06-09T04:37:47.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 -- 172.21.15.149:0/1800065712 shutdown_connections 2023-06-09T04:37:47.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 --2- 172.21.15.149:0/1800065712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380cd930 0x7f89380ca580 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.778 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 --2- 172.21.15.149:0/1800065712 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f89380716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 -- 172.21.15.149:0/1800065712 >> 172.21.15.149:0/1800065712 conn(0x7f893806aec0 msgr2=0x7f893806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 -- 172.21.15.149:0/1800065712 shutdown_connections 2023-06-09T04:37:47.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.775+0000 7f893d191700 1 -- 172.21.15.149:0/1800065712 wait complete. 2023-06-09T04:37:47.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.776+0000 7f893d191700 1 Processor -- start 2023-06-09T04:37:47.779 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.777+0000 7f893d191700 1 -- start start 2023-06-09T04:37:47.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.777+0000 7f893d191700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380b1dc0 0x7f893815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.777+0000 7f893d191700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89380cd930 0x7f893815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.777+0000 7f893d191700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f893815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.777+0000 7f893d191700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89380c6140 con 0x7f89380b1dc0 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.777+0000 7f893d191700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89380c5e60 con 0x7f89380cd930 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.777+0000 7f893d191700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893815b6f0 con 0x7f8938159380 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380b1dc0 0x7f893815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380b1dc0 0x7f893815c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37556/0 (socket says 172.21.15.149:37556) 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 -- 172.21.15.149:0/2144809258 learned_addr learned my addr 172.21.15.149:0/2144809258 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f893759e700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f893815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f893659c700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89380cd930 0x7f893815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 -- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 msgr2=0x7f893815ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f893815ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 -- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89380cd930 msgr2=0x7f893815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89380cd930 0x7f893815a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 -- 172.21.15.149:0/2144809258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893000bd40 con 0x7f89380b1dc0 2023-06-09T04:37:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f893759e700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f893815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f8936d9d700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380b1dc0 0x7f893815c4e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f892c00b530 tx=0x7f892c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f891f7fe700 1 -- 172.21.15.149:0/2144809258 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011830 con 0x7f89380b1dc0 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f891f7fe700 1 -- 172.21.15.149:0/2144809258 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c0119b0 con 0x7f89380b1dc0 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893815b9d0 con 0x7f89380b1dc0 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f891f7fe700 1 -- 172.21.15.149:0/2144809258 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011d60 con 0x7f89380b1dc0 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.778+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893815b3a0 con 0x7f89380b1dc0 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.779+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89380737c0 con 0x7f89380b1dc0 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.780+0000 7f891f7fe700 1 -- 172.21.15.149:0/2144809258 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f892c01a400 con 0x7f89380b1dc0 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.780+0000 7f891f7fe700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f892406ace0 0x7f892406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:47.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.780+0000 7f891f7fe700 1 -- 172.21.15.149:0/2144809258 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f892c089870 con 0x7f89380b1dc0 2023-06-09T04:37:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.780+0000 7f893659c700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f892406ace0 0x7f892406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.780+0000 7f893659c700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f892406ace0 0x7f892406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8938150710 tx=0x7f8928008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:47.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.784+0000 7f891f7fe700 1 -- 172.21.15.149:0/2144809258 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f892c0545f0 con 0x7f89380b1dc0 2023-06-09T04:37:47.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.972+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8938073fa0 con 0x7f89380b1dc0 2023-06-09T04:37:47.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.973+0000 7f891f7fe700 1 -- 172.21.15.149:0/2144809258 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f892c057c10 con 0x7f89380b1dc0 2023-06-09T04:37:47.974 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:47.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f892406ace0 msgr2=0x7f892406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f892406ace0 0x7f892406d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8938150710 tx=0x7f8928008040 comp rx=0 tx=0).stop 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380b1dc0 msgr2=0x7f893815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380b1dc0 0x7f893815c4e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f892c00b530 tx=0x7f892c00b8f0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 shutdown_connections 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f892406ace0 0x7f892406d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8938159380 0x7f893815ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f89380b1dc0 0x7f893815c4e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 --2- 172.21.15.149:0/2144809258 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89380cd930 0x7f893815a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:47.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 >> 172.21.15.149:0/2144809258 conn(0x7f893806aec0 msgr2=0x7f8938154a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:47.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 shutdown_connections 2023-06-09T04:37:47.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:47.975+0000 7f893d191700 1 -- 172.21.15.149:0/2144809258 wait complete. 2023-06-09T04:37:47.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:48.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.110+0000 7fec11df2700 1 Processor -- start 2023-06-09T04:37:48.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.110+0000 7fec11df2700 1 -- start start 2023-06-09T04:37:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec11df2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c15c520 0x7fec0c071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec11df2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fec0c06a4c0 0x7fec0c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec11df2700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c15c8f0 con 0x7fec0c0cee20 2023-06-09T04:37:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec11df2700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c0cd940 con 0x7fec0c06a4c0 2023-06-09T04:37:48.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec11df2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0b20f0 con 0x7fec0c15c520 2023-06-09T04:37:48.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fec0c06a4c0 0x7fec0c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fec0c06a4c0 0x7fec0c0b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37566/0 (socket says 172.21.15.149:37566) 2023-06-09T04:37:48.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0bfff700 1 -- 172.21.15.149:0/2314479664 learned_addr learned my addr 172.21.15.149:0/2314479664 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:48.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0b7fe700 1 --2- 172.21.15.149:0/2314479664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c15c520 0x7fec0c071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0bfff700 1 -- 172.21.15.149:0/2314479664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c15c520 msgr2=0x7fec0c071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0bfff700 1 --2- 172.21.15.149:0/2314479664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c15c520 0x7fec0c071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0bfff700 1 -- 172.21.15.149:0/2314479664 >> v1:172.21.15.184:6789/0 conn(0x7fec0c0cee20 legacy=0x7fec0c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.111+0000 7fec0bfff700 1 -- 172.21.15.149:0/2314479664 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0cd3c0 con 0x7fec0c06a4c0 2023-06-09T04:37:48.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec0bfff700 1 --2- 172.21.15.149:0/2314479664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c06a4c0 0x7fec0c0b24a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec04009e80 tx=0x7fec0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f017f7ebaacef4fc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec0a7fc700 1 -- 172.21.15.149:0/2314479664 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400e070 con 0x7fec0c06a4c0 2023-06-09T04:37:48.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec0a7fc700 1 -- 172.21.15.149:0/2314479664 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0400b8d0 con 0x7fec0c06a4c0 2023-06-09T04:37:48.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec0a7fc700 1 -- 172.21.15.149:0/2314479664 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400bc80 con 0x7fec0c06a4c0 2023-06-09T04:37:48.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 -- 172.21.15.149:0/2314479664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c06a4c0 msgr2=0x7fec0c0b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 --2- 172.21.15.149:0/2314479664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c06a4c0 0x7fec0c0b24a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fec04009e80 tx=0x7fec0400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:48.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 -- 172.21.15.149:0/2314479664 shutdown_connections 2023-06-09T04:37:48.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 --2- 172.21.15.149:0/2314479664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c06a4c0 0x7fec0c0b24a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 --2- 172.21.15.149:0/2314479664 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c15c520 0x7fec0c071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 -- 172.21.15.149:0/2314479664 >> 172.21.15.149:0/2314479664 conn(0x7fec0c06aec0 msgr2=0x7fec0c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 -- 172.21.15.149:0/2314479664 shutdown_connections 2023-06-09T04:37:48.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.112+0000 7fec11df2700 1 -- 172.21.15.149:0/2314479664 wait complete. 2023-06-09T04:37:48.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 Processor -- start 2023-06-09T04:37:48.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 -- start start 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c06a4c0 0x7fec0c0c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c0cee20 0x7fec0c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec0c15c520 0x7fec0c0c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0c36c0 con 0x7fec0c0cee20 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0c41e0 con 0x7fec0c15c520 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.114+0000 7fec11df2700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0c3940 con 0x7fec0c06a4c0 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c0cee20 0x7fec0c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c0cee20 0x7fec0c0b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37570/0 (socket says 172.21.15.149:37570) 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 -- 172.21.15.149:0/2021501505 learned_addr learned my addr 172.21.15.149:0/2021501505 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0b7fe700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c06a4c0 0x7fec0c0c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0bfff700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec0c15c520 0x7fec0c0c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 -- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c06a4c0 msgr2=0x7fec0c0c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c06a4c0 0x7fec0c0c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 -- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec0c15c520 msgr2=0x7fec0c0c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec0c15c520 0x7fec0c0c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 -- 172.21.15.149:0/2021501505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04009b30 con 0x7fec0c0cee20 2023-06-09T04:37:48.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0bfff700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec0c15c520 0x7fec0c0c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:48.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec0affd700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c0cee20 0x7fec0c0b33d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c4e0 tx=0x7febfc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7febf3fff700 1 -- 172.21.15.149:0/2021501505 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0052d0 con 0x7fec0c0cee20 2023-06-09T04:37:48.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7febf3fff700 1 -- 172.21.15.149:0/2021501505 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc005430 con 0x7fec0c0cee20 2023-06-09T04:37:48.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c0c3c20 con 0x7fec0c0cee20 2023-06-09T04:37:48.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7febf3fff700 1 -- 172.21.15.149:0/2021501505 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc0038c0 con 0x7fec0c0cee20 2023-06-09T04:37:48.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.115+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c1f1e80 con 0x7fec0c0cee20 2023-06-09T04:37:48.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.116+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c073fa0 con 0x7fec0c0cee20 2023-06-09T04:37:48.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.117+0000 7febf3fff700 1 -- 172.21.15.149:0/2021501505 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febfc003a20 con 0x7fec0c0cee20 2023-06-09T04:37:48.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.117+0000 7febf3fff700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7febf806ace0 0x7febf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.117+0000 7febf3fff700 1 -- 172.21.15.149:0/2021501505 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7febfc088aa0 con 0x7fec0c0cee20 2023-06-09T04:37:48.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.117+0000 7fec0b7fe700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7febf806ace0 0x7febf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.117+0000 7fec0b7fe700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7febf806ace0 0x7febf806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0c6210 tx=0x7fec00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.121+0000 7febf3fff700 1 -- 172.21.15.149:0/2021501505 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7febfc0538b0 con 0x7fec0c0cee20 2023-06-09T04:37:48.305 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.305+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec0c15c8f0 con 0x7fec0c0cee20 2023-06-09T04:37:48.306 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.305+0000 7febf3fff700 1 -- 172.21.15.149:0/2021501505 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec0c15c8f0 con 0x7fec0c0cee20 2023-06-09T04:37:48.306 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:48.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7febf806ace0 msgr2=0x7febf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7febf806ace0 0x7febf806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0c6210 tx=0x7fec00008040 comp rx=0 tx=0).stop 2023-06-09T04:37:48.308 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c0cee20 msgr2=0x7fec0c0b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c0cee20 0x7fec0c0b33d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c4e0 tx=0x7febfc00c8a0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 shutdown_connections 2023-06-09T04:37:48.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7febf806ace0 0x7febf806d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fec0c06a4c0 0x7fec0c0c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fec0c15c520 0x7fec0c0c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 --2- 172.21.15.149:0/2021501505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec0c0cee20 0x7fec0c0b33d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.309 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 >> 172.21.15.149:0/2021501505 conn(0x7fec0c06aec0 msgr2=0x7fec0c159130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 shutdown_connections 2023-06-09T04:37:48.310 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.307+0000 7fec11df2700 1 -- 172.21.15.149:0/2021501505 wait complete. 2023-06-09T04:37:48.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:48.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.443+0000 7f11ae206700 1 Processor -- start 2023-06-09T04:37:48.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.443+0000 7f11ae206700 1 -- start start 2023-06-09T04:37:48.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11ae206700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f11a8071560 0x7f11a8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11ae206700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f11a806a2f0 0x7f11a80b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11ae206700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a815c8f0 con 0x7f11a815c520 2023-06-09T04:37:48.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11ae206700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a80cd940 con 0x7f11a8071560 2023-06-09T04:37:48.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11ae206700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a80b20f0 con 0x7f11a806a2f0 2023-06-09T04:37:48.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f119effd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f11a8071560 0x7f11a8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11a77fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f11a815c520 0x7f11a80cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33208/0 (socket says 172.21.15.149:33208) 2023-06-09T04:37:48.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11a77fe700 1 -- 172.21.15.149:0/1141717728 learned_addr learned my addr 172.21.15.149:0/1141717728 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:48.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11a7fff700 1 --2- 172.21.15.149:0/1141717728 >> v2:172.21.15.184:3300/0 conn(0x7f11a806a2f0 0x7f11a80b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f119effd700 1 -- 172.21.15.149:0/1141717728 >> v2:172.21.15.184:3300/0 conn(0x7f11a806a2f0 msgr2=0x7f11a80b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f119effd700 1 --2- 172.21.15.149:0/1141717728 >> v2:172.21.15.184:3300/0 conn(0x7f11a806a2f0 0x7f11a80b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f119effd700 1 -- 172.21.15.149:0/1141717728 >> v1:172.21.15.149:6789/0 conn(0x7f11a815c520 legacy=0x7f11a80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11a6ffd700 1 -- 172.21.15.149:0/1141717728 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491613431 0 0) 0x7f1198001110 con 0x7f11a815c520 2023-06-09T04:37:48.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f119effd700 1 -- 172.21.15.149:0/1141717728 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a80719b0 con 0x7f11a8071560 2023-06-09T04:37:48.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f11a7fff700 1 --2- 172.21.15.149:0/1141717728 >> v2:172.21.15.184:3300/0 conn(0x7f11a806a2f0 0x7f11a80b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:48.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.444+0000 7f119effd700 1 --2- 172.21.15.149:0/1141717728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8071560 0x7f11a8069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f11a806bd00 tx=0x7f1190009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1baa9bfe509655 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11a6ffd700 1 -- 172.21.15.149:0/1141717728 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190011830 con 0x7f11a8071560 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11a6ffd700 1 -- 172.21.15.149:0/1141717728 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190011990 con 0x7f11a8071560 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11a6ffd700 1 -- 172.21.15.149:0/1141717728 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190011d20 con 0x7f11a8071560 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 -- 172.21.15.149:0/1141717728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8071560 msgr2=0x7f11a8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 --2- 172.21.15.149:0/1141717728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8071560 0x7f11a8069db0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f11a806bd00 tx=0x7f1190009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 -- 172.21.15.149:0/1141717728 shutdown_connections 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 --2- 172.21.15.149:0/1141717728 >> v2:172.21.15.184:3300/0 conn(0x7f11a806a2f0 0x7f11a80b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 --2- 172.21.15.149:0/1141717728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a8071560 0x7f11a8069db0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 -- 172.21.15.149:0/1141717728 >> 172.21.15.149:0/1141717728 conn(0x7f11a806aec0 msgr2=0x7f11a806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 -- 172.21.15.149:0/1141717728 shutdown_connections 2023-06-09T04:37:48.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.445+0000 7f11ae206700 1 -- 172.21.15.149:0/1141717728 wait complete. 2023-06-09T04:37:48.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.446+0000 7f11ae206700 1 Processor -- start 2023-06-09T04:37:48.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11ae206700 1 -- start start 2023-06-09T04:37:48.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11ae206700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11a806a2f0 0x7f11a80b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11ae206700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11a8071560 0x7f11a814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11ae206700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a815c520 0x7f11a80b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11ae206700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a815dae0 con 0x7f11a815c520 2023-06-09T04:37:48.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11ae206700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a80b3590 con 0x7f11a8071560 2023-06-09T04:37:48.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11ae206700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a80b3f00 con 0x7f11a806a2f0 2023-06-09T04:37:48.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a815c520 0x7f11a80b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11a7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a815c520 0x7f11a80b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37586/0 (socket says 172.21.15.149:37586) 2023-06-09T04:37:48.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11a7fff700 1 -- 172.21.15.149:0/4124829494 learned_addr learned my addr 172.21.15.149:0/4124829494 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:48.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.447+0000 7f11a77fe700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11a806a2f0 0x7f11a80b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f119effd700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11a8071560 0x7f11a814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a7fff700 1 -- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11a806a2f0 msgr2=0x7f11a80b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a7fff700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11a806a2f0 0x7f11a80b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a7fff700 1 -- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11a8071560 msgr2=0x7f11a814bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a7fff700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11a8071560 0x7f11a814bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a7fff700 1 -- 172.21.15.149:0/4124829494 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900094a0 con 0x7f11a815c520 2023-06-09T04:37:48.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f119effd700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11a8071560 0x7f11a814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:48.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a7fff700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a815c520 0x7f11a80b3050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f11a000cef0 tx=0x7f11a000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a4ff9700 1 -- 172.21.15.149:0/4124829494 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a000adb0 con 0x7f11a815c520 2023-06-09T04:37:48.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a4ff9700 1 -- 172.21.15.149:0/4124829494 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a0015440 con 0x7f11a815c520 2023-06-09T04:37:48.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11a4ff9700 1 -- 172.21.15.149:0/4124829494 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a00157f0 con 0x7f11a815c520 2023-06-09T04:37:48.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a80b41e0 con 0x7f11a815c520 2023-06-09T04:37:48.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.448+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a80b47a0 con 0x7f11a815c520 2023-06-09T04:37:48.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.449+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a8073fa0 con 0x7f11a815c520 2023-06-09T04:37:48.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.449+0000 7f11a4ff9700 1 -- 172.21.15.149:0/4124829494 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11a000d430 con 0x7f11a815c520 2023-06-09T04:37:48.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.450+0000 7f11a4ff9700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f118806ace0 0x7f118806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.450+0000 7f11a77fe700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f118806ace0 0x7f118806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.450+0000 7f11a4ff9700 1 -- 172.21.15.149:0/4124829494 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11a0089c90 con 0x7f11a815c520 2023-06-09T04:37:48.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.450+0000 7f11a77fe700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f118806ace0 0x7f118806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1198000f60 tx=0x7f1198007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.454+0000 7f11a4ff9700 1 -- 172.21.15.149:0/4124829494 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f11a0054aa0 con 0x7f11a815c520 2023-06-09T04:37:48.641 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.640+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11a815dc20 con 0x7f11a815c520 2023-06-09T04:37:48.642 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.640+0000 7f11a4ff9700 1 -- 172.21.15.149:0/4124829494 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f11a001a020 con 0x7f11a815c520 2023-06-09T04:37:48.642 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:48.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f118806ace0 msgr2=0x7f118806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f118806ace0 0x7f118806d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1198000f60 tx=0x7f1198007e70 comp rx=0 tx=0).stop 2023-06-09T04:37:48.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a815c520 msgr2=0x7f11a80b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.644 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a815c520 0x7f11a80b3050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f11a000cef0 tx=0x7f11a000cf20 comp rx=0 tx=0).stop 2023-06-09T04:37:48.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 shutdown_connections 2023-06-09T04:37:48.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f118806ace0 0x7f118806d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f11a806a2f0 0x7f11a80b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f11a815c520 0x7f11a80b3050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 --2- 172.21.15.149:0/4124829494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11a8071560 0x7f11a814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 >> 172.21.15.149:0/4124829494 conn(0x7f11a806aec0 msgr2=0x7f11a81607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 shutdown_connections 2023-06-09T04:37:48.646 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.643+0000 7f11ae206700 1 -- 172.21.15.149:0/4124829494 wait complete. 2023-06-09T04:37:48.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:48.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.780+0000 7f320bcdf700 1 Processor -- start 2023-06-09T04:37:48.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.780+0000 7f320bcdf700 1 -- start start 2023-06-09T04:37:48.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320bcdf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406b0a0 0x7f320415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320bcdf700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f320406d2c0 0x7f320406d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320bcdf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f320415c5d0 con 0x7f32040ae2e0 2023-06-09T04:37:48.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320bcdf700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32040cdd70 con 0x7f320406d2c0 2023-06-09T04:37:48.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320bcdf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320406dc40 con 0x7f320406b0a0 2023-06-09T04:37:48.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320a27c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f320406d2c0 0x7f320406d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320a27c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f320406d2c0 0x7f320406d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37594/0 (socket says 172.21.15.149:37594) 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320a27c700 1 -- 172.21.15.149:0/1549530740 learned_addr learned my addr 172.21.15.149:0/1549530740 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f3209a7b700 1 --2- 172.21.15.149:0/1549530740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406b0a0 0x7f320415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320a27c700 1 -- 172.21.15.149:0/1549530740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406b0a0 msgr2=0x7f320415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320a27c700 1 --2- 172.21.15.149:0/1549530740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406b0a0 0x7f320415fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320a27c700 1 -- 172.21.15.149:0/1549530740 >> v1:172.21.15.184:6789/0 conn(0x7f32040ae2e0 legacy=0x7f3204069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.781+0000 7f320a27c700 1 -- 172.21.15.149:0/1549530740 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320406a4c0 con 0x7f320406d2c0 2023-06-09T04:37:48.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320a27c700 1 --2- 172.21.15.149:0/1549530740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f320406d2c0 0x7f320406d700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009e50 tx=0x7f31fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a40e8f14e1b6f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f3208a79700 1 -- 172.21.15.149:0/1549530740 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00e070 con 0x7f320406d2c0 2023-06-09T04:37:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f3208a79700 1 -- 172.21.15.149:0/1549530740 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc00b9c0 con 0x7f320406d2c0 2023-06-09T04:37:48.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f3208a79700 1 -- 172.21.15.149:0/1549530740 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc00bd70 con 0x7f320406d2c0 2023-06-09T04:37:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 -- 172.21.15.149:0/1549530740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f320406d2c0 msgr2=0x7f320406d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 --2- 172.21.15.149:0/1549530740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f320406d2c0 0x7f320406d700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009e50 tx=0x7f31fc00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 -- 172.21.15.149:0/1549530740 shutdown_connections 2023-06-09T04:37:48.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 --2- 172.21.15.149:0/1549530740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f320406d2c0 0x7f320406d700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 --2- 172.21.15.149:0/1549530740 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406b0a0 0x7f320415fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 -- 172.21.15.149:0/1549530740 >> 172.21.15.149:0/1549530740 conn(0x7f32040cee30 msgr2=0x7f32040cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 -- 172.21.15.149:0/1549530740 shutdown_connections 2023-06-09T04:37:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.782+0000 7f320bcdf700 1 -- 172.21.15.149:0/1549530740 wait complete. 2023-06-09T04:37:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 Processor -- start 2023-06-09T04:37:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 -- start start 2023-06-09T04:37:48.788 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320406b0a0 0x7f32040c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406d2c0 0x7f320415d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32040ae2e0 0x7f320409ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040af200 con 0x7f32040ae2e0 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320415dd80 con 0x7f320406b0a0 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320bcdf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32040ae860 con 0x7f320406d2c0 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320a27c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32040ae2e0 0x7f320409ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320a27c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32040ae2e0 0x7f320409ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37600/0 (socket says 172.21.15.149:37600) 2023-06-09T04:37:48.789 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.784+0000 7f320a27c700 1 -- 172.21.15.149:0/3682351274 learned_addr learned my addr 172.21.15.149:0/3682351274 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f3209a7b700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320406b0a0 0x7f32040c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320927a700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406d2c0 0x7f320415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320a27c700 1 -- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406d2c0 msgr2=0x7f320415d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320a27c700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406d2c0 0x7f320415d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320a27c700 1 -- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320406b0a0 msgr2=0x7f32040c1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320a27c700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320406b0a0 0x7f32040c1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320a27c700 1 -- 172.21.15.149:0/3682351274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc009b30 con 0x7f32040ae2e0 2023-06-09T04:37:48.790 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f3209a7b700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320406b0a0 0x7f32040c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320a27c700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32040ae2e0 0x7f320409ec40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32040705f0 tx=0x7f31fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f31fa7fc700 1 -- 172.21.15.149:0/3682351274 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0048b0 con 0x7f32040ae2e0 2023-06-09T04:37:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f31fa7fc700 1 -- 172.21.15.149:0/3682351274 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc0099b0 con 0x7f32040ae2e0 2023-06-09T04:37:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040aeb40 con 0x7f32040ae2e0 2023-06-09T04:37:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f31fa7fc700 1 -- 172.21.15.149:0/3682351274 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc01c680 con 0x7f32040ae2e0 2023-06-09T04:37:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.785+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040c2060 con 0x7f32040ae2e0 2023-06-09T04:37:48.791 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.786+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32040af340 con 0x7f32040ae2e0 2023-06-09T04:37:48.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.786+0000 7f31fa7fc700 1 -- 172.21.15.149:0/3682351274 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31fc01c7e0 con 0x7f32040ae2e0 2023-06-09T04:37:48.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.787+0000 7f31fa7fc700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f31e806ace0 0x7f31e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:48.792 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.787+0000 7f31fa7fc700 1 -- 172.21.15.149:0/3682351274 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f31fc08b3e0 con 0x7f32040ae2e0 2023-06-09T04:37:48.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.787+0000 7f3209a7b700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f31e806ace0 0x7f31e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:48.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.787+0000 7f3209a7b700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f31e806ace0 0x7f31e806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f31f4007a50 tx=0x7f31f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:48.793 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.791+0000 7f31fa7fc700 1 -- 172.21.15.149:0/3682351274 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32040af340 con 0x7f32040ae2e0 2023-06-09T04:37:48.977 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.976+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32040af340 con 0x7f32040ae2e0 2023-06-09T04:37:48.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.977+0000 7f31fa7fc700 1 -- 172.21.15.149:0/3682351274 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32040af340 con 0x7f32040ae2e0 2023-06-09T04:37:48.978 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:48.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f31e806ace0 msgr2=0x7f31e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f31e806ace0 0x7f31e806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f31f4007a50 tx=0x7f31f4008040 comp rx=0 tx=0).stop 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32040ae2e0 msgr2=0x7f320409ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32040ae2e0 0x7f320409ec40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32040705f0 tx=0x7f31fc004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 shutdown_connections 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f31e806ace0 0x7f31e806d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32040ae2e0 0x7f320409ec40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f320406b0a0 0x7f32040c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 --2- 172.21.15.149:0/3682351274 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f320406d2c0 0x7f320415d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 >> 172.21.15.149:0/3682351274 conn(0x7f32040cee30 msgr2=0x7f3204069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 shutdown_connections 2023-06-09T04:37:48.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:48.979+0000 7f320bcdf700 1 -- 172.21.15.149:0/3682351274 wait complete. 2023-06-09T04:37:48.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:49.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.118+0000 7f05dea41700 1 Processor -- start 2023-06-09T04:37:49.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.118+0000 7f05dea41700 1 -- start start 2023-06-09T04:37:49.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.118+0000 7f05dea41700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05d80cd930 0x7f05d80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.118+0000 7f05dea41700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f05d80b1dc0 0x7f05d80ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.118+0000 7f05dea41700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d806f480 con 0x7f05d8159380 2023-06-09T04:37:49.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.118+0000 7f05dea41700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d80b10d0 con 0x7f05d80cd930 2023-06-09T04:37:49.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.118+0000 7f05dea41700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d806f760 con 0x7f05d80b1dc0 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d77fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f05d80cd930 0x7f05d80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d7fff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f05d8159380 0x7f05d80cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33236/0 (socket says 172.21.15.149:33236) 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d7fff700 1 -- 172.21.15.149:0/3319587930 learned_addr learned my addr 172.21.15.149:0/3319587930 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d77fe700 1 -- 172.21.15.149:0/3319587930 >> v2:172.21.15.184:3300/0 conn(0x7f05d80b1dc0 msgr2=0x7f05d80ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05dcfde700 1 --2- 172.21.15.149:0/3319587930 >> v2:172.21.15.184:3300/0 conn(0x7f05d80b1dc0 0x7f05d80ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d77fe700 1 --2- 172.21.15.149:0/3319587930 >> v2:172.21.15.184:3300/0 conn(0x7f05d80b1dc0 0x7f05d80ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d77fe700 1 -- 172.21.15.149:0/3319587930 >> v1:172.21.15.149:6789/0 conn(0x7f05d8159380 legacy=0x7f05d80cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d6ffd700 1 -- 172.21.15.149:0/3319587930 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042194090 0 0) 0x7f05d806f480 con 0x7f05d8159380 2023-06-09T04:37:49.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d77fe700 1 -- 172.21.15.149:0/3319587930 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d80b12e0 con 0x7f05d80cd930 2023-06-09T04:37:49.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d77fe700 1 --2- 172.21.15.149:0/3319587930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80716c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f05d815cc20 tx=0x7f05cc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c011a3108d35cf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d6ffd700 1 -- 172.21.15.149:0/3319587930 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc011830 con 0x7f05d80cd930 2023-06-09T04:37:49.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d6ffd700 1 -- 172.21.15.149:0/3319587930 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc011990 con 0x7f05d80cd930 2023-06-09T04:37:49.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.119+0000 7f05d6ffd700 1 -- 172.21.15.149:0/3319587930 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc011d20 con 0x7f05d80cd930 2023-06-09T04:37:49.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 -- 172.21.15.149:0/3319587930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 msgr2=0x7f05d80716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 --2- 172.21.15.149:0/3319587930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80716c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f05d815cc20 tx=0x7f05cc009b20 comp rx=0 tx=0).stop 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 -- 172.21.15.149:0/3319587930 shutdown_connections 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 --2- 172.21.15.149:0/3319587930 >> v2:172.21.15.184:3300/0 conn(0x7f05d80b1dc0 0x7f05d80ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 --2- 172.21.15.149:0/3319587930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80716c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 -- 172.21.15.149:0/3319587930 >> 172.21.15.149:0/3319587930 conn(0x7f05d806aec0 msgr2=0x7f05d806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 -- 172.21.15.149:0/3319587930 shutdown_connections 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.120+0000 7f05dea41700 1 -- 172.21.15.149:0/3319587930 wait complete. 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.121+0000 7f05dea41700 1 Processor -- start 2023-06-09T04:37:49.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.121+0000 7f05dea41700 1 -- start start 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dea41700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05d80b1dc0 0x7f05d80c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dea41700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dea41700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05d8159380 0x7f05d80b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dea41700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80c7f00 con 0x7f05d80cd930 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dea41700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80c4e20 con 0x7f05d80b1dc0 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dea41700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80c5100 con 0x7f05d8159380 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.126 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37612/0 (socket says 172.21.15.149:37612) 2023-06-09T04:37:49.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 -- 172.21.15.149:0/2342335284 learned_addr learned my addr 172.21.15.149:0/2342335284 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:49.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d7fff700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05d80b1dc0 0x7f05d80c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dcfde700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05d8159380 0x7f05d80b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 -- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05d8159380 msgr2=0x7f05d80b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05d8159380 0x7f05d80b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 -- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05d80b1dc0 msgr2=0x7f05d80c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05d80b1dc0 0x7f05d80c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 -- 172.21.15.149:0/2342335284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0094a0 con 0x7f05d80cd930 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05dcfde700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05d8159380 0x7f05d80b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.122+0000 7f05d77fe700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80b3f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.123+0000 7f05d4ff9700 1 -- 172.21.15.149:0/2342335284 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0038a0 con 0x7f05d80cd930 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.123+0000 7f05d4ff9700 1 -- 172.21.15.149:0/2342335284 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc01f070 con 0x7f05d80cd930 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.123+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d80c53e0 con 0x7f05d80cd930 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.123+0000 7f05d4ff9700 1 -- 172.21.15.149:0/2342335284 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc003c40 con 0x7f05d80cd930 2023-06-09T04:37:49.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.123+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d80c59a0 con 0x7f05d80cd930 2023-06-09T04:37:49.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.124+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d8073fa0 con 0x7f05d80cd930 2023-06-09T04:37:49.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.124+0000 7f05d4ff9700 1 -- 172.21.15.149:0/2342335284 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05cc026480 con 0x7f05d80cd930 2023-06-09T04:37:49.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.124+0000 7f05d4ff9700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f05c406ace0 0x7f05c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.125+0000 7f05d4ff9700 1 -- 172.21.15.149:0/2342335284 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f05cc021070 con 0x7f05d80cd930 2023-06-09T04:37:49.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.125+0000 7f05d7fff700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f05c406ace0 0x7f05c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.125+0000 7f05d7fff700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f05c406ace0 0x7f05c406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000f60 tx=0x7f05c8007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.129+0000 7f05d4ff9700 1 -- 172.21.15.149:0/2342335284 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f05cc055fb0 con 0x7f05d80cd930 2023-06-09T04:37:49.315 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.314+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f05d80714a0 con 0x7f05d80cd930 2023-06-09T04:37:49.316 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.315+0000 7f05d4ff9700 1 -- 172.21.15.149:0/2342335284 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05cc0595d0 con 0x7f05d80cd930 2023-06-09T04:37:49.316 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:49.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f05c406ace0 msgr2=0x7f05c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f05c406ace0 0x7f05c406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000f60 tx=0x7f05c8007e70 comp rx=0 tx=0).stop 2023-06-09T04:37:49.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 msgr2=0x7f05d80b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80b3f30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc004750 comp rx=0 tx=0).stop 2023-06-09T04:37:49.318 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 shutdown_connections 2023-06-09T04:37:49.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f05c406ace0 0x7f05c406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f05d8159380 0x7f05d80b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05d80b1dc0 0x7f05d80c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 --2- 172.21.15.149:0/2342335284 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f05d80cd930 0x7f05d80b3f30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 >> 172.21.15.149:0/2342335284 conn(0x7f05d806aec0 msgr2=0x7f05d806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 shutdown_connections 2023-06-09T04:37:49.319 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.317+0000 7f05dea41700 1 -- 172.21.15.149:0/2342335284 wait complete. 2023-06-09T04:37:49.330 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:37:49.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.449+0000 7f8f7391c700 1 Processor -- start 2023-06-09T04:37:49.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.450+0000 7f8f7391c700 1 -- start start 2023-06-09T04:37:49.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.450+0000 7f8f7391c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8f6c15c170 0x7f8f6c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.450+0000 7f8f7391c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c0ccf50 0x7f8f6c0cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.450+0000 7f8f7391c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8f6c15fc20 0x7f8f6c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.450+0000 7f8f7391c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c0d06f0 con 0x7f8f6c15fc20 2023-06-09T04:37:49.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.450+0000 7f8f7391c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c15c540 con 0x7f8f6c15c170 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.450+0000 7f8f7391c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0cd900 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8f6c15fc20 0x7f8f6c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f8f6c15fc20 0x7f8f6c1600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37622/0 (socket says 172.21.15.149:37622) 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 -- 172.21.15.149:0/3943077698 learned_addr learned my addr 172.21.15.149:0/3943077698 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f716b8700 1 --2- 172.21.15.149:0/3943077698 >> v2:172.21.15.184:3300/0 conn(0x7f8f6c15c170 0x7f8f6c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f70eb7700 1 --2- 172.21.15.149:0/3943077698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c0ccf50 0x7f8f6c0cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 -- 172.21.15.149:0/3943077698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c0ccf50 msgr2=0x7f8f6c0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 --2- 172.21.15.149:0/3943077698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c0ccf50 0x7f8f6c0cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 -- 172.21.15.149:0/3943077698 >> v2:172.21.15.184:3300/0 conn(0x7f8f6c15c170 msgr2=0x7f8f6c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:49.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 --2- 172.21.15.149:0/3943077698 >> v2:172.21.15.184:3300/0 conn(0x7f8f6c15c170 0x7f8f6c0b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 -- 172.21.15.149:0/3943077698 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0d14e0 con 0x7f8f6c15fc20 2023-06-09T04:37:49.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f71eb9700 1 --2- 172.21.15.149:0/3943077698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c15fc20 0x7f8f6c1600a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0710d0 tx=0x7f8f6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3c429f5d879e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f63fff700 1 -- 172.21.15.149:0/3943077698 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400e070 con 0x7f8f6c15fc20 2023-06-09T04:37:49.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f63fff700 1 -- 172.21.15.149:0/3943077698 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6400b980 con 0x7f8f6c15fc20 2023-06-09T04:37:49.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.451+0000 7f8f63fff700 1 -- 172.21.15.149:0/3943077698 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400bd30 con 0x7f8f6c15fc20 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 -- 172.21.15.149:0/3943077698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c15fc20 msgr2=0x7f8f6c1600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 --2- 172.21.15.149:0/3943077698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c15fc20 0x7f8f6c1600a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0710d0 tx=0x7f8f6400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 -- 172.21.15.149:0/3943077698 shutdown_connections 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 --2- 172.21.15.149:0/3943077698 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c15fc20 0x7f8f6c1600a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 --2- 172.21.15.149:0/3943077698 >> v2:172.21.15.184:3300/0 conn(0x7f8f6c15c170 0x7f8f6c0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 --2- 172.21.15.149:0/3943077698 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c0ccf50 0x7f8f6c0cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 -- 172.21.15.149:0/3943077698 >> 172.21.15.149:0/3943077698 conn(0x7f8f6c069db0 msgr2=0x7f8f6c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.456 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 -- 172.21.15.149:0/3943077698 shutdown_connections 2023-06-09T04:37:49.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.452+0000 7f8f7391c700 1 -- 172.21.15.149:0/3943077698 wait complete. 2023-06-09T04:37:49.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.453+0000 7f8f7391c700 1 Processor -- start 2023-06-09T04:37:49.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.453+0000 7f8f7391c700 1 -- start start 2023-06-09T04:37:49.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f7391c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c0ccf50 0x7f8f6c155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f7391c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f6c15c170 0x7f8f6c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f7391c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c15fc20 0x7f8f6c0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f7391c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c15d890 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f7391c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0b3710 con 0x7f8f6c15c170 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f7391c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c155db0 con 0x7f8f6c15fc20 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c0ccf50 0x7f8f6c155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c0ccf50 0x7f8f6c155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37624/0 (socket says 172.21.15.149:37624) 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 -- 172.21.15.149:0/2513681064 learned_addr learned my addr 172.21.15.149:0/2513681064 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f71eb9700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c15fc20 0x7f8f6c0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f70eb7700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f6c15c170 0x7f8f6c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 -- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c15fc20 msgr2=0x7f8f6c0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c15fc20 0x7f8f6c0c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 -- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f6c15c170 msgr2=0x7f8f6c15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f6c15c170 0x7f8f6c15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 -- 172.21.15.149:0/2513681064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64009b30 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f71eb9700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c15fc20 0x7f8f6c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:49.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f70eb7700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f6c15c170 0x7f8f6c15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:49.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f716b8700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c0ccf50 0x7f8f6c155870 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00e810 tx=0x7f8f5c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f61ffb700 1 -- 172.21.15.149:0/2513681064 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c013610 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f61ffb700 1 -- 172.21.15.149:0/2513681064 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c013770 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c15cff0 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.454+0000 7f8f61ffb700 1 -- 172.21.15.149:0/2513681064 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c013b20 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.455+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c15d5b0 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.456+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c0b3570 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.456+0000 7f8f61ffb700 1 -- 172.21.15.149:0/2513681064 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f5c013c80 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.456+0000 7f8f61ffb700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8f5006ace0 0x7f8f5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:49.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.456+0000 7f8f61ffb700 1 -- 172.21.15.149:0/2513681064 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8f5c0894e0 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.456+0000 7f8f70eb7700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8f5006ace0 0x7f8f5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:49.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.457+0000 7f8f70eb7700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8f5006ace0 0x7f8f5006d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c15bb40 tx=0x7f8f68008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:49.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.461+0000 7f8f61ffb700 1 -- 172.21.15.149:0/2513681064 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8f6c0b3570 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.665+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f6c0b3570 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.665+0000 7f8f61ffb700 1 -- 172.21.15.149:0/2513681064 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f6c0b3570 con 0x7f8f6c0ccf50 2023-06-09T04:37:49.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8f5006ace0 msgr2=0x7f8f5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8f5006ace0 0x7f8f5006d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c15bb40 tx=0x7f8f68008040 comp rx=0 tx=0).stop 2023-06-09T04:37:49.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c0ccf50 msgr2=0x7f8f6c155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:49.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c0ccf50 0x7f8f6c155870 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00e810 tx=0x7f8f5c00ebd0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 shutdown_connections 2023-06-09T04:37:49.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f8f5006ace0 0x7f8f5006d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8f6c15fc20 0x7f8f6c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f6c0ccf50 0x7f8f6c155870 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 --2- 172.21.15.149:0/2513681064 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8f6c15c170 0x7f8f6c15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:49.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 >> 172.21.15.149:0/2513681064 conn(0x7f8f6c069db0 msgr2=0x7f8f6c06c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:49.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 shutdown_connections 2023-06-09T04:37:49.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:49.668+0000 7f8f7391c700 1 -- 172.21.15.149:0/2513681064 wait complete. 2023-06-09T04:37:49.671 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-06-09T04:37:49.681 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T04:37:49.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:49.682 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-09T04:37:49.744 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:37:49.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:49.745 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T04:37:49.762 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:49.762 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:49.782 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:49.783 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:49.842 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:49.842 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:49.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:50.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.020+0000 7f235045b700 1 Processor -- start 2023-06-09T04:37:50.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.020+0000 7f235045b700 1 -- start start 2023-06-09T04:37:50.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f235045b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f234815a0f0 0x7f2348070290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f235045b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f23480cebf0 0x7f23480c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f235045b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234815a4c0 con 0x7f2348071bd0 2023-06-09T04:37:50.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f235045b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2348072420 con 0x7f234815a0f0 2023-06-09T04:37:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f235045b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23480707d0 con 0x7f23480cebf0 2023-06-09T04:37:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f234e1f7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f234815a0f0 0x7f2348070290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f234e1f7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f234815a0f0 0x7f2348070290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37632/0 (socket says 172.21.15.149:37632) 2023-06-09T04:37:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.021+0000 7f234e1f7700 1 -- 172.21.15.149:0/3673369342 learned_addr learned my addr 172.21.15.149:0/3673369342 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234e9f8700 1 --2- 172.21.15.149:0/3673369342 >> v2:172.21.15.184:3300/0 conn(0x7f23480cebf0 0x7f23480c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234e1f7700 1 -- 172.21.15.149:0/3673369342 >> v2:172.21.15.184:3300/0 conn(0x7f23480cebf0 msgr2=0x7f23480c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:50.024 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234e1f7700 1 --2- 172.21.15.149:0/3673369342 >> v2:172.21.15.184:3300/0 conn(0x7f23480cebf0 0x7f23480c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234e1f7700 1 -- 172.21.15.149:0/3673369342 >> v1:172.21.15.149:6789/0 conn(0x7f2348071bd0 legacy=0x7f23480ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234e1f7700 1 -- 172.21.15.149:0/3673369342 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23480c2c50 con 0x7f234815a0f0 2023-06-09T04:37:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234e1f7700 1 --2- 172.21.15.149:0/3673369342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f2348070290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f23480cc040 tx=0x7f2338009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6a424916a63854 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234d1f5700 1 -- 172.21.15.149:0/3673369342 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800b860 con 0x7f234815a0f0 2023-06-09T04:37:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234d1f5700 1 -- 172.21.15.149:0/3673369342 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233800b9c0 con 0x7f234815a0f0 2023-06-09T04:37:50.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.022+0000 7f234d1f5700 1 -- 172.21.15.149:0/3673369342 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800bd50 con 0x7f234815a0f0 2023-06-09T04:37:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 -- 172.21.15.149:0/3673369342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 msgr2=0x7f2348070290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 --2- 172.21.15.149:0/3673369342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f2348070290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f23480cc040 tx=0x7f2338009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 -- 172.21.15.149:0/3673369342 shutdown_connections 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 --2- 172.21.15.149:0/3673369342 >> v2:172.21.15.184:3300/0 conn(0x7f23480cebf0 0x7f23480c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 --2- 172.21.15.149:0/3673369342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f2348070290 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 -- 172.21.15.149:0/3673369342 >> 172.21.15.149:0/3673369342 conn(0x7f234806aa40 msgr2=0x7f23480b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 -- 172.21.15.149:0/3673369342 shutdown_connections 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.023+0000 7f235045b700 1 -- 172.21.15.149:0/3673369342 wait complete. 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.024+0000 7f235045b700 1 Processor -- start 2023-06-09T04:37:50.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.024+0000 7f235045b700 1 -- start start 2023-06-09T04:37:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348071bd0 0x7f23480c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480cebf0 0x7f2348148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f23480c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c7d00 con 0x7f234815a0f0 2023-06-09T04:37:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c66c0 con 0x7f2348071bd0 2023-06-09T04:37:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23480c69a0 con 0x7f23480cebf0 2023-06-09T04:37:50.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f23480c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f23480c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37642/0 (socket says 172.21.15.149:37642) 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 -- 172.21.15.149:0/572010957 learned_addr learned my addr 172.21.15.149:0/572010957 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e1f7700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348071bd0 0x7f23480c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234d9f6700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480cebf0 0x7f2348148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 -- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480cebf0 msgr2=0x7f2348148540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480cebf0 0x7f2348148540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 -- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348071bd0 msgr2=0x7f23480c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348071bd0 0x7f23480c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 -- 172.21.15.149:0/572010957 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2338009550 con 0x7f234815a0f0 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234d9f6700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480cebf0 0x7f2348148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f234e9f8700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f23480c77c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2340007de0 tx=0x7f234000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f233effd700 1 -- 172.21.15.149:0/572010957 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234000ede0 con 0x7f234815a0f0 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f233effd700 1 -- 172.21.15.149:0/572010957 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340014420 con 0x7f234815a0f0 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23480c6c80 con 0x7f234815a0f0 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f233effd700 1 -- 172.21.15.149:0/572010957 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400147d0 con 0x7f234815a0f0 2023-06-09T04:37:50.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.025+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2348148d00 con 0x7f234815a0f0 2023-06-09T04:37:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.026+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2348073fa0 con 0x7f234815a0f0 2023-06-09T04:37:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.027+0000 7f233effd700 1 -- 172.21.15.149:0/572010957 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2340014930 con 0x7f234815a0f0 2023-06-09T04:37:50.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.027+0000 7f233effd700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f232c06ace0 0x7f232c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.027+0000 7f233effd700 1 -- 172.21.15.149:0/572010957 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2340089f80 con 0x7f234815a0f0 2023-06-09T04:37:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.027+0000 7f234e1f7700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f232c06ace0 0x7f232c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.028+0000 7f234e1f7700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f232c06ace0 0x7f232c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2338000c00 tx=0x7f2338008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.033 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.032+0000 7f233effd700 1 -- 172.21.15.149:0/572010957 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23400bc310 con 0x7f234815a0f0 2023-06-09T04:37:50.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.218+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23480cb940 con 0x7f234815a0f0 2023-06-09T04:37:50.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.219+0000 7f233effd700 1 -- 172.21.15.149:0/572010957 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f2340054d00 con 0x7f234815a0f0 2023-06-09T04:37:50.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:50.221 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:50.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f232c06ace0 msgr2=0x7f232c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f232c06ace0 0x7f232c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2338000c00 tx=0x7f2338008030 comp rx=0 tx=0).stop 2023-06-09T04:37:50.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 msgr2=0x7f23480c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f23480c77c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2340007de0 tx=0x7f234000e3c0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.223 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 shutdown_connections 2023-06-09T04:37:50.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f232c06ace0 0x7f232c06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f234815a0f0 0x7f23480c77c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2348071bd0 0x7f23480c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 --2- 172.21.15.149:0/572010957 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f23480cebf0 0x7f2348148540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 >> 172.21.15.149:0/572010957 conn(0x7f234806aa40 msgr2=0x7f23480b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 shutdown_connections 2023-06-09T04:37:50.224 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.222+0000 7f235045b700 1 -- 172.21.15.149:0/572010957 wait complete. 2023-06-09T04:37:50.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:50.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:50.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.358+0000 7faa8f32f700 1 Processor -- start 2023-06-09T04:37:50.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.358+0000 7faa8f32f700 1 -- start start 2023-06-09T04:37:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8f32f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faa880cd300 0x7faa880ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8f32f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa881591d0 0x7faa88071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8f32f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa880716e0 con 0x7faa880cded0 2023-06-09T04:37:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8f32f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8806f4a0 con 0x7faa881591d0 2023-06-09T04:37:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8f32f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa880ce7e0 con 0x7faa880cd300 2023-06-09T04:37:50.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d8cc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa881591d0 0x7faa88071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d8cc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7faa881591d0 0x7faa88071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37650/0 (socket says 172.21.15.149:37650) 2023-06-09T04:37:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d0cb700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faa880cded0 0x7faa8815d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33278/0 (socket says 172.21.15.149:33278) 2023-06-09T04:37:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d8cc700 1 -- 172.21.15.149:0/1296040233 learned_addr learned my addr 172.21.15.149:0/1296040233 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8c8ca700 1 --2- 172.21.15.149:0/1296040233 >> v2:172.21.15.184:3300/0 conn(0x7faa880cd300 0x7faa880ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d8cc700 1 -- 172.21.15.149:0/1296040233 >> v2:172.21.15.184:3300/0 conn(0x7faa880cd300 msgr2=0x7faa880ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d8cc700 1 --2- 172.21.15.149:0/1296040233 >> v2:172.21.15.184:3300/0 conn(0x7faa880cd300 0x7faa880ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d8cc700 1 -- 172.21.15.149:0/1296040233 >> v1:172.21.15.149:6789/0 conn(0x7faa880cded0 legacy=0x7faa8815d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa7ffff700 1 -- 172.21.15.149:0/1296040233 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386038950 0 0) 0x7faa880716e0 con 0x7faa880cded0 2023-06-09T04:37:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.359+0000 7faa8d8cc700 1 -- 172.21.15.149:0/1296040233 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8806f6b0 con 0x7faa881591d0 2023-06-09T04:37:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8d8cc700 1 --2- 172.21.15.149:0/1296040233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa881591d0 0x7faa88071b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa880b2210 tx=0x7faa8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913d79bff114d206 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa7ffff700 1 -- 172.21.15.149:0/1296040233 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000e070 con 0x7faa881591d0 2023-06-09T04:37:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa7ffff700 1 -- 172.21.15.149:0/1296040233 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8000b9c0 con 0x7faa881591d0 2023-06-09T04:37:50.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa7ffff700 1 -- 172.21.15.149:0/1296040233 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000bd70 con 0x7faa881591d0 2023-06-09T04:37:50.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 -- 172.21.15.149:0/1296040233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa881591d0 msgr2=0x7faa88071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 --2- 172.21.15.149:0/1296040233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa881591d0 0x7faa88071b70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa880b2210 tx=0x7faa8000b330 comp rx=0 tx=0).stop 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 -- 172.21.15.149:0/1296040233 shutdown_connections 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 --2- 172.21.15.149:0/1296040233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa881591d0 0x7faa88071b70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 --2- 172.21.15.149:0/1296040233 >> v2:172.21.15.184:3300/0 conn(0x7faa880cd300 0x7faa880ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 -- 172.21.15.149:0/1296040233 >> 172.21.15.149:0/1296040233 conn(0x7faa8806aec0 msgr2=0x7faa8806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 -- 172.21.15.149:0/1296040233 shutdown_connections 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.360+0000 7faa8f32f700 1 -- 172.21.15.149:0/1296040233 wait complete. 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 Processor -- start 2023-06-09T04:37:50.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 -- start start 2023-06-09T04:37:50.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa880cd300 0x7faa881500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa880cded0 0x7faa880c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa881591d0 0x7faa880b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa880c4850 con 0x7faa880cded0 2023-06-09T04:37:50.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa880c3bd0 con 0x7faa880cd300 2023-06-09T04:37:50.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8f32f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa880c3eb0 con 0x7faa881591d0 2023-06-09T04:37:50.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8c8ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa880cded0 0x7faa880c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8c8ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa880cded0 0x7faa880c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37654/0 (socket says 172.21.15.149:37654) 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.362+0000 7faa8c8ca700 1 -- 172.21.15.149:0/2315171227 learned_addr learned my addr 172.21.15.149:0/2315171227 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8d0cb700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa880cd300 0x7faa881500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8d8cc700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa881591d0 0x7faa880b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8c8ca700 1 -- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa881591d0 msgr2=0x7faa880b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8c8ca700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa881591d0 0x7faa880b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8c8ca700 1 -- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa880cd300 msgr2=0x7faa881500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8c8ca700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa880cd300 0x7faa881500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8c8ca700 1 -- 172.21.15.149:0/2315171227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009b30 con 0x7faa880cded0 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8c8ca700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa880cded0 0x7faa880c3180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa8400e810 tx=0x7faa8400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa7dffb700 1 -- 172.21.15.149:0/2315171227 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84013610 con 0x7faa880cded0 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa7dffb700 1 -- 172.21.15.149:0/2315171227 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa84013770 con 0x7faa880cded0 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa880c4190 con 0x7faa880cded0 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa7dffb700 1 -- 172.21.15.149:0/2315171227 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84013b20 con 0x7faa880cded0 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.363+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa880c7fd0 con 0x7faa880cded0 2023-06-09T04:37:50.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.364+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa88073fa0 con 0x7faa880cded0 2023-06-09T04:37:50.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.365+0000 7faa7dffb700 1 -- 172.21.15.149:0/2315171227 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faa84013c80 con 0x7faa880cded0 2023-06-09T04:37:50.370 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.365+0000 7faa7dffb700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faa6c06ace0 0x7faa6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.365+0000 7faa7dffb700 1 -- 172.21.15.149:0/2315171227 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faa84089370 con 0x7faa880cded0 2023-06-09T04:37:50.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.365+0000 7faa8d0cb700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faa6c06ace0 0x7faa6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.365+0000 7faa8d0cb700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faa6c06ace0 0x7faa6c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa78000f60 tx=0x7faa78007c00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.371 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.369+0000 7faa7dffb700 1 -- 172.21.15.149:0/2315171227 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faa84054180 con 0x7faa880cded0 2023-06-09T04:37:50.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.558+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa880b55d0 con 0x7faa880cded0 2023-06-09T04:37:50.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.559+0000 7faa7dffb700 1 -- 172.21.15.149:0/2315171227 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa840577a0 con 0x7faa880cded0 2023-06-09T04:37:50.560 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:50.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faa6c06ace0 msgr2=0x7faa6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faa6c06ace0 0x7faa6c06d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa78000f60 tx=0x7faa78007c00 comp rx=0 tx=0).stop 2023-06-09T04:37:50.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa880cded0 msgr2=0x7faa880c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa880cded0 0x7faa880c3180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa8400e810 tx=0x7faa8400ebd0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 shutdown_connections 2023-06-09T04:37:50.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faa6c06ace0 0x7faa6c06d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faa881591d0 0x7faa880b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa880cd300 0x7faa881500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 --2- 172.21.15.149:0/2315171227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faa880cded0 0x7faa880c3180 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 >> 172.21.15.149:0/2315171227 conn(0x7faa8806aec0 msgr2=0x7faa8806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 shutdown_connections 2023-06-09T04:37:50.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.561+0000 7faa8f32f700 1 -- 172.21.15.149:0/2315171227 wait complete. 2023-06-09T04:37:50.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:50.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.696+0000 7f9b5a764700 1 Processor -- start 2023-06-09T04:37:50.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.697+0000 7f9b5a764700 1 -- start start 2023-06-09T04:37:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.697+0000 7f9b5a764700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b54071770 0x7f9b54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.697+0000 7f9b5a764700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9b5415c6f0 0x7f9b5406a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.697+0000 7f9b5a764700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b54071290 con 0x7f9b5415c320 2023-06-09T04:37:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.697+0000 7f9b5a764700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540b2050 con 0x7f9b54071770 2023-06-09T04:37:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.697+0000 7f9b5a764700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b540cd2c0 con 0x7f9b5415c6f0 2023-06-09T04:37:50.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.697+0000 7f9b537fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b54071770 0x7f9b54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b537fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f9b54071770 0x7f9b54069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37662/0 (socket says 172.21.15.149:37662) 2023-06-09T04:37:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b537fe700 1 -- 172.21.15.149:0/4013439636 learned_addr learned my addr 172.21.15.149:0/4013439636 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b537fe700 1 -- 172.21.15.149:0/4013439636 >> v2:172.21.15.184:3300/0 conn(0x7f9b5415c6f0 msgr2=0x7f9b5406a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b58d01700 1 --2- 172.21.15.149:0/4013439636 >> v2:172.21.15.184:3300/0 conn(0x7f9b5415c6f0 0x7f9b5406a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b537fe700 1 --2- 172.21.15.149:0/4013439636 >> v2:172.21.15.184:3300/0 conn(0x7f9b5415c6f0 0x7f9b5406a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b537fe700 1 -- 172.21.15.149:0/4013439636 >> v1:172.21.15.149:6789/0 conn(0x7f9b5415c320 legacy=0x7f9b540cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b537fe700 1 -- 172.21.15.149:0/4013439636 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b540cd5a0 con 0x7f9b54071770 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b537fe700 1 --2- 172.21.15.149:0/4013439636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b54071770 0x7f9b54069db0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9b540c9c30 tx=0x7f9b44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0194082535335b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b52ffd700 1 -- 172.21.15.149:0/4013439636 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400b870 con 0x7f9b54071770 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b52ffd700 1 -- 172.21.15.149:0/4013439636 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400b9d0 con 0x7f9b54071770 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.698+0000 7f9b52ffd700 1 -- 172.21.15.149:0/4013439636 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400bd60 con 0x7f9b54071770 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 -- 172.21.15.149:0/4013439636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b54071770 msgr2=0x7f9b54069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 --2- 172.21.15.149:0/4013439636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b54071770 0x7f9b54069db0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9b540c9c30 tx=0x7f9b44009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 -- 172.21.15.149:0/4013439636 shutdown_connections 2023-06-09T04:37:50.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 --2- 172.21.15.149:0/4013439636 >> v2:172.21.15.184:3300/0 conn(0x7f9b5415c6f0 0x7f9b5406a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 --2- 172.21.15.149:0/4013439636 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b54071770 0x7f9b54069db0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 -- 172.21.15.149:0/4013439636 >> 172.21.15.149:0/4013439636 conn(0x7f9b5406aec0 msgr2=0x7f9b5406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 -- 172.21.15.149:0/4013439636 shutdown_connections 2023-06-09T04:37:50.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.699+0000 7f9b5a764700 1 -- 172.21.15.149:0/4013439636 wait complete. 2023-06-09T04:37:50.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.700+0000 7f9b5a764700 1 Processor -- start 2023-06-09T04:37:50.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.700+0000 7f9b5a764700 1 -- start start 2023-06-09T04:37:50.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b5a764700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b54071770 0x7f9b54155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b5a764700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b5415c320 0x7f9b54155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b5a764700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b5415c6f0 0x7f9b5415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b5a764700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b54155560 con 0x7f9b5415c320 2023-06-09T04:37:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b5a764700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540b2e60 con 0x7f9b54071770 2023-06-09T04:37:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b5a764700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b540b52b0 con 0x7f9b5415c6f0 2023-06-09T04:37:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b5415c320 0x7f9b54155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b5415c320 0x7f9b54155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37668/0 (socket says 172.21.15.149:37668) 2023-06-09T04:37:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b537fe700 1 -- 172.21.15.149:0/483729930 learned_addr learned my addr 172.21.15.149:0/483729930 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:50.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b537fe700 1 -- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b5415c6f0 msgr2=0x7f9b5415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b58d01700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b5415c6f0 0x7f9b5415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b53fff700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b54071770 0x7f9b54155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b537fe700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b5415c6f0 0x7f9b5415a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b537fe700 1 -- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b54071770 msgr2=0x7f9b54155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.701+0000 7f9b537fe700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b54071770 0x7f9b54155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b537fe700 1 -- 172.21.15.149:0/483729930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44009550 con 0x7f9b5415c320 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b53fff700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b54071770 0x7f9b54155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:50.707 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b537fe700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b5415c320 0x7f9b54155020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b44013000 tx=0x7f9b44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b50ff9700 1 -- 172.21.15.149:0/483729930 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44004310 con 0x7f9b5415c320 2023-06-09T04:37:50.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b50ff9700 1 -- 172.21.15.149:0/483729930 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4401f070 con 0x7f9b5415c320 2023-06-09T04:37:50.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b540b3130 con 0x7f9b5415c320 2023-06-09T04:37:50.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b50ff9700 1 -- 172.21.15.149:0/483729930 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b440036a0 con 0x7f9b5415c320 2023-06-09T04:37:50.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.702+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b540b36f0 con 0x7f9b5415c320 2023-06-09T04:37:50.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.703+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b540b2fa0 con 0x7f9b5415c320 2023-06-09T04:37:50.708 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.703+0000 7f9b50ff9700 1 -- 172.21.15.149:0/483729930 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b44021030 con 0x7f9b5415c320 2023-06-09T04:37:50.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.704+0000 7f9b50ff9700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9b4006ace0 0x7f9b4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:50.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.704+0000 7f9b50ff9700 1 -- 172.21.15.149:0/483729930 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b4408ac70 con 0x7f9b5415c320 2023-06-09T04:37:50.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.704+0000 7f9b53fff700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9b4006ace0 0x7f9b4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:50.709 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.704+0000 7f9b53fff700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9b4006ace0 0x7f9b4006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b540cc7e0 tx=0x7f9b48009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:50.710 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.708+0000 7f9b50ff9700 1 -- 172.21.15.149:0/483729930 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9b44055a80 con 0x7f9b5415c320 2023-06-09T04:37:50.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.899+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b54073fa0 con 0x7f9b5415c320 2023-06-09T04:37:50.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.899+0000 7f9b50ff9700 1 -- 172.21.15.149:0/483729930 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b44015020 con 0x7f9b5415c320 2023-06-09T04:37:50.901 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:50.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9b4006ace0 msgr2=0x7f9b4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9b4006ace0 0x7f9b4006d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b540cc7e0 tx=0x7f9b48009040 comp rx=0 tx=0).stop 2023-06-09T04:37:50.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b5415c320 msgr2=0x7f9b54155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:50.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b5415c320 0x7f9b54155020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b44013000 tx=0x7f9b44004750 comp rx=0 tx=0).stop 2023-06-09T04:37:50.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 shutdown_connections 2023-06-09T04:37:50.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f9b4006ace0 0x7f9b4006d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f9b5415c6f0 0x7f9b5415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b54071770 0x7f9b54155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 --2- 172.21.15.149:0/483729930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9b5415c320 0x7f9b54155020 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:50.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.901+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 >> 172.21.15.149:0/483729930 conn(0x7f9b5406aec0 msgr2=0x7f9b54156f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:50.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.902+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 shutdown_connections 2023-06-09T04:37:50.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:50.902+0000 7f9b5a764700 1 -- 172.21.15.149:0/483729930 wait complete. 2023-06-09T04:37:50.915 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:51.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.036+0000 7f4f2d414700 1 Processor -- start 2023-06-09T04:37:51.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.036+0000 7f4f2d414700 1 -- start start 2023-06-09T04:37:51.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f2d414700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4f280cd930 0x7f4f280716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f2d414700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4f280b1dc0 0x7f4f280ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f2d414700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2806f480 con 0x7f4f28159380 2023-06-09T04:37:51.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f2d414700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f280b10d0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f2d414700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2806f760 con 0x7f4f280cd930 2023-06-09T04:37:51.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f277fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4f280b1dc0 0x7f4f280ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f277fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4f280b1dc0 0x7f4f280ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37678/0 (socket says 172.21.15.149:37678) 2023-06-09T04:37:51.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.037+0000 7f4f277fe700 1 -- 172.21.15.149:0/2231102656 learned_addr learned my addr 172.21.15.149:0/2231102656 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:51.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f267fc700 1 --2- 172.21.15.149:0/2231102656 >> v2:172.21.15.184:3300/0 conn(0x7f4f280cd930 0x7f4f280716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f277fe700 1 -- 172.21.15.149:0/2231102656 >> v2:172.21.15.184:3300/0 conn(0x7f4f280cd930 msgr2=0x7f4f280716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:51.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f277fe700 1 --2- 172.21.15.149:0/2231102656 >> v2:172.21.15.184:3300/0 conn(0x7f4f280cd930 0x7f4f280716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f277fe700 1 -- 172.21.15.149:0/2231102656 >> v1:172.21.15.184:6789/0 conn(0x7f4f28159380 legacy=0x7f4f280cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f277fe700 1 -- 172.21.15.149:0/2231102656 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280b12e0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f277fe700 1 --2- 172.21.15.149:0/2231102656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f280ca580 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4f28070ca0 tx=0x7f4f2000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17149231b2c231c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f25ffb700 1 -- 172.21.15.149:0/2231102656 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20010070 con 0x7f4f280b1dc0 2023-06-09T04:37:51.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f25ffb700 1 -- 172.21.15.149:0/2231102656 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000dd90 con 0x7f4f280b1dc0 2023-06-09T04:37:51.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f25ffb700 1 -- 172.21.15.149:0/2231102656 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000b310 con 0x7f4f280b1dc0 2023-06-09T04:37:51.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f2d414700 1 -- 172.21.15.149:0/2231102656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 msgr2=0x7f4f280ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.038+0000 7f4f2d414700 1 --2- 172.21.15.149:0/2231102656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f280ca580 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4f28070ca0 tx=0x7f4f2000d430 comp rx=0 tx=0).stop 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.039+0000 7f4f2d414700 1 -- 172.21.15.149:0/2231102656 shutdown_connections 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.039+0000 7f4f2d414700 1 --2- 172.21.15.149:0/2231102656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f280ca580 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.039+0000 7f4f2d414700 1 --2- 172.21.15.149:0/2231102656 >> v2:172.21.15.184:3300/0 conn(0x7f4f280cd930 0x7f4f280716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.039+0000 7f4f2d414700 1 -- 172.21.15.149:0/2231102656 >> 172.21.15.149:0/2231102656 conn(0x7f4f2806aec0 msgr2=0x7f4f2806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.039+0000 7f4f2d414700 1 -- 172.21.15.149:0/2231102656 shutdown_connections 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.039+0000 7f4f2d414700 1 -- 172.21.15.149:0/2231102656 wait complete. 2023-06-09T04:37:51.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.040+0000 7f4f2d414700 1 Processor -- start 2023-06-09T04:37:51.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.040+0000 7f4f2d414700 1 -- start start 2023-06-09T04:37:51.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f28148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f280cd930 0x7f4f280c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f28159380 0x7f4f280b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b33d0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b4210 con 0x7f4f280cd930 2023-06-09T04:37:51.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f280b3600 con 0x7f4f28159380 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f28148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f28148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37680/0 (socket says 172.21.15.149:37680) 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 -- 172.21.15.149:0/1462481821 learned_addr learned my addr 172.21.15.149:0/1462481821 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f277fe700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f28159380 0x7f4f280b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f267fc700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f280cd930 0x7f4f280c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 -- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f28159380 msgr2=0x7f4f280b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f28159380 0x7f4f280b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 -- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f280cd930 msgr2=0x7f4f280c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f280cd930 0x7f4f280c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 -- 172.21.15.149:0/1462481821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2000bd40 con 0x7f4f280b1dc0 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f267fc700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f280cd930 0x7f4f280c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f26ffd700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f28148f60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c450 tx=0x7f4f1c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f0f7fe700 1 -- 172.21.15.149:0/1462481821 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0052d0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f0f7fe700 1 -- 172.21.15.149:0/1462481821 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c005430 con 0x7f4f280b1dc0 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f0f7fe700 1 -- 172.21.15.149:0/1462481821 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0038c0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f280b38e0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.041+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f280b3ea0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.042+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f280b4060 con 0x7f4f280b1dc0 2023-06-09T04:37:51.048 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.043+0000 7f4f0f7fe700 1 -- 172.21.15.149:0/1462481821 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f1c003a20 con 0x7f4f280b1dc0 2023-06-09T04:37:51.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.043+0000 7f4f0f7fe700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4f1406ace0 0x7f4f1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.043+0000 7f4f267fc700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4f1406ace0 0x7f4f1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.043+0000 7f4f0f7fe700 1 -- 172.21.15.149:0/1462481821 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f1c088be0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.044+0000 7f4f267fc700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4f1406ace0 0x7f4f1406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4f280aec00 tx=0x7f4f18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.048+0000 7f4f0f7fe700 1 -- 172.21.15.149:0/1462481821 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f1c0538c0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.236 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.235+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f28073fa0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.236+0000 7f4f0f7fe700 1 -- 172.21.15.149:0/1462481821 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f1c056ee0 con 0x7f4f280b1dc0 2023-06-09T04:37:51.237 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:51.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4f1406ace0 msgr2=0x7f4f1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.239 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4f1406ace0 0x7f4f1406d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4f280aec00 tx=0x7f4f18008040 comp rx=0 tx=0).stop 2023-06-09T04:37:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 msgr2=0x7f4f28148f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f28148f60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c450 tx=0x7f4f1c00c760 comp rx=0 tx=0).stop 2023-06-09T04:37:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 shutdown_connections 2023-06-09T04:37:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4f1406ace0 0x7f4f1406d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4f28159380 0x7f4f280b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4f280b1dc0 0x7f4f28148f60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 --2- 172.21.15.149:0/1462481821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f280cd930 0x7f4f280c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 >> 172.21.15.149:0/1462481821 conn(0x7f4f2806aec0 msgr2=0x7f4f281585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:51.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 shutdown_connections 2023-06-09T04:37:51.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.238+0000 7f4f2d414700 1 -- 172.21.15.149:0/1462481821 wait complete. 2023-06-09T04:37:51.251 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:51.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.374+0000 7f803ceaa700 1 Processor -- start 2023-06-09T04:37:51.375 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.374+0000 7f803ceaa700 1 -- start start 2023-06-09T04:37:51.376 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f803ceaa700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80380cf5b0 0x7f80380cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f803ceaa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f803815e340 0x7f80380cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f803ceaa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80380cda20 con 0x7f80380b60a0 2023-06-09T04:37:51.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f803ceaa700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380b6470 con 0x7f80380cf5b0 2023-06-09T04:37:51.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f803ceaa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803815e7c0 con 0x7f803815e340 2023-06-09T04:37:51.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80380cf5b0 0x7f80380cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.377 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f80380cf5b0 0x7f80380cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37690/0 (socket says 172.21.15.149:37690) 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 -- 172.21.15.149:0/1649180877 learned_addr learned my addr 172.21.15.149:0/1649180877 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8036d9d700 1 --2- 172.21.15.149:0/1649180877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f803815e340 0x7f80380cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 -- 172.21.15.149:0/1649180877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f803815e340 msgr2=0x7f80380cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 --2- 172.21.15.149:0/1649180877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f803815e340 0x7f80380cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 -- 172.21.15.149:0/1649180877 >> v1:172.21.15.184:6789/0 conn(0x7f80380b60a0 legacy=0x7f803815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 -- 172.21.15.149:0/1649180877 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803815a520 con 0x7f80380cf5b0 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.375+0000 7f8035d9b700 1 --2- 172.21.15.149:0/1649180877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80380cf5b0 0x7f80380cad90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f802c0098f0 tx=0x7f802c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638d657c21cf7834 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803559a700 1 -- 172.21.15.149:0/1649180877 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c011830 con 0x7f80380cf5b0 2023-06-09T04:37:51.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803559a700 1 -- 172.21.15.149:0/1649180877 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c011990 con 0x7f80380cf5b0 2023-06-09T04:37:51.379 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803559a700 1 -- 172.21.15.149:0/1649180877 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c011d20 con 0x7f80380cf5b0 2023-06-09T04:37:51.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 -- 172.21.15.149:0/1649180877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80380cf5b0 msgr2=0x7f80380cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 --2- 172.21.15.149:0/1649180877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80380cf5b0 0x7f80380cad90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f802c0098f0 tx=0x7f802c009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:51.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 -- 172.21.15.149:0/1649180877 shutdown_connections 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 --2- 172.21.15.149:0/1649180877 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f803815e340 0x7f80380cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 --2- 172.21.15.149:0/1649180877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80380cf5b0 0x7f80380cad90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 -- 172.21.15.149:0/1649180877 >> 172.21.15.149:0/1649180877 conn(0x7f8038069db0 msgr2=0x7f803806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 -- 172.21.15.149:0/1649180877 shutdown_connections 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.376+0000 7f803ceaa700 1 -- 172.21.15.149:0/1649180877 wait complete. 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 Processor -- start 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 -- start start 2023-06-09T04:37:51.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b60a0 0x7f803815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380cf5b0 0x7f80381f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f803815e340 0x7f8038156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803815d230 con 0x7f803815e340 2023-06-09T04:37:51.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80381f2ce0 con 0x7f80380b60a0 2023-06-09T04:37:51.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f803ceaa700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803806bfc0 con 0x7f80380cf5b0 2023-06-09T04:37:51.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f8036d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f803815e340 0x7f8038156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.378+0000 7f8036d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f803815e340 0x7f8038156420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37696/0 (socket says 172.21.15.149:37696) 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8036d9d700 1 -- 172.21.15.149:0/2984659816 learned_addr learned my addr 172.21.15.149:0/2984659816 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8035d9b700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380cf5b0 0x7f80381f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f803659c700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b60a0 0x7f803815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8036d9d700 1 -- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380cf5b0 msgr2=0x7f80381f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8036d9d700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380cf5b0 0x7f80381f27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8036d9d700 1 -- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b60a0 msgr2=0x7f803815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8036d9d700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b60a0 0x7f803815ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.384 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8036d9d700 1 -- 172.21.15.149:0/2984659816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c009550 con 0x7f803815e340 2023-06-09T04:37:51.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8036d9d700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f803815e340 0x7f8038156420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f803000efc0 tx=0x7f803000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8026ffd700 1 -- 172.21.15.149:0/2984659816 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030009ba0 con 0x7f803815e340 2023-06-09T04:37:51.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8026ffd700 1 -- 172.21.15.149:0/2984659816 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000f040 con 0x7f803815e340 2023-06-09T04:37:51.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803806b440 con 0x7f803815e340 2023-06-09T04:37:51.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f8026ffd700 1 -- 172.21.15.149:0/2984659816 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8030014480 con 0x7f803815e340 2023-06-09T04:37:51.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.379+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803806ba00 con 0x7f803815e340 2023-06-09T04:37:51.385 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.380+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8038073fa0 con 0x7f803815e340 2023-06-09T04:37:51.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.380+0000 7f8026ffd700 1 -- 172.21.15.149:0/2984659816 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f80300145e0 con 0x7f803815e340 2023-06-09T04:37:51.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.381+0000 7f8026ffd700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f801806ace0 0x7f801806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.386 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.381+0000 7f803659c700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f801806ace0 0x7f801806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.381+0000 7f8026ffd700 1 -- 172.21.15.149:0/2984659816 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f803008a100 con 0x7f803815e340 2023-06-09T04:37:51.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.381+0000 7f803659c700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f801806ace0 0x7f801806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8028000f60 tx=0x7f8028009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.387 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.385+0000 7f8026ffd700 1 -- 172.21.15.149:0/2984659816 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8030054e80 con 0x7f803815e340 2023-06-09T04:37:51.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.574+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80380b2790 con 0x7f803815e340 2023-06-09T04:37:51.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.574+0000 7f8026ffd700 1 -- 172.21.15.149:0/2984659816 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80300584a0 con 0x7f803815e340 2023-06-09T04:37:51.576 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:51.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f801806ace0 msgr2=0x7f801806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f801806ace0 0x7f801806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8028000f60 tx=0x7f8028009040 comp rx=0 tx=0).stop 2023-06-09T04:37:51.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f803815e340 msgr2=0x7f8038156420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f803815e340 0x7f8038156420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f803000efc0 tx=0x7f803000c3a0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 shutdown_connections 2023-06-09T04:37:51.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f801806ace0 0x7f801806d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f803815e340 0x7f8038156420 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80380b60a0 0x7f803815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.576+0000 7f803ceaa700 1 --2- 172.21.15.149:0/2984659816 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f80380cf5b0 0x7f80381f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.577+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 >> 172.21.15.149:0/2984659816 conn(0x7f8038069db0 msgr2=0x7f80380cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:51.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.577+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 shutdown_connections 2023-06-09T04:37:51.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.577+0000 7f803ceaa700 1 -- 172.21.15.149:0/2984659816 wait complete. 2023-06-09T04:37:51.590 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:51.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.713+0000 7fe09573e700 1 Processor -- start 2023-06-09T04:37:51.714 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.713+0000 7fe09573e700 1 -- start start 2023-06-09T04:37:51.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe09573e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 0x7fe0900cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.716 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe09573e700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe090071290 con 0x7fe09006a4c0 2023-06-09T04:37:51.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe09573e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0900b2050 con 0x7fe090071770 2023-06-09T04:37:51.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe09573e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900cd2c0 con 0x7fe09015c320 2023-06-09T04:37:51.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08f7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe09006a4c0 0x7fe0900b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33336/0 (socket says 172.21.15.149:33336) 2023-06-09T04:37:51.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08f7fe700 1 -- 172.21.15.149:0/1077000948 learned_addr learned my addr 172.21.15.149:0/1077000948 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:51.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08effd700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 0x7fe0900cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114418777 0 0) 0x7fe090071290 con 0x7fe09006a4c0 2023-06-09T04:37:51.717 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0780035b0 con 0x7fe09006a4c0 2023-06-09T04:37:51.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2806902563 0 0) 0x7fe0780035b0 con 0x7fe09006a4c0 2023-06-09T04:37:51.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 msgr2=0x7fe0900cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:51.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 0x7fe0900cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 >> v1:172.21.15.184:6789/0 conn(0x7fe090071770 legacy=0x7fe090069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900cd5a0 con 0x7fe09006a4c0 2023-06-09T04:37:51.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7fe0880019f0 con 0x7fe09006a4c0 2023-06-09T04:37:51.718 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 >> v1:172.21.15.149:6789/0 conn(0x7fe09006a4c0 legacy=0x7fe0900b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe078003a30 0x7fe078003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 0x7fe078004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe078004d90 0x7fe078005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900cd2c0 con 0x7fe078004d90 2023-06-09T04:37:51.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07800bac0 con 0x7fe078003a30 2023-06-09T04:37:51.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07800bc50 con 0x7fe09015c320 2023-06-09T04:37:51.719 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.714+0000 7fe08f7fe700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe078004d90 0x7fe078005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08effd700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe078003a30 0x7fe078003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08e7fc700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 0x7fe078004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08f7fe700 1 -- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 msgr2=0x7fe078004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08f7fe700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe09015c320 0x7fe078004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08f7fe700 1 -- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe078003a30 msgr2=0x7fe078003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08f7fe700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe078003a30 0x7fe078003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08f7fe700 1 -- 172.21.15.149:0/1077000948 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0780035b0 con 0x7fe078004d90 2023-06-09T04:37:51.720 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08f7fe700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe078004d90 0x7fe078005200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe0900c9c50 tx=0x7fe078005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c940fcea6e950e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088012600 con 0x7fe078004d90 2023-06-09T04:37:51.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe088012760 con 0x7fe078004d90 2023-06-09T04:37:51.721 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.715+0000 7fe08dffb700 1 -- 172.21.15.149:0/1077000948 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088012b10 con 0x7fe078004d90 2023-06-09T04:37:51.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.716+0000 7fe09573e700 1 -- 172.21.15.149:0/1077000948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe078004d90 msgr2=0x7fe078005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.723 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.716+0000 7fe09573e700 1 --2- 172.21.15.149:0/1077000948 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe078004d90 0x7fe078005200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe0900c9c50 tx=0x7fe078005880 comp rx=0 tx=0).stop 2023-06-09T04:37:51.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.716+0000 7fe08f7fe700 1 -- 172.21.15.149:0/1077000948 reap_dead start 2023-06-09T04:37:51.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.716+0000 7fe09573e700 1 -- 172.21.15.149:0/1077000948 shutdown_connections 2023-06-09T04:37:51.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.716+0000 7fe09573e700 1 -- 172.21.15.149:0/1077000948 >> 172.21.15.149:0/1077000948 conn(0x7fe09006aec0 msgr2=0x7fe09006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:51.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.716+0000 7fe09573e700 1 -- 172.21.15.149:0/1077000948 shutdown_connections 2023-06-09T04:37:51.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.716+0000 7fe09573e700 1 -- 172.21.15.149:0/1077000948 wait complete. 2023-06-09T04:37:51.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.717+0000 7fe09573e700 1 Processor -- start 2023-06-09T04:37:51.724 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.717+0000 7fe09573e700 1 -- start start 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe09573e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe090154480 0x7fe0901f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe09573e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe090154850 0x7fe0900c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe09573e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0900b4650 0x7fe0900b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe09573e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0900b5000 con 0x7fe090154480 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe09573e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0901f63a0 con 0x7fe0900b4650 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe09573e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0901f5790 con 0x7fe090154850 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe090154480 0x7fe0901f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.725 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe090154480 0x7fe0901f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37712/0 (socket says 172.21.15.149:37712) 2023-06-09T04:37:51.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 -- 172.21.15.149:0/1782998200 learned_addr learned my addr 172.21.15.149:0/1782998200 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:51.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08f7fe700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0900b4650 0x7fe0900b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08e7fc700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe090154850 0x7fe0900c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 -- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe090154850 msgr2=0x7fe0900c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe090154850 0x7fe0900c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 -- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0900b4650 msgr2=0x7fe0900b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.726 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0900b4650 0x7fe0900b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.718+0000 7fe08effd700 1 -- 172.21.15.149:0/1782998200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0901f5a70 con 0x7fe090154480 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.719+0000 7fe08effd700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe090154480 0x7fe0901f1e40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe080011aa0 tx=0x7fe080011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.720+0000 7fe0777fe700 1 -- 172.21.15.149:0/1782998200 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080011ee0 con 0x7fe090154480 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.720+0000 7fe0777fe700 1 -- 172.21.15.149:0/1782998200 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08000f940 con 0x7fe090154480 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.720+0000 7fe0777fe700 1 -- 172.21.15.149:0/1782998200 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08000fcf0 con 0x7fe090154480 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.720+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0901f5d50 con 0x7fe090154480 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.720+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0901f5420 con 0x7fe090154480 2023-06-09T04:37:51.727 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.721+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe090073fa0 con 0x7fe090154480 2023-06-09T04:37:51.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.722+0000 7fe0777fe700 1 -- 172.21.15.149:0/1782998200 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe080014440 con 0x7fe090154480 2023-06-09T04:37:51.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.722+0000 7fe0777fe700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe07c06ace0 0x7fe07c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:51.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.722+0000 7fe0777fe700 1 -- 172.21.15.149:0/1782998200 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe080089de0 con 0x7fe090154480 2023-06-09T04:37:51.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.722+0000 7fe08e7fc700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe07c06ace0 0x7fe07c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:51.728 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.722+0000 7fe08e7fc700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe07c06ace0 0x7fe07c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe0900aece0 tx=0x7fe084009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:51.729 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.727+0000 7fe0777fe700 1 -- 172.21.15.149:0/1782998200 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0800586b0 con 0x7fe090154480 2023-06-09T04:37:51.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.914+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe0900c39b0 con 0x7fe090154480 2023-06-09T04:37:51.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.914+0000 7fe0777fe700 1 -- 172.21.15.149:0/1782998200 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe0800220a0 con 0x7fe090154480 2023-06-09T04:37:51.915 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:51.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe07c06ace0 msgr2=0x7fe07c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe07c06ace0 0x7fe07c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe0900aece0 tx=0x7fe084009040 comp rx=0 tx=0).stop 2023-06-09T04:37:51.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe090154480 msgr2=0x7fe0901f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:51.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe090154480 0x7fe0901f1e40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe080011aa0 tx=0x7fe080011db0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 shutdown_connections 2023-06-09T04:37:51.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe07c06ace0 0x7fe07c06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe0900b4650 0x7fe0900b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe090154480 0x7fe0901f1e40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 --2- 172.21.15.149:0/1782998200 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe090154850 0x7fe0900c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:51.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 >> 172.21.15.149:0/1782998200 conn(0x7fe09006aec0 msgr2=0x7fe090069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:51.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 shutdown_connections 2023-06-09T04:37:51.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:51.916+0000 7fe09573e700 1 -- 172.21.15.149:0/1782998200 wait complete. 2023-06-09T04:37:51.930 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:37:52.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.050+0000 7fdd7adbf700 1 Processor -- start 2023-06-09T04:37:52.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.050+0000 7fdd7adbf700 1 -- start start 2023-06-09T04:37:52.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd7adbf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 0x7fdd740ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd7adbf700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd74072440 con 0x7fdd74069db0 2023-06-09T04:37:52.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd7adbf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd740b20b0 con 0x7fdd740cd220 2023-06-09T04:37:52.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd7adbf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74071320 con 0x7fdd74071fc0 2023-06-09T04:37:52.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd78b5b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdd74069db0 0x7fdd7406a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33352/0 (socket says 172.21.15.149:33352) 2023-06-09T04:37:52.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd78b5b700 1 -- 172.21.15.149:0/2459954006 learned_addr learned my addr 172.21.15.149:0/2459954006 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:52.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd7935c700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 0x7fdd740ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431257701 0 0) 0x7fdd68001110 con 0x7fdd74069db0 2023-06-09T04:37:52.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd640035b0 con 0x7fdd74069db0 2023-06-09T04:37:52.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934223032 0 0) 0x7fdd640035b0 con 0x7fdd74069db0 2023-06-09T04:37:52.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 msgr2=0x7fdd740ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 0x7fdd740ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 >> v1:172.21.15.184:6789/0 conn(0x7fdd740cd220 legacy=0x7fdd740b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74071600 con 0x7fdd74069db0 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7fdd68001800 con 0x7fdd74069db0 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 >> v1:172.21.15.149:6789/0 conn(0x7fdd74069db0 legacy=0x7fdd7406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd64003a30 0x7fdd64003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd64004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 0x7fdd640052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74071320 con 0x7fdd64004850 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6400bc00 con 0x7fdd64003a30 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.051+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6400bdc0 con 0x7fdd74071fc0 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd73fff700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd64004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd78b5b700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd64003a30 0x7fdd64003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd7935c700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 0x7fdd640052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd73fff700 1 -- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 msgr2=0x7fdd640052d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd73fff700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd74071fc0 0x7fdd640052d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd73fff700 1 -- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd64003a30 msgr2=0x7fdd64003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd73fff700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd64003a30 0x7fdd64003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd73fff700 1 -- 172.21.15.149:0/2459954006 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640035b0 con 0x7fdd64004850 2023-06-09T04:37:52.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd73fff700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd64004cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd60007fd0 tx=0x7fdd64005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901bd02e6394584e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600012f0 con 0x7fdd64004850 2023-06-09T04:37:52.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60005220 con 0x7fdd64004850 2023-06-09T04:37:52.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd737fe700 1 -- 172.21.15.149:0/2459954006 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60006860 con 0x7fdd64004850 2023-06-09T04:37:52.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd7adbf700 1 -- 172.21.15.149:0/2459954006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 msgr2=0x7fdd64004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.052+0000 7fdd7adbf700 1 --2- 172.21.15.149:0/2459954006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd64004cc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd60007fd0 tx=0x7fdd64005880 comp rx=0 tx=0).stop 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.053+0000 7fdd7935c700 1 -- 172.21.15.149:0/2459954006 reap_dead start 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.053+0000 7fdd7adbf700 1 -- 172.21.15.149:0/2459954006 shutdown_connections 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.053+0000 7fdd7adbf700 1 -- 172.21.15.149:0/2459954006 >> 172.21.15.149:0/2459954006 conn(0x7fdd7406aec0 msgr2=0x7fdd7406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.053+0000 7fdd7adbf700 1 -- 172.21.15.149:0/2459954006 shutdown_connections 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.053+0000 7fdd7adbf700 1 -- 172.21.15.149:0/2459954006 wait complete. 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.054+0000 7fdd7adbf700 1 Processor -- start 2023-06-09T04:37:52.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.054+0000 7fdd7adbf700 1 -- start start 2023-06-09T04:37:52.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd74151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.061 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd740cbfc0 0x7fdd740cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd740c9c80 0x7fdd740ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740cb610 con 0x7fdd64004850 2023-06-09T04:37:52.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740cc970 con 0x7fdd740cbfc0 2023-06-09T04:37:52.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740ca990 con 0x7fdd740c9c80 2023-06-09T04:37:52.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd74151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd74151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37732/0 (socket says 172.21.15.149:37732) 2023-06-09T04:37:52.062 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 -- 172.21.15.149:0/4197284433 learned_addr learned my addr 172.21.15.149:0/4197284433 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:52.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd73fff700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd740cbfc0 0x7fdd740cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7935c700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd740c9c80 0x7fdd740ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 -- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd740c9c80 msgr2=0x7fdd740ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd740c9c80 0x7fdd740ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 -- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd740cbfc0 msgr2=0x7fdd740cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.063 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd740cbfc0 0x7fdd740cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 -- 172.21.15.149:0/4197284433 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740cac70 con 0x7fdd64004850 2023-06-09T04:37:52.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7935c700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd740c9c80 0x7fdd740ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:52.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd73fff700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd740cbfc0 0x7fdd740cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:52.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd78b5b700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd74151e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd680072f0 tx=0x7fdd68007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd717fa700 1 -- 172.21.15.149:0/4197284433 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680015c0 con 0x7fdd64004850 2023-06-09T04:37:52.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd717fa700 1 -- 172.21.15.149:0/4197284433 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800f6c0 con 0x7fdd64004850 2023-06-09T04:37:52.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd740caf50 con 0x7fdd64004850 2023-06-09T04:37:52.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd717fa700 1 -- 172.21.15.149:0/4197284433 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800fa70 con 0x7fdd64004850 2023-06-09T04:37:52.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.055+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd74152370 con 0x7fdd64004850 2023-06-09T04:37:52.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.056+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd740cb750 con 0x7fdd64004850 2023-06-09T04:37:52.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.057+0000 7fdd717fa700 1 -- 172.21.15.149:0/4197284433 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd6800fbd0 con 0x7fdd64004850 2023-06-09T04:37:52.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.058+0000 7fdd717fa700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdd5806ace0 0x7fdd5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.058+0000 7fdd717fa700 1 -- 172.21.15.149:0/4197284433 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd68089020 con 0x7fdd64004850 2023-06-09T04:37:52.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.058+0000 7fdd73fff700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdd5806ace0 0x7fdd5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.058+0000 7fdd73fff700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdd5806ace0 0x7fdd5806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd740cbaf0 tx=0x7fdd60009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.061+0000 7fdd717fa700 1 -- 172.21.15.149:0/4197284433 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd68053f10 con 0x7fdd64004850 2023-06-09T04:37:52.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.263+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdd74072440 con 0x7fdd64004850 2023-06-09T04:37:52.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.263+0000 7fdd717fa700 1 -- 172.21.15.149:0/4197284433 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdd74072440 con 0x7fdd64004850 2023-06-09T04:37:52.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdd5806ace0 msgr2=0x7fdd5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdd5806ace0 0x7fdd5806d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd740cbaf0 tx=0x7fdd60009030 comp rx=0 tx=0).stop 2023-06-09T04:37:52.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 msgr2=0x7fdd74151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd74151e30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd680072f0 tx=0x7fdd68007600 comp rx=0 tx=0).stop 2023-06-09T04:37:52.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 shutdown_connections 2023-06-09T04:37:52.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdd5806ace0 0x7fdd5806d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdd740c9c80 0x7fdd740ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64004850 0x7fdd74151e30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 --2- 172.21.15.149:0/4197284433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdd740cbfc0 0x7fdd740cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 >> 172.21.15.149:0/4197284433 conn(0x7fdd7406aec0 msgr2=0x7fdd74158650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 shutdown_connections 2023-06-09T04:37:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.265+0000 7fdd7adbf700 1 -- 172.21.15.149:0/4197284433 wait complete. 2023-06-09T04:37:52.268 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-06-09T04:37:52.278 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-09T04:37:52.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:52.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-09T04:37:52.337 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:37:52.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:52.338 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T04:37:52.366 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:52.367 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:52.385 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:52.385 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:52.442 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:37:52.442 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:52.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:52.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.657+0000 7fca173e5700 1 Processor -- start 2023-06-09T04:37:52.658 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.657+0000 7fca173e5700 1 -- start start 2023-06-09T04:37:52.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca173e5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca10157d30 0x7fca100cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca173e5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca173e5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fca1015a6a0 0x7fca1015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca173e5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca100ced30 con 0x7fca1015a6a0 2023-06-09T04:37:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca173e5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca100cd770 con 0x7fca10157d30 2023-06-09T04:37:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca173e5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1015b060 con 0x7fca100ce3a0 2023-06-09T04:37:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fca1015a6a0 0x7fca1015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fca1015a6a0 0x7fca1015ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37744/0 (socket says 172.21.15.149:37744) 2023-06-09T04:37:52.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 -- 172.21.15.149:0/526060077 learned_addr learned my addr 172.21.15.149:0/526060077 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15181700 1 --2- 172.21.15.149:0/526060077 >> v2:172.21.15.184:3300/0 conn(0x7fca10157d30 0x7fca100cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca14980700 1 --2- 172.21.15.149:0/526060077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 -- 172.21.15.149:0/526060077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 msgr2=0x7fca100ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 --2- 172.21.15.149:0/526060077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 -- 172.21.15.149:0/526060077 >> v2:172.21.15.184:3300/0 conn(0x7fca10157d30 msgr2=0x7fca100cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 --2- 172.21.15.149:0/526060077 >> v2:172.21.15.184:3300/0 conn(0x7fca10157d30 0x7fca100cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 -- 172.21.15.149:0/526060077 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10158100 con 0x7fca1015a6a0 2023-06-09T04:37:52.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15181700 1 --2- 172.21.15.149:0/526060077 >> v2:172.21.15.184:3300/0 conn(0x7fca10157d30 0x7fca100cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:52.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.658+0000 7fca15982700 1 --2- 172.21.15.149:0/526060077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca1015ab20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca100ce2f0 tx=0x7fca0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3f8763e0a80ed5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca07fff700 1 -- 172.21.15.149:0/526060077 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800e070 con 0x7fca1015a6a0 2023-06-09T04:37:52.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca07fff700 1 -- 172.21.15.149:0/526060077 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0800b9c0 con 0x7fca1015a6a0 2023-06-09T04:37:52.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca07fff700 1 -- 172.21.15.149:0/526060077 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800bd70 con 0x7fca1015a6a0 2023-06-09T04:37:52.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 -- 172.21.15.149:0/526060077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 msgr2=0x7fca1015ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 --2- 172.21.15.149:0/526060077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca1015ab20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fca100ce2f0 tx=0x7fca0800b330 comp rx=0 tx=0).stop 2023-06-09T04:37:52.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 -- 172.21.15.149:0/526060077 shutdown_connections 2023-06-09T04:37:52.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 --2- 172.21.15.149:0/526060077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca1015ab20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 --2- 172.21.15.149:0/526060077 >> v2:172.21.15.184:3300/0 conn(0x7fca10157d30 0x7fca100cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 --2- 172.21.15.149:0/526060077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 -- 172.21.15.149:0/526060077 >> 172.21.15.149:0/526060077 conn(0x7fca1006a6d0 msgr2=0x7fca10099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:52.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 -- 172.21.15.149:0/526060077 shutdown_connections 2023-06-09T04:37:52.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.659+0000 7fca173e5700 1 -- 172.21.15.149:0/526060077 wait complete. 2023-06-09T04:37:52.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.660+0000 7fca173e5700 1 Processor -- start 2023-06-09T04:37:52.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.660+0000 7fca173e5700 1 -- start start 2023-06-09T04:37:52.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca173e5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca173e5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca10157d30 0x7fca1015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca173e5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca10156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca173e5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca100b5d20 con 0x7fca1015a6a0 2023-06-09T04:37:52.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca173e5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca100b43b0 con 0x7fca10157d30 2023-06-09T04:37:52.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca173e5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1015df00 con 0x7fca100ce3a0 2023-06-09T04:37:52.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca15982700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca10156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca15982700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca10156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37750/0 (socket says 172.21.15.149:37750) 2023-06-09T04:37:52.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca15982700 1 -- 172.21.15.149:0/1377501586 learned_addr learned my addr 172.21.15.149:0/1377501586 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:52.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca15181700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.661+0000 7fca14980700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca10157d30 0x7fca1015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca15982700 1 -- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 msgr2=0x7fca100b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca15982700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca15982700 1 -- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca10157d30 msgr2=0x7fca1015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca15982700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca10157d30 0x7fca1015d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca15982700 1 -- 172.21.15.149:0/1377501586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08009b30 con 0x7fca1015a6a0 2023-06-09T04:37:52.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca15982700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca10156a70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fca100ce350 tx=0x7fca08004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca05ffb700 1 -- 172.21.15.149:0/1377501586 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08004450 con 0x7fca1015a6a0 2023-06-09T04:37:52.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca05ffb700 1 -- 172.21.15.149:0/1377501586 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca080045d0 con 0x7fca1015a6a0 2023-06-09T04:37:52.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca100b3730 con 0x7fca1015a6a0 2023-06-09T04:37:52.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca05ffb700 1 -- 172.21.15.149:0/1377501586 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca080099b0 con 0x7fca1015a6a0 2023-06-09T04:37:52.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.662+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca100b3cf0 con 0x7fca1015a6a0 2023-06-09T04:37:52.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.663+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca10073fa0 con 0x7fca1015a6a0 2023-06-09T04:37:52.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.663+0000 7fca05ffb700 1 -- 172.21.15.149:0/1377501586 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca0801c410 con 0x7fca1015a6a0 2023-06-09T04:37:52.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.664+0000 7fca05ffb700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc9f406ace0 0x7fc9f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:52.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.664+0000 7fca15181700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc9f406ace0 0x7fc9f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:52.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.664+0000 7fca05ffb700 1 -- 172.21.15.149:0/1377501586 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fca0808b310 con 0x7fca1015a6a0 2023-06-09T04:37:52.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.664+0000 7fca15181700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc9f406ace0 0x7fc9f406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca1015cb10 tx=0x7fca0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:52.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.668+0000 7fca05ffb700 1 -- 172.21.15.149:0/1377501586 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fca08056120 con 0x7fca1015a6a0 2023-06-09T04:37:52.862 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.861+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca100ad630 con 0x7fca1015a6a0 2023-06-09T04:37:52.863 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.862+0000 7fca05ffb700 1 -- 172.21.15.149:0/1377501586 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7fca08059740 con 0x7fca1015a6a0 2023-06-09T04:37:52.863 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:52.863 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc9f406ace0 msgr2=0x7fc9f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc9f406ace0 0x7fc9f406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fca1015cb10 tx=0x7fca0c008040 comp rx=0 tx=0).stop 2023-06-09T04:37:52.865 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 msgr2=0x7fca10156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca10156a70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fca100ce350 tx=0x7fca08004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 shutdown_connections 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc9f406ace0 0x7fc9f406d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fca100ce3a0 0x7fca100b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca1015a6a0 0x7fca10156a70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 --2- 172.21.15.149:0/1377501586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca10157d30 0x7fca1015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 >> 172.21.15.149:0/1377501586 conn(0x7fca1006a6d0 msgr2=0x7fca101584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:52.866 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 shutdown_connections 2023-06-09T04:37:52.867 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:52.864+0000 7fca173e5700 1 -- 172.21.15.149:0/1377501586 wait complete. 2023-06-09T04:37:52.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:52.878 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:53.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.001+0000 7fdbc3cac700 1 Processor -- start 2023-06-09T04:37:53.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.001+0000 7fdbc3cac700 1 -- start start 2023-06-09T04:37:53.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.001+0000 7fdbc3cac700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbbc06d2c0 0x7fdbbc06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.001+0000 7fdbc3cac700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc15c5d0 con 0x7fdbbc0ae2e0 2023-06-09T04:37:53.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.001+0000 7fdbc3cac700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc0cdd70 con 0x7fdbbc06b0a0 2023-06-09T04:37:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.001+0000 7fdbc3cac700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc160380 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc2249700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbbc06d2c0 0x7fdbbc06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc2249700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdbbc06d2c0 0x7fdbbc06d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37756/0 (socket says 172.21.15.149:37756) 2023-06-09T04:37:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc2249700 1 -- 172.21.15.149:0/3432420615 learned_addr learned my addr 172.21.15.149:0/3432420615 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc2249700 1 -- 172.21.15.149:0/3432420615 >> v1:172.21.15.184:6789/0 conn(0x7fdbbc06b0a0 legacy=0x7fdbbc15fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc2249700 1 -- 172.21.15.149:0/3432420615 >> v1:172.21.15.149:6789/0 conn(0x7fdbbc0ae2e0 legacy=0x7fdbbc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc2249700 1 -- 172.21.15.149:0/3432420615 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc06a4c0 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc0a46700 1 -- 172.21.15.149:0/3432420615 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1292311508 0 0) 0x7fdbb8001110 con 0x7fdbbc0ae2e0 2023-06-09T04:37:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc2249700 1 --2- 172.21.15.149:0/3432420615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc06d6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009e50 tx=0x7fdbb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8182d0f560c01635 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc0a46700 1 -- 172.21.15.149:0/3432420615 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400e070 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc0a46700 1 -- 172.21.15.149:0/3432420615 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400b9c0 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.002+0000 7fdbc0a46700 1 -- 172.21.15.149:0/3432420615 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400bd70 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.003+0000 7fdbc3cac700 1 -- 172.21.15.149:0/3432420615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 msgr2=0x7fdbbc06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.003+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/3432420615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc06d6e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009e50 tx=0x7fdbb400b330 comp rx=0 tx=0).stop 2023-06-09T04:37:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.003+0000 7fdbc3cac700 1 -- 172.21.15.149:0/3432420615 shutdown_connections 2023-06-09T04:37:53.007 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.003+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/3432420615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc06d6e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.003+0000 7fdbc3cac700 1 -- 172.21.15.149:0/3432420615 >> 172.21.15.149:0/3432420615 conn(0x7fdbbc0cee30 msgr2=0x7fdbbc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.003+0000 7fdbc3cac700 1 -- 172.21.15.149:0/3432420615 shutdown_connections 2023-06-09T04:37:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.003+0000 7fdbc3cac700 1 -- 172.21.15.149:0/3432420615 wait complete. 2023-06-09T04:37:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.004+0000 7fdbc3cac700 1 Processor -- start 2023-06-09T04:37:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.004+0000 7fdbc3cac700 1 -- start start 2023-06-09T04:37:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc3cac700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbbc06b0a0 0x7fdbbc1f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.008 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc3cac700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc0b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc3cac700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbbc0ae2e0 0x7fdbbc09f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc3cac700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0ae060 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc3cac700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0b2850 con 0x7fdbbc06b0a0 2023-06-09T04:37:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc3cac700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc0b2b30 con 0x7fdbbc0ae2e0 2023-06-09T04:37:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc0b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc0b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37760/0 (socket says 172.21.15.149:37760) 2023-06-09T04:37:53.009 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 -- 172.21.15.149:0/798583172 learned_addr learned my addr 172.21.15.149:0/798583172 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1a48700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbbc06b0a0 0x7fdbbc1f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc2249700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbbc0ae2e0 0x7fdbbc09f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 -- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbbc0ae2e0 msgr2=0x7fdbbc09f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbbc0ae2e0 0x7fdbbc09f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 -- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbbc06b0a0 msgr2=0x7fdbbc1f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbbc06b0a0 0x7fdbbc1f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 -- 172.21.15.149:0/798583172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009b30 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.010 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.005+0000 7fdbc1247700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc0b1e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800c780 tx=0x7fdbb800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.006+0000 7fdbb27fc700 1 -- 172.21.15.149:0/798583172 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80054e0 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.006+0000 7fdbb27fc700 1 -- 172.21.15.149:0/798583172 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb8003680 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.006+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc1f1fd0 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.006+0000 7fdbb27fc700 1 -- 172.21.15.149:0/798583172 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8003a30 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.011 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.006+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc1f1c80 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.007+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc1f24f0 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.007+0000 7fdbb27fc700 1 -- 172.21.15.149:0/798583172 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbb8003b90 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.007+0000 7fdbb27fc700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba006ace0 0x7fdba006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.008+0000 7fdbb27fc700 1 -- 172.21.15.149:0/798583172 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdbb8088a90 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.012 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.008+0000 7fdbc1a48700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba006ace0 0x7fdba006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.008+0000 7fdbc1a48700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba006ace0 0x7fdba006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdbac000f60 tx=0x7fdbac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.013 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.012+0000 7fdbb27fc700 1 -- 172.21.15.149:0/798583172 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdbbc1f24f0 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.205 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.204+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdbbc15c5d0 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.204+0000 7fdbb27fc700 1 -- 172.21.15.149:0/798583172 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdbb8017020 con 0x7fdbbc06d2c0 2023-06-09T04:37:53.206 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba006ace0 msgr2=0x7fdba006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba006ace0 0x7fdba006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdbac000f60 tx=0x7fdbac009040 comp rx=0 tx=0).stop 2023-06-09T04:37:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 msgr2=0x7fdbbc0b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc0b1e70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdbb800c780 tx=0x7fdbb800cb40 comp rx=0 tx=0).stop 2023-06-09T04:37:53.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 shutdown_connections 2023-06-09T04:37:53.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdba006ace0 0x7fdba006d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdbbc0ae2e0 0x7fdbbc09f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdbbc06b0a0 0x7fdbbc1f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 --2- 172.21.15.149:0/798583172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdbbc06d2c0 0x7fdbbc0b1e70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 >> 172.21.15.149:0/798583172 conn(0x7fdbbc0cee30 msgr2=0x7fdbbc15b400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 shutdown_connections 2023-06-09T04:37:53.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.207+0000 7fdbc3cac700 1 -- 172.21.15.149:0/798583172 wait complete. 2023-06-09T04:37:53.220 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:53.343 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.342+0000 7f2141190700 1 Processor -- start 2023-06-09T04:37:53.344 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.342+0000 7f2141190700 1 -- start start 2023-06-09T04:37:53.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f2141190700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f213c15c320 0x7f213c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f2141190700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c06a4c0 0x7f213c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f2141190700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213c071290 con 0x7f213c071770 2023-06-09T04:37:53.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f2141190700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213c0b2050 con 0x7f213c15c320 2023-06-09T04:37:53.346 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f2141190700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0cd2c0 con 0x7f213c06a4c0 2023-06-09T04:37:53.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f213ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f213c15c320 0x7f213c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f213ad9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f213c15c320 0x7f213c0cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37766/0 (socket says 172.21.15.149:37766) 2023-06-09T04:37:53.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.343+0000 7f213ad9d700 1 -- 172.21.15.149:0/680103260 learned_addr learned my addr 172.21.15.149:0/680103260 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:53.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f213b59e700 1 --2- 172.21.15.149:0/680103260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c06a4c0 0x7f213c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f213ad9d700 1 -- 172.21.15.149:0/680103260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c06a4c0 msgr2=0x7f213c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:53.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f213ad9d700 1 --2- 172.21.15.149:0/680103260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c06a4c0 0x7f213c0b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.347 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f213ad9d700 1 -- 172.21.15.149:0/680103260 >> v1:172.21.15.149:6789/0 conn(0x7f213c071770 legacy=0x7f213c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2139d9b700 1 -- 172.21.15.149:0/680103260 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681157024 0 0) 0x7f213c071290 con 0x7f213c071770 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f213ad9d700 1 -- 172.21.15.149:0/680103260 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c0cd5a0 con 0x7f213c15c320 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f213ad9d700 1 --2- 172.21.15.149:0/680103260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c15c320 0x7f213c0cee20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21300098f0 tx=0x7f2130009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd09aa3719e32 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2139d9b700 1 -- 172.21.15.149:0/680103260 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000b8a0 con 0x7f213c15c320 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2139d9b700 1 -- 172.21.15.149:0/680103260 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213000ba00 con 0x7f213c15c320 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2139d9b700 1 -- 172.21.15.149:0/680103260 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000bd90 con 0x7f213c15c320 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2141190700 1 -- 172.21.15.149:0/680103260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c15c320 msgr2=0x7f213c0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.348 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2141190700 1 --2- 172.21.15.149:0/680103260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c15c320 0x7f213c0cee20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21300098f0 tx=0x7f2130009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:53.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2141190700 1 -- 172.21.15.149:0/680103260 shutdown_connections 2023-06-09T04:37:53.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2141190700 1 --2- 172.21.15.149:0/680103260 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c06a4c0 0x7f213c0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2141190700 1 --2- 172.21.15.149:0/680103260 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c15c320 0x7f213c0cee20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.344+0000 7f2141190700 1 -- 172.21.15.149:0/680103260 >> 172.21.15.149:0/680103260 conn(0x7f213c06aec0 msgr2=0x7f213c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.345+0000 7f2141190700 1 -- 172.21.15.149:0/680103260 shutdown_connections 2023-06-09T04:37:53.349 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.345+0000 7f2141190700 1 -- 172.21.15.149:0/680103260 wait complete. 2023-06-09T04:37:53.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.346+0000 7f2141190700 1 Processor -- start 2023-06-09T04:37:53.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.346+0000 7f2141190700 1 -- start start 2023-06-09T04:37:53.351 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f2141190700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213c06a4c0 0x7f213c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f2141190700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c071770 0x7f213c0c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f2141190700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c15c320 0x7f213c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f2141190700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c14b050 con 0x7f213c071770 2023-06-09T04:37:53.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f2141190700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0c33d0 con 0x7f213c06a4c0 2023-06-09T04:37:53.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f2141190700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213c0b3bb0 con 0x7f213c15c320 2023-06-09T04:37:53.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c071770 0x7f213c0c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.352 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c071770 0x7f213c0c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37774/0 (socket says 172.21.15.149:37774) 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 -- 172.21.15.149:0/209904840 learned_addr learned my addr 172.21.15.149:0/209904840 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213ad9d700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213c06a4c0 0x7f213c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213b59e700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c15c320 0x7f213c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 -- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c15c320 msgr2=0x7f213c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c15c320 0x7f213c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 -- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213c06a4c0 msgr2=0x7f213c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213c06a4c0 0x7f213c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 -- 172.21.15.149:0/209904840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009550 con 0x7f213c071770 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213b59e700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c15c320 0x7f213c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f213a59c700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c071770 0x7f213c0c2e90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f212c00c520 tx=0x7f212c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.347+0000 7f21237fe700 1 -- 172.21.15.149:0/209904840 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c0054e0 con 0x7f213c071770 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.348+0000 7f21237fe700 1 -- 172.21.15.149:0/209904840 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c003680 con 0x7f213c071770 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.348+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c0c7b70 con 0x7f213c071770 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.348+0000 7f21237fe700 1 -- 172.21.15.149:0/209904840 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c003a30 con 0x7f213c071770 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.348+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213c0c8130 con 0x7f213c071770 2023-06-09T04:37:53.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.348+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213c073fa0 con 0x7f213c071770 2023-06-09T04:37:53.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.349+0000 7f21237fe700 1 -- 172.21.15.149:0/209904840 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f212c003b90 con 0x7f213c071770 2023-06-09T04:37:53.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.349+0000 7f21237fe700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f212806ace0 0x7f212806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.349+0000 7f21237fe700 1 -- 172.21.15.149:0/209904840 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f212c088bf0 con 0x7f213c071770 2023-06-09T04:37:53.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.349+0000 7f213ad9d700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f212806ace0 0x7f212806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.350+0000 7f213ad9d700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f212806ace0 0x7f212806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2130014040 tx=0x7f2130008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.355+0000 7f21237fe700 1 -- 172.21.15.149:0/209904840 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f212c053a00 con 0x7f213c071770 2023-06-09T04:37:53.543 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.542+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f213c0ae790 con 0x7f213c071770 2023-06-09T04:37:53.544 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.542+0000 7f21237fe700 1 -- 172.21.15.149:0/209904840 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f212c0170a0 con 0x7f213c071770 2023-06-09T04:37:53.544 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:53.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f212806ace0 msgr2=0x7f212806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f212806ace0 0x7f212806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2130014040 tx=0x7f2130008030 comp rx=0 tx=0).stop 2023-06-09T04:37:53.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c071770 msgr2=0x7f213c0c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c071770 0x7f213c0c2e90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f212c00c520 tx=0x7f212c00c830 comp rx=0 tx=0).stop 2023-06-09T04:37:53.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 shutdown_connections 2023-06-09T04:37:53.546 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f212806ace0 0x7f212806d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f213c15c320 0x7f213c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f213c06a4c0 0x7f213c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 --2- 172.21.15.149:0/209904840 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f213c071770 0x7f213c0c2e90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 >> 172.21.15.149:0/209904840 conn(0x7f213c06aec0 msgr2=0x7f213c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 shutdown_connections 2023-06-09T04:37:53.547 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.545+0000 7f2141190700 1 -- 172.21.15.149:0/209904840 wait complete. 2023-06-09T04:37:53.558 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:53.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.680+0000 7f69c9981700 1 Processor -- start 2023-06-09T04:37:53.681 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.680+0000 7f69c9981700 1 -- start start 2023-06-09T04:37:53.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.680+0000 7f69c9981700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c40b43f0 0x7f69c40cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.680+0000 7f69c9981700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f69c406bb00 0x7f69c40d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.680+0000 7f69c9981700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c40ccfc0 con 0x7f69c40cf100 2023-06-09T04:37:53.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.680+0000 7f69c9981700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c40cd7d0 con 0x7f69c406bb00 2023-06-09T04:37:53.682 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.680+0000 7f69c9981700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c40d0540 con 0x7f69c40b43f0 2023-06-09T04:37:53.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f69c406bb00 0x7f69c40d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c2ffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c40b43f0 0x7f69c40cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f69c406bb00 0x7f69c40d0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:57046/0 (socket says 172.21.15.149:57046) 2023-06-09T04:37:53.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 -- 172.21.15.149:0/1043531191 learned_addr learned my addr 172.21.15.149:0/1043531191 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:53.683 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c37fe700 1 --1- 172.21.15.149:0/1043531191 >> v1:172.21.15.184:6789/0 conn(0x7f69c40cf100 0x7f69c40b47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:39412/0 (socket says 172.21.15.149:39412) 2023-06-09T04:37:53.684 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 -- 172.21.15.149:0/1043531191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c40b43f0 msgr2=0x7f69c40cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:53.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 --2- 172.21.15.149:0/1043531191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c40b43f0 0x7f69c40cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 -- 172.21.15.149:0/1043531191 >> v1:172.21.15.184:6789/0 conn(0x7f69c40cf100 legacy=0x7f69c40b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 -- 172.21.15.149:0/1043531191 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c40d07e0 con 0x7f69c406bb00 2023-06-09T04:37:53.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c27fc700 1 --2- 172.21.15.149:0/1043531191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c406bb00 0x7f69c40d0c70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69b40098f0 tx=0x7f69b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1355fff698fef42 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c1ffb700 1 -- 172.21.15.149:0/1043531191 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4011830 con 0x7f69c406bb00 2023-06-09T04:37:53.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c1ffb700 1 -- 172.21.15.149:0/1043531191 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b4011990 con 0x7f69c406bb00 2023-06-09T04:37:53.685 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.681+0000 7f69c1ffb700 1 -- 172.21.15.149:0/1043531191 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4011d20 con 0x7f69c406bb00 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 -- 172.21.15.149:0/1043531191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c406bb00 msgr2=0x7f69c40d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 --2- 172.21.15.149:0/1043531191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c406bb00 0x7f69c40d0c70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f69b40098f0 tx=0x7f69b4009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 -- 172.21.15.149:0/1043531191 shutdown_connections 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 --2- 172.21.15.149:0/1043531191 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c40b43f0 0x7f69c40cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 --2- 172.21.15.149:0/1043531191 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c406bb00 0x7f69c40d0c70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 -- 172.21.15.149:0/1043531191 >> 172.21.15.149:0/1043531191 conn(0x7f69c4072120 msgr2=0x7f69c406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 -- 172.21.15.149:0/1043531191 shutdown_connections 2023-06-09T04:37:53.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.682+0000 7f69c9981700 1 -- 172.21.15.149:0/1043531191 wait complete. 2023-06-09T04:37:53.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.683+0000 7f69c9981700 1 Processor -- start 2023-06-09T04:37:53.687 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.683+0000 7f69c9981700 1 -- start start 2023-06-09T04:37:53.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c9981700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c406bb00 0x7f69c41f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c9981700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c40b43f0 0x7f69c40cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c9981700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69c40cf100 0x7f69c40cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c9981700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415d680 con 0x7f69c40cf100 2023-06-09T04:37:53.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c9981700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415d960 con 0x7f69c40b43f0 2023-06-09T04:37:53.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c9981700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415dc40 con 0x7f69c406bb00 2023-06-09T04:37:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69c40cf100 0x7f69c40cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c37fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69c40cf100 0x7f69c40cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37790/0 (socket says 172.21.15.149:37790) 2023-06-09T04:37:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c37fe700 1 -- 172.21.15.149:0/611841971 learned_addr learned my addr 172.21.15.149:0/611841971 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c27fc700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c40b43f0 0x7f69c40cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.684+0000 7f69c2ffd700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c406bb00 0x7f69c41f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c37fe700 1 -- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c406bb00 msgr2=0x7f69c41f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c37fe700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c406bb00 0x7f69c41f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c37fe700 1 -- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c40b43f0 msgr2=0x7f69c40cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c37fe700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c40b43f0 0x7f69c40cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c37fe700 1 -- 172.21.15.149:0/611841971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4009550 con 0x7f69c40cf100 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c37fe700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69c40cf100 0x7f69c40cb810 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00cbd0 tx=0x7f69bc00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69abfff700 1 -- 172.21.15.149:0/611841971 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00aaa0 con 0x7f69c40cf100 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69abfff700 1 -- 172.21.15.149:0/611841971 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc00ac00 con 0x7f69c40cf100 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c415df20 con 0x7f69c40cf100 2023-06-09T04:37:53.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69abfff700 1 -- 172.21.15.149:0/611841971 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc007070 con 0x7f69c40cf100 2023-06-09T04:37:53.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.685+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c415c910 con 0x7f69c40cf100 2023-06-09T04:37:53.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.686+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c40d27e0 con 0x7f69c40cf100 2023-06-09T04:37:53.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.686+0000 7f69abfff700 1 -- 172.21.15.149:0/611841971 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69bc0071d0 con 0x7f69c40cf100 2023-06-09T04:37:53.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.687+0000 7f69abfff700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f69b006ace0 0x7f69b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:53.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.687+0000 7f69abfff700 1 -- 172.21.15.149:0/611841971 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f69bc089400 con 0x7f69c40cf100 2023-06-09T04:37:53.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.687+0000 7f69c2ffd700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f69b006ace0 0x7f69b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:53.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.687+0000 7f69c2ffd700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f69b006ace0 0x7f69b006d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009be0 tx=0x7f69b8009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:53.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.692+0000 7f69abfff700 1 -- 172.21.15.149:0/611841971 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f69bc054230 con 0x7f69c40cf100 2023-06-09T04:37:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.880+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f69c415e0b0 con 0x7f69c40cf100 2023-06-09T04:37:53.881 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.880+0000 7f69abfff700 1 -- 172.21.15.149:0/611841971 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f69bc017020 con 0x7f69c40cf100 2023-06-09T04:37:53.882 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f69b006ace0 msgr2=0x7f69b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f69b006ace0 0x7f69b006d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f69b8009be0 tx=0x7f69b8009210 comp rx=0 tx=0).stop 2023-06-09T04:37:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69c40cf100 msgr2=0x7f69c40cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:53.884 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69c40cf100 0x7f69c40cb810 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00cbd0 tx=0x7f69bc00cee0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 shutdown_connections 2023-06-09T04:37:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f69b006ace0 0x7f69b006d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69c406bb00 0x7f69c41f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69c40cf100 0x7f69c40cb810 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 --2- 172.21.15.149:0/611841971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69c40b43f0 0x7f69c40cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:53.885 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 >> 172.21.15.149:0/611841971 conn(0x7f69c4072120 msgr2=0x7f69c40b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:53.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 shutdown_connections 2023-06-09T04:37:53.886 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:53.882+0000 7f69c9981700 1 -- 172.21.15.149:0/611841971 wait complete. 2023-06-09T04:37:53.896 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:54.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.019+0000 7fcc59ab9700 1 Processor -- start 2023-06-09T04:37:54.019 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.019+0000 7fcc59ab9700 1 -- start start 2023-06-09T04:37:54.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.019+0000 7fcc59ab9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc540cf150 0x7fcc54069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.020 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.019+0000 7fcc59ab9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcc5406a2f0 0x7fcc540ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.019+0000 7fcc59ab9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc540cd930 con 0x7fcc5415c420 2023-06-09T04:37:54.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.019+0000 7fcc59ab9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5406a790 con 0x7fcc5406a2f0 2023-06-09T04:37:54.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.019+0000 7fcc59ab9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5415c7f0 con 0x7fcc540cf150 2023-06-09T04:37:54.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcc5406a2f0 0x7fcc540ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcc5406a2f0 0x7fcc540ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37798/0 (socket says 172.21.15.149:37798) 2023-06-09T04:37:54.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 -- 172.21.15.149:0/3879155023 learned_addr learned my addr 172.21.15.149:0/3879155023 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:54.021 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc52ffd700 1 --2- 172.21.15.149:0/3879155023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc540cf150 0x7fcc54069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 -- 172.21.15.149:0/3879155023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc540cf150 msgr2=0x7fcc54069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 --2- 172.21.15.149:0/3879155023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc540cf150 0x7fcc54069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 -- 172.21.15.149:0/3879155023 >> v1:172.21.15.184:6789/0 conn(0x7fcc5415c420 legacy=0x7fcc540cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 -- 172.21.15.149:0/3879155023 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54072330 con 0x7fcc5406a2f0 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc53fff700 1 --2- 172.21.15.149:0/3879155023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5406a2f0 0x7fcc540ab8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009e50 tx=0x7fcc4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5883d97b0e95d56 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.022 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc527fc700 1 -- 172.21.15.149:0/3879155023 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c00e070 con 0x7fcc5406a2f0 2023-06-09T04:37:54.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc527fc700 1 -- 172.21.15.149:0/3879155023 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c003a20 con 0x7fcc5406a2f0 2023-06-09T04:37:54.023 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.020+0000 7fcc527fc700 1 -- 172.21.15.149:0/3879155023 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c003dd0 con 0x7fcc5406a2f0 2023-06-09T04:37:54.025 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 -- 172.21.15.149:0/3879155023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5406a2f0 msgr2=0x7fcc540ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/3879155023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5406a2f0 0x7fcc540ab8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009e50 tx=0x7fcc4c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:54.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 -- 172.21.15.149:0/3879155023 shutdown_connections 2023-06-09T04:37:54.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/3879155023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5406a2f0 0x7fcc540ab8f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/3879155023 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc540cf150 0x7fcc54069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 -- 172.21.15.149:0/3879155023 >> 172.21.15.149:0/3879155023 conn(0x7fcc5406aec0 msgr2=0x7fcc5406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 -- 172.21.15.149:0/3879155023 shutdown_connections 2023-06-09T04:37:54.026 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.021+0000 7fcc59ab9700 1 -- 172.21.15.149:0/3879155023 wait complete. 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.022+0000 7fcc59ab9700 1 Processor -- start 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.022+0000 7fcc59ab9700 1 -- start start 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc59ab9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc5406a2f0 0x7fcc540addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc59ab9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc540cf150 0x7fcc540b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc59ab9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5415c420 0x7fcc540b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc59ab9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540b4330 con 0x7fcc5415c420 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc59ab9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540ae2f0 con 0x7fcc540cf150 2023-06-09T04:37:54.027 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc59ab9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540b52b0 con 0x7fcc5406a2f0 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5415c420 0x7fcc540b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5415c420 0x7fcc540b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37804/0 (socket says 172.21.15.149:37804) 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 -- 172.21.15.149:0/949925032 learned_addr learned my addr 172.21.15.149:0/949925032 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc537fe700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc5406a2f0 0x7fcc540addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc52ffd700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc540cf150 0x7fcc540b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 -- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc5406a2f0 msgr2=0x7fcc540addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc5406a2f0 0x7fcc540addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.028 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 -- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc540cf150 msgr2=0x7fcc540b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc540cf150 0x7fcc540b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 -- 172.21.15.149:0/949925032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c009b30 con 0x7fcc5415c420 2023-06-09T04:37:54.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.023+0000 7fcc53fff700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5415c420 0x7fcc540b3180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcc5406be40 tx=0x7fcc4c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.024+0000 7fcc3bfff700 1 -- 172.21.15.149:0/949925032 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c004440 con 0x7fcc5415c420 2023-06-09T04:37:54.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.024+0000 7fcc3bfff700 1 -- 172.21.15.149:0/949925032 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c0045c0 con 0x7fcc5415c420 2023-06-09T04:37:54.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.024+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5415da20 con 0x7fcc5415c420 2023-06-09T04:37:54.029 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.024+0000 7fcc3bfff700 1 -- 172.21.15.149:0/949925032 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c004970 con 0x7fcc5415c420 2023-06-09T04:37:54.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.024+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5415f430 con 0x7fcc5415c420 2023-06-09T04:37:54.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.025+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc540b4470 con 0x7fcc5415c420 2023-06-09T04:37:54.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.025+0000 7fcc3bfff700 1 -- 172.21.15.149:0/949925032 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc4c025450 con 0x7fcc5415c420 2023-06-09T04:37:54.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.025+0000 7fcc3bfff700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcc4006ace0 0x7fcc4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.025+0000 7fcc3bfff700 1 -- 172.21.15.149:0/949925032 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc4c08ae00 con 0x7fcc5415c420 2023-06-09T04:37:54.030 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.026+0000 7fcc537fe700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcc4006ace0 0x7fcc4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.026+0000 7fcc537fe700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcc4006ace0 0x7fcc4006d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007fd0 tx=0x7fcc44007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.030+0000 7fcc3bfff700 1 -- 172.21.15.149:0/949925032 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc540b4470 con 0x7fcc5415c420 2023-06-09T04:37:54.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.215+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc540b4470 con 0x7fcc5415c420 2023-06-09T04:37:54.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.216+0000 7fcc3bfff700 1 -- 172.21.15.149:0/949925032 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc540b4470 con 0x7fcc5415c420 2023-06-09T04:37:54.216 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:54.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcc4006ace0 msgr2=0x7fcc4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcc4006ace0 0x7fcc4006d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcc44007fd0 tx=0x7fcc44007ec0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5415c420 msgr2=0x7fcc540b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5415c420 0x7fcc540b3180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcc5406be40 tx=0x7fcc4c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 shutdown_connections 2023-06-09T04:37:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fcc4006ace0 0x7fcc4006d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcc5406a2f0 0x7fcc540addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc5415c420 0x7fcc540b3180 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 --2- 172.21.15.149:0/949925032 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc540cf150 0x7fcc540b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 >> 172.21.15.149:0/949925032 conn(0x7fcc5406aec0 msgr2=0x7fcc540cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 shutdown_connections 2023-06-09T04:37:54.220 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.218+0000 7fcc59ab9700 1 -- 172.21.15.149:0/949925032 wait complete. 2023-06-09T04:37:54.230 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:54.353 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.353+0000 7fdbaf441700 1 Processor -- start 2023-06-09T04:37:54.354 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.353+0000 7fdbaf441700 1 -- start start 2023-06-09T04:37:54.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.354+0000 7fdbaf441700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdba815c320 0x7fdba80cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.354+0000 7fdbaf441700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdba8071770 0x7fdba8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.354+0000 7fdbaf441700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba8071290 con 0x7fdba815c6f0 2023-06-09T04:37:54.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.354+0000 7fdbaf441700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80b2050 con 0x7fdba8071770 2023-06-09T04:37:54.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.354+0000 7fdbaf441700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80cd2c0 con 0x7fdba815c320 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdba8071770 0x7fdba8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdba8071770 0x7fdba8069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37808/0 (socket says 172.21.15.149:37808) 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 -- 172.21.15.149:0/575364257 learned_addr learned my addr 172.21.15.149:0/575364257 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbad1dd700 1 --2- 172.21.15.149:0/575364257 >> v2:172.21.15.184:3300/0 conn(0x7fdba815c320 0x7fdba80cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 -- 172.21.15.149:0/575364257 >> v2:172.21.15.184:3300/0 conn(0x7fdba815c320 msgr2=0x7fdba80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 --2- 172.21.15.149:0/575364257 >> v2:172.21.15.184:3300/0 conn(0x7fdba815c320 0x7fdba80cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 -- 172.21.15.149:0/575364257 >> v1:172.21.15.149:6789/0 conn(0x7fdba815c6f0 legacy=0x7fdba8160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdb9ffff700 1 -- 172.21.15.149:0/575364257 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625263867 0 0) 0x7fdba8071290 con 0x7fdba815c6f0 2023-06-09T04:37:54.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 -- 172.21.15.149:0/575364257 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80cd5a0 con 0x7fdba8071770 2023-06-09T04:37:54.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdbac9dc700 1 --2- 172.21.15.149:0/575364257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba8071770 0x7fdba8069db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdba80cd1a0 tx=0x7fdba4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64f2270f18333fb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdb9ffff700 1 -- 172.21.15.149:0/575364257 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4011830 con 0x7fdba8071770 2023-06-09T04:37:54.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdb9ffff700 1 -- 172.21.15.149:0/575364257 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba4011990 con 0x7fdba8071770 2023-06-09T04:37:54.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.355+0000 7fdb9ffff700 1 -- 172.21.15.149:0/575364257 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4011d20 con 0x7fdba8071770 2023-06-09T04:37:54.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 -- 172.21.15.149:0/575364257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba8071770 msgr2=0x7fdba8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 --2- 172.21.15.149:0/575364257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba8071770 0x7fdba8069db0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdba80cd1a0 tx=0x7fdba4009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 -- 172.21.15.149:0/575364257 shutdown_connections 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 --2- 172.21.15.149:0/575364257 >> v2:172.21.15.184:3300/0 conn(0x7fdba815c320 0x7fdba80cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 --2- 172.21.15.149:0/575364257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba8071770 0x7fdba8069db0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 -- 172.21.15.149:0/575364257 >> 172.21.15.149:0/575364257 conn(0x7fdba806aec0 msgr2=0x7fdba806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 -- 172.21.15.149:0/575364257 shutdown_connections 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.356+0000 7fdbaf441700 1 -- 172.21.15.149:0/575364257 wait complete. 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.357+0000 7fdbaf441700 1 Processor -- start 2023-06-09T04:37:54.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.357+0000 7fdbaf441700 1 -- start start 2023-06-09T04:37:54.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbaf441700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba8071770 0x7fdba81549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbaf441700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba815c320 0x7fdba8154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbaf441700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba815c6f0 0x7fdba80ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbaf441700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8155450 con 0x7fdba815c6f0 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbaf441700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80cca90 con 0x7fdba815c320 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbaf441700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80cb9f0 con 0x7fdba8071770 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba815c6f0 0x7fdba80ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba815c6f0 0x7fdba80ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37818/0 (socket says 172.21.15.149:37818) 2023-06-09T04:37:54.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 -- 172.21.15.149:0/1678518889 learned_addr learned my addr 172.21.15.149:0/1678518889 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:54.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbac9dc700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba815c320 0x7fdba8154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad1dd700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba8071770 0x7fdba81549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 -- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba8071770 msgr2=0x7fdba81549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba8071770 0x7fdba81549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 -- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba815c320 msgr2=0x7fdba8154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba815c320 0x7fdba8154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.358+0000 7fdbad9de700 1 -- 172.21.15.149:0/1678518889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba4009550 con 0x7fdba815c6f0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.359+0000 7fdbad9de700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba815c6f0 0x7fdba80ac450 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c780 tx=0x7fdba000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.359+0000 7fdb9dffb700 1 -- 172.21.15.149:0/1678518889 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0003e30 con 0x7fdba815c6f0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.359+0000 7fdb9dffb700 1 -- 172.21.15.149:0/1678518889 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba0005070 con 0x7fdba815c6f0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.359+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba80cbcd0 con 0x7fdba815c6f0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.359+0000 7fdb9dffb700 1 -- 172.21.15.149:0/1678518889 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0005400 con 0x7fdba815c6f0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.359+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba80cc290 con 0x7fdba815c6f0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.360+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8073fa0 con 0x7fdba815c6f0 2023-06-09T04:37:54.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.360+0000 7fdb9dffb700 1 -- 172.21.15.149:0/1678518889 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdba0005560 con 0x7fdba815c6f0 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.361+0000 7fdb9dffb700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdb8c06ace0 0x7fdb8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.361+0000 7fdb9dffb700 1 -- 172.21.15.149:0/1678518889 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdba0088d50 con 0x7fdba815c6f0 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.361+0000 7fdbad1dd700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdb8c06ace0 0x7fdb8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.361+0000 7fdbad1dd700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdb8c06ace0 0x7fdb8c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009be0 tx=0x7fdb98009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.365+0000 7fdb9dffb700 1 -- 172.21.15.149:0/1678518889 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdba008c030 con 0x7fdba815c6f0 2023-06-09T04:37:54.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.552+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdba80b55d0 con 0x7fdba815c6f0 2023-06-09T04:37:54.552 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.552+0000 7fdb9dffb700 1 -- 172.21.15.149:0/1678518889 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdba00170a0 con 0x7fdba815c6f0 2023-06-09T04:37:54.553 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:54.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdb8c06ace0 msgr2=0x7fdb8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.554 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdb8c06ace0 0x7fdb8c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009be0 tx=0x7fdb98009210 comp rx=0 tx=0).stop 2023-06-09T04:37:54.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba815c6f0 msgr2=0x7fdba80ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba815c6f0 0x7fdba80ac450 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c780 tx=0x7fdba000ca90 comp rx=0 tx=0).stop 2023-06-09T04:37:54.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 shutdown_connections 2023-06-09T04:37:54.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdb8c06ace0 0x7fdb8c06d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdba8071770 0x7fdba81549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdba815c6f0 0x7fdba80ac450 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.555 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 --2- 172.21.15.149:0/1678518889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdba815c320 0x7fdba8154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 >> 172.21.15.149:0/1678518889 conn(0x7fdba806aec0 msgr2=0x7fdba80af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 shutdown_connections 2023-06-09T04:37:54.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.554+0000 7fdbaf441700 1 -- 172.21.15.149:0/1678518889 wait complete. 2023-06-09T04:37:54.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:37:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.689+0000 7f41ca640700 1 Processor -- start 2023-06-09T04:37:54.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.689+0000 7f41ca640700 1 -- start start 2023-06-09T04:37:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.689+0000 7f41ca640700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41c40ccf50 0x7f41c40cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.690 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.689+0000 7f41ca640700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f41c40cafb0 0x7f41c40cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.689+0000 7f41ca640700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c40d14e0 con 0x7f41c415c170 2023-06-09T04:37:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.689+0000 7f41ca640700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c40d06f0 con 0x7f41c40ccf50 2023-06-09T04:37:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.689+0000 7f41ca640700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c415c540 con 0x7f41c40cafb0 2023-06-09T04:37:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41c40ccf50 0x7f41c40cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41c40ccf50 0x7f41c40cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37824/0 (socket says 172.21.15.149:37824) 2023-06-09T04:37:54.691 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 -- 172.21.15.149:0/2022639984 learned_addr learned my addr 172.21.15.149:0/2022639984 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c8bdd700 1 --2- 172.21.15.149:0/2022639984 >> v2:172.21.15.184:3300/0 conn(0x7f41c40cafb0 0x7f41c40cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 -- 172.21.15.149:0/2022639984 >> v2:172.21.15.184:3300/0 conn(0x7f41c40cafb0 msgr2=0x7f41c40cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 --2- 172.21.15.149:0/2022639984 >> v2:172.21.15.184:3300/0 conn(0x7f41c40cafb0 0x7f41c40cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 -- 172.21.15.149:0/2022639984 >> v1:172.21.15.184:6789/0 conn(0x7f41c415c170 legacy=0x7f41c40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 -- 172.21.15.149:0/2022639984 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40b2bb0 con 0x7f41c40ccf50 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c8bdd700 1 --2- 172.21.15.149:0/2022639984 >> v2:172.21.15.184:3300/0 conn(0x7f41c40cafb0 0x7f41c40cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:54.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c37fe700 1 --2- 172.21.15.149:0/2022639984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40ccf50 0x7f41c40cd3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f41c40b0150 tx=0x7f41b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3567186cb14d9096 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c2ffd700 1 -- 172.21.15.149:0/2022639984 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8004230 con 0x7f41c40ccf50 2023-06-09T04:37:54.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c2ffd700 1 -- 172.21.15.149:0/2022639984 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8004390 con 0x7f41c40ccf50 2023-06-09T04:37:54.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.690+0000 7f41c2ffd700 1 -- 172.21.15.149:0/2022639984 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b80036a0 con 0x7f41c40ccf50 2023-06-09T04:37:54.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 -- 172.21.15.149:0/2022639984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40ccf50 msgr2=0x7f41c40cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 --2- 172.21.15.149:0/2022639984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40ccf50 0x7f41c40cd3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f41c40b0150 tx=0x7f41b8009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 -- 172.21.15.149:0/2022639984 shutdown_connections 2023-06-09T04:37:54.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 --2- 172.21.15.149:0/2022639984 >> v2:172.21.15.184:3300/0 conn(0x7f41c40cafb0 0x7f41c40cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 --2- 172.21.15.149:0/2022639984 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40ccf50 0x7f41c40cd3c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 -- 172.21.15.149:0/2022639984 >> 172.21.15.149:0/2022639984 conn(0x7f41c4069db0 msgr2=0x7f41c406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 -- 172.21.15.149:0/2022639984 shutdown_connections 2023-06-09T04:37:54.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.691+0000 7f41ca640700 1 -- 172.21.15.149:0/2022639984 wait complete. 2023-06-09T04:37:54.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.692+0000 7f41ca640700 1 Processor -- start 2023-06-09T04:37:54.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41ca640700 1 -- start start 2023-06-09T04:37:54.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41ca640700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40cafb0 0x7f41c415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41ca640700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41c40ccf50 0x7f41c40b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41ca640700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41c415c170 0x7f41c40b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41ca640700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c414d710 con 0x7f41c40cafb0 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41ca640700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40c7810 con 0x7f41c415c170 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41ca640700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c415d670 con 0x7f41c40ccf50 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41c3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40cafb0 0x7f41c415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41c3fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40cafb0 0x7f41c415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37828/0 (socket says 172.21.15.149:37828) 2023-06-09T04:37:54.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.693+0000 7f41c3fff700 1 -- 172.21.15.149:0/2195387399 learned_addr learned my addr 172.21.15.149:0/2195387399 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c37fe700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41c40ccf50 0x7f41c40b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c8bdd700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41c415c170 0x7f41c40b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c3fff700 1 -- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41c40ccf50 msgr2=0x7f41c40b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c3fff700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41c40ccf50 0x7f41c40b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c3fff700 1 -- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41c415c170 msgr2=0x7f41c40b4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c3fff700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41c415c170 0x7f41c40b4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c3fff700 1 -- 172.21.15.149:0/2195387399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8009550 con 0x7f41c40cafb0 2023-06-09T04:37:54.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c3fff700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40cafb0 0x7f41c415d090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f41b400b4a0 tx=0x7f41b400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c0ff9700 1 -- 172.21.15.149:0/2195387399 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011830 con 0x7f41c40cafb0 2023-06-09T04:37:54.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c0ff9700 1 -- 172.21.15.149:0/2195387399 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4011990 con 0x7f41c40cafb0 2023-06-09T04:37:54.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41c0ff9700 1 -- 172.21.15.149:0/2195387399 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4011d40 con 0x7f41c40cafb0 2023-06-09T04:37:54.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c415d950 con 0x7f41c40cafb0 2023-06-09T04:37:54.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.694+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c415df10 con 0x7f41c40cafb0 2023-06-09T04:37:54.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.695+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c4073fa0 con 0x7f41c40cafb0 2023-06-09T04:37:54.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.695+0000 7f41c0ff9700 1 -- 172.21.15.149:0/2195387399 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41b401a400 con 0x7f41c40cafb0 2023-06-09T04:37:54.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.696+0000 7f41c0ff9700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f41b006ace0 0x7f41b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:54.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.696+0000 7f41c0ff9700 1 -- 172.21.15.149:0/2195387399 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f41b4089550 con 0x7f41c40cafb0 2023-06-09T04:37:54.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.696+0000 7f41c37fe700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f41b006ace0 0x7f41b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:54.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.696+0000 7f41c37fe700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f41b006ace0 0x7f41b006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009130 tx=0x7f41b8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:54.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.700+0000 7f41c0ff9700 1 -- 172.21.15.149:0/2195387399 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41b40542d0 con 0x7f41c40cafb0 2023-06-09T04:37:54.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.905+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41c40b66c0 con 0x7f41c40cafb0 2023-06-09T04:37:54.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.905+0000 7f41c0ff9700 1 -- 172.21.15.149:0/2195387399 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f41b40578f0 con 0x7f41c40cafb0 2023-06-09T04:37:54.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.907+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f41b006ace0 msgr2=0x7f41b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.907+0000 7f41ca640700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f41b006ace0 0x7f41b006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009130 tx=0x7f41b8008030 comp rx=0 tx=0).stop 2023-06-09T04:37:54.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.907+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40cafb0 msgr2=0x7f41c415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:54.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.907+0000 7f41ca640700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40cafb0 0x7f41c415d090 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f41b400b4a0 tx=0x7f41b400b860 comp rx=0 tx=0).stop 2023-06-09T04:37:54.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.907+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 shutdown_connections 2023-06-09T04:37:54.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.907+0000 7f41ca640700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f41b006ace0 0x7f41b006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.907+0000 7f41ca640700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41c415c170 0x7f41c40b4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.908+0000 7f41ca640700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c40cafb0 0x7f41c415d090 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.908+0000 7f41ca640700 1 --2- 172.21.15.149:0/2195387399 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f41c40ccf50 0x7f41c40b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:54.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.908+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 >> 172.21.15.149:0/2195387399 conn(0x7f41c4069db0 msgr2=0x7f41c415f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:54.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.908+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 shutdown_connections 2023-06-09T04:37:54.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:54.908+0000 7f41ca640700 1 -- 172.21.15.149:0/2195387399 wait complete. 2023-06-09T04:37:54.910 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-06-09T04:37:54.920 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-09T04:37:54.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:54.920 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-09T04:37:54.965 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T04:37:54.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:54.966 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T04:37:54.981 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:54.982 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:55.003 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:55.003 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:55.062 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T04:37:55.062 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:37:55.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:55.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.244+0000 7fe54dc95700 1 Processor -- start 2023-06-09T04:37:55.244 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.244+0000 7fe54dc95700 1 -- start start 2023-06-09T04:37:55.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe54dc95700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5480ceab0 0x7fe5480cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe54dc95700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe54815a6a0 0x7fe54815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe54dc95700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480cd770 con 0x7fe548157d30 2023-06-09T04:37:55.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe54dc95700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe548158100 con 0x7fe5480ceab0 2023-06-09T04:37:55.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe54dc95700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54815b020 con 0x7fe54815a6a0 2023-06-09T04:37:55.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe546ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5480ceab0 0x7fe5480cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe546ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe5480ceab0 0x7fe5480cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37838/0 (socket says 172.21.15.149:37838) 2023-06-09T04:37:55.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe546ffd700 1 -- 172.21.15.149:0/2418900822 learned_addr learned my addr 172.21.15.149:0/2418900822 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:55.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe547fff700 1 --2- 172.21.15.149:0/2418900822 >> v2:172.21.15.184:3300/0 conn(0x7fe54815a6a0 0x7fe54815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe546ffd700 1 -- 172.21.15.149:0/2418900822 >> v2:172.21.15.184:3300/0 conn(0x7fe54815a6a0 msgr2=0x7fe54815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:55.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe546ffd700 1 --2- 172.21.15.149:0/2418900822 >> v2:172.21.15.184:3300/0 conn(0x7fe54815a6a0 0x7fe54815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe546ffd700 1 -- 172.21.15.149:0/2418900822 >> v1:172.21.15.184:6789/0 conn(0x7fe548157d30 legacy=0x7fe5480ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:55.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe546ffd700 1 -- 172.21.15.149:0/2418900822 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54815b2d0 con 0x7fe5480ceab0 2023-06-09T04:37:55.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.245+0000 7fe547fff700 1 --2- 172.21.15.149:0/2418900822 >> v2:172.21.15.184:3300/0 conn(0x7fe54815a6a0 0x7fe54815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:55.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe546ffd700 1 --2- 172.21.15.149:0/2418900822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5480cdc00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe5480af9b0 tx=0x7fe530009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca494ee8fc956a56 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe5467fc700 1 -- 172.21.15.149:0/2418900822 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530004230 con 0x7fe5480ceab0 2023-06-09T04:37:55.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe5467fc700 1 -- 172.21.15.149:0/2418900822 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe530004390 con 0x7fe5480ceab0 2023-06-09T04:37:55.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe5467fc700 1 -- 172.21.15.149:0/2418900822 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300036a0 con 0x7fe5480ceab0 2023-06-09T04:37:55.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 -- 172.21.15.149:0/2418900822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 msgr2=0x7fe5480cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 --2- 172.21.15.149:0/2418900822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5480cdc00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe5480af9b0 tx=0x7fe530009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 -- 172.21.15.149:0/2418900822 shutdown_connections 2023-06-09T04:37:55.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 --2- 172.21.15.149:0/2418900822 >> v2:172.21.15.184:3300/0 conn(0x7fe54815a6a0 0x7fe54815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 --2- 172.21.15.149:0/2418900822 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5480cdc00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 -- 172.21.15.149:0/2418900822 >> 172.21.15.149:0/2418900822 conn(0x7fe54806a6d0 msgr2=0x7fe548099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:55.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 -- 172.21.15.149:0/2418900822 shutdown_connections 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.246+0000 7fe54dc95700 1 -- 172.21.15.149:0/2418900822 wait complete. 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.247+0000 7fe54dc95700 1 Processor -- start 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe54dc95700 1 -- start start 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe54dc95700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5481ef530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe54dc95700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe548157d30 0x7fe54815c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe54dc95700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54815a6a0 0x7fe5480b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe54dc95700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c4430 con 0x7fe5480ceab0 2023-06-09T04:37:55.252 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe54dc95700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c4710 con 0x7fe54815a6a0 2023-06-09T04:37:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe54dc95700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480c49f0 con 0x7fe548157d30 2023-06-09T04:37:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.248+0000 7fe5477fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5481ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5481ef530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37842/0 (socket says 172.21.15.149:37842) 2023-06-09T04:37:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 -- 172.21.15.149:0/3598975281 learned_addr learned my addr 172.21.15.149:0/3598975281 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe546ffd700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe548157d30 0x7fe54815c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe547fff700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54815a6a0 0x7fe5480b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 -- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe548157d30 msgr2=0x7fe54815c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe548157d30 0x7fe54815c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 -- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54815a6a0 msgr2=0x7fe5480b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54815a6a0 0x7fe5480b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 -- 172.21.15.149:0/3598975281 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009550 con 0x7fe5480ceab0 2023-06-09T04:37:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe546ffd700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe548157d30 0x7fe54815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe5477fe700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5481ef530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe53800c4b0 tx=0x7fe53800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe53ffff700 1 -- 172.21.15.149:0/3598975281 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538011790 con 0x7fe5480ceab0 2023-06-09T04:37:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe53ffff700 1 -- 172.21.15.149:0/3598975281 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5380118f0 con 0x7fe5480ceab0 2023-06-09T04:37:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480c4cd0 con 0x7fe5480ceab0 2023-06-09T04:37:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe53ffff700 1 -- 172.21.15.149:0/3598975281 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538011ca0 con 0x7fe5480ceab0 2023-06-09T04:37:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.249+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54815cb20 con 0x7fe5480ceab0 2023-06-09T04:37:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.250+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5480c4ec0 con 0x7fe5480ceab0 2023-06-09T04:37:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.250+0000 7fe53ffff700 1 -- 172.21.15.149:0/3598975281 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe53801c460 con 0x7fe5480ceab0 2023-06-09T04:37:55.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.251+0000 7fe53ffff700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe52806ace0 0x7fe52806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.251+0000 7fe53ffff700 1 -- 172.21.15.149:0/3598975281 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe538089630 con 0x7fe5480ceab0 2023-06-09T04:37:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.251+0000 7fe546ffd700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe52806ace0 0x7fe52806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.251+0000 7fe546ffd700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe52806ace0 0x7fe52806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe530009130 tx=0x7fe530008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.255+0000 7fe53ffff700 1 -- 172.21.15.149:0/3598975281 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5380543c0 con 0x7fe5480ceab0 2023-06-09T04:37:55.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.442+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5480c4570 con 0x7fe5480ceab0 2023-06-09T04:37:55.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.444+0000 7fe53ffff700 1 -- 172.21.15.149:0/3598975281 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7fe5480c4570 con 0x7fe5480ceab0 2023-06-09T04:37:55.444 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:55.444 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:55.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe52806ace0 msgr2=0x7fe52806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe52806ace0 0x7fe52806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe530009130 tx=0x7fe530008030 comp rx=0 tx=0).stop 2023-06-09T04:37:55.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 msgr2=0x7fe5481ef530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5481ef530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe53800c4b0 tx=0x7fe53800c870 comp rx=0 tx=0).stop 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 shutdown_connections 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe52806ace0 0x7fe52806d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54815a6a0 0x7fe5480b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5480ceab0 0x7fe5481ef530 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 --2- 172.21.15.149:0/3598975281 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe548157d30 0x7fe54815c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 >> 172.21.15.149:0/3598975281 conn(0x7fe54806a6d0 msgr2=0x7fe548158240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:55.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 shutdown_connections 2023-06-09T04:37:55.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.446+0000 7fe54dc95700 1 -- 172.21.15.149:0/3598975281 wait complete. 2023-06-09T04:37:55.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:55.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:55.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.583+0000 7fc3e95e7700 1 Processor -- start 2023-06-09T04:37:55.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.583+0000 7fc3e95e7700 1 -- start start 2023-06-09T04:37:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e95e7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3e40ce040 0x7fc3e415a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e95e7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e95e7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e415dad0 con 0x7fc3e415e7f0 2023-06-09T04:37:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e95e7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e415adc0 con 0x7fc3e40ce040 2023-06-09T04:37:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e95e7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e415b0a0 con 0x7fc3e40ae0e0 2023-06-09T04:37:55.586 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e2ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3e40ce040 0x7fc3e415a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e2ffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc3e40ce040 0x7fc3e415a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37850/0 (socket says 172.21.15.149:37850) 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.584+0000 7fc3e2ffd700 1 -- 172.21.15.149:0/2702397431 learned_addr learned my addr 172.21.15.149:0/2702397431 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e2ffd700 1 -- 172.21.15.149:0/2702397431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 msgr2=0x7fc3e415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e27fc700 1 --2- 172.21.15.149:0/2702397431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e2ffd700 1 --2- 172.21.15.149:0/2702397431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e415e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e2ffd700 1 -- 172.21.15.149:0/2702397431 >> v1:172.21.15.149:6789/0 conn(0x7fc3e415e7f0 legacy=0x7fc3e4070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e2ffd700 1 -- 172.21.15.149:0/2702397431 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e415b380 con 0x7fc3e40ce040 2023-06-09T04:37:55.587 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e27fc700 1 --2- 172.21.15.149:0/2702397431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e2ffd700 1 --2- 172.21.15.149:0/2702397431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e40ce040 0x7fc3e415a500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80098f0 tx=0x7fc3d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b6062d73c96a74 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e1ffb700 1 -- 172.21.15.149:0/2702397431 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800b8a0 con 0x7fc3e40ce040 2023-06-09T04:37:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e1ffb700 1 -- 172.21.15.149:0/2702397431 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d800ba00 con 0x7fc3e40ce040 2023-06-09T04:37:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e1ffb700 1 -- 172.21.15.149:0/2702397431 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800bd90 con 0x7fc3e40ce040 2023-06-09T04:37:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2702397431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e40ce040 msgr2=0x7fc3e415a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2702397431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e40ce040 0x7fc3e415a500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80098f0 tx=0x7fc3d8009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:55.588 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2702397431 shutdown_connections 2023-06-09T04:37:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2702397431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e40ce040 0x7fc3e415a500 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2702397431 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e415e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.585+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2702397431 >> 172.21.15.149:0/2702397431 conn(0x7fc3e40cee30 msgr2=0x7fc3e40cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.586+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2702397431 shutdown_connections 2023-06-09T04:37:55.589 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.586+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2702397431 wait complete. 2023-06-09T04:37:55.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.587+0000 7fc3e95e7700 1 Processor -- start 2023-06-09T04:37:55.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.587+0000 7fc3e95e7700 1 -- start start 2023-06-09T04:37:55.591 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e40afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e415e7f0 0x7fc3e40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3e415c8d0 0x7fc3e4153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41e4750 con 0x7fc3e415e7f0 2023-06-09T04:37:55.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40b12c0 con 0x7fc3e415c8d0 2023-06-09T04:37:55.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e41e3e20 con 0x7fc3e40ae0e0 2023-06-09T04:37:55.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e415e7f0 0x7fc3e40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.592 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e415e7f0 0x7fc3e40b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37858/0 (socket says 172.21.15.149:37858) 2023-06-09T04:37:55.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 -- 172.21.15.149:0/2230321607 learned_addr learned my addr 172.21.15.149:0/2230321607 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:55.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e2ffd700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e40afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e37fe700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3e415c8d0 0x7fc3e4153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 -- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 msgr2=0x7fc3e40afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e40afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 -- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3e415c8d0 msgr2=0x7fc3e4153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3e415c8d0 0x7fc3e4153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 -- 172.21.15.149:0/2230321607 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8009550 con 0x7fc3e415e7f0 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e2ffd700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e40afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e37fe700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3e415c8d0 0x7fc3e4153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e27fc700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e415e7f0 0x7fc3e40b0a70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400c750 tx=0x7fc3d400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3cb7fe700 1 -- 172.21.15.149:0/2230321607 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011800 con 0x7fc3e415e7f0 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3cb7fe700 1 -- 172.21.15.149:0/2230321607 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d4011960 con 0x7fc3e415e7f0 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e41e4100 con 0x7fc3e415e7f0 2023-06-09T04:37:55.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3cb7fe700 1 -- 172.21.15.149:0/2230321607 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011cd0 con 0x7fc3e415e7f0 2023-06-09T04:37:55.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.588+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e40b0fb0 con 0x7fc3e415e7f0 2023-06-09T04:37:55.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.589+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e40cb6b0 con 0x7fc3e415e7f0 2023-06-09T04:37:55.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.590+0000 7fc3cb7fe700 1 -- 172.21.15.149:0/2230321607 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3d4021350 con 0x7fc3e415e7f0 2023-06-09T04:37:55.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.590+0000 7fc3cb7fe700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3d006ace0 0x7fc3d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.590+0000 7fc3cb7fe700 1 -- 172.21.15.149:0/2230321607 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc3d4089750 con 0x7fc3e415e7f0 2023-06-09T04:37:55.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.590+0000 7fc3e2ffd700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3d006ace0 0x7fc3d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.591+0000 7fc3e2ffd700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3d006ace0 0x7fc3d006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4070700 tx=0x7fc3d8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.595+0000 7fc3cb7fe700 1 -- 172.21.15.149:0/2230321607 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3d4057f60 con 0x7fc3e415e7f0 2023-06-09T04:37:55.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.783+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc3e4073fa0 con 0x7fc3e415e7f0 2023-06-09T04:37:55.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.783+0000 7fc3cb7fe700 1 -- 172.21.15.149:0/2230321607 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3d4057af0 con 0x7fc3e415e7f0 2023-06-09T04:37:55.783 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:55.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3d006ace0 msgr2=0x7fc3d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.785 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3d006ace0 0x7fc3d006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4070700 tx=0x7fc3d8008030 comp rx=0 tx=0).stop 2023-06-09T04:37:55.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e415e7f0 msgr2=0x7fc3e40b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e415e7f0 0x7fc3e40b0a70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc3d400c750 tx=0x7fc3d400cb10 comp rx=0 tx=0).stop 2023-06-09T04:37:55.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 shutdown_connections 2023-06-09T04:37:55.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc3d006ace0 0x7fc3d006d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc3e40ae0e0 0x7fc3e40afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc3e415c8d0 0x7fc3e4153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.786 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 --2- 172.21.15.149:0/2230321607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc3e415e7f0 0x7fc3e40b0a70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 >> 172.21.15.149:0/2230321607 conn(0x7fc3e40cee30 msgr2=0x7fc3e415be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:55.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 shutdown_connections 2023-06-09T04:37:55.787 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.785+0000 7fc3e95e7700 1 -- 172.21.15.149:0/2230321607 wait complete. 2023-06-09T04:37:55.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:55.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.920+0000 7fc8cb857700 1 Processor -- start 2023-06-09T04:37:55.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.921+0000 7fc8cb857700 1 -- start start 2023-06-09T04:37:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.921+0000 7fc8cb857700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8c40ccb00 0x7fc8c40d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.921+0000 7fc8cb857700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.921+0000 7fc8cb857700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c415c750 con 0x7fc8c40b43f0 2023-06-09T04:37:55.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.921+0000 7fc8cb857700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c40ccfc0 con 0x7fc8c40ccb00 2023-06-09T04:37:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.921+0000 7fc8cb857700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c40cf740 con 0x7fc8c40b4ed0 2023-06-09T04:37:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.921+0000 7fc8c8df2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8c40ccb00 0x7fc8c40d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c8df2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fc8c40ccb00 0x7fc8c40d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37866/0 (socket says 172.21.15.149:37866) 2023-06-09T04:37:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c8df2700 1 -- 172.21.15.149:0/3650804558 learned_addr learned my addr 172.21.15.149:0/3650804558 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c9df4700 1 --2- 172.21.15.149:0/3650804558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c8df2700 1 -- 172.21.15.149:0/3650804558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 msgr2=0x7fc8c40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:55.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c8df2700 1 --2- 172.21.15.149:0/3650804558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c40d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c8df2700 1 -- 172.21.15.149:0/3650804558 >> v1:172.21.15.184:6789/0 conn(0x7fc8c40b43f0 legacy=0x7fc8c40b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c8df2700 1 -- 172.21.15.149:0/3650804558 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40cd540 con 0x7fc8c40ccb00 2023-06-09T04:37:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c9df4700 1 --2- 172.21.15.149:0/3650804558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8c8df2700 1 --2- 172.21.15.149:0/3650804558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40ccb00 0x7fc8c40d0640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00098f0 tx=0x7fc8c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd09e9d137af1ea server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8bbfff700 1 -- 172.21.15.149:0/3650804558 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0004230 con 0x7fc8c40ccb00 2023-06-09T04:37:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8bbfff700 1 -- 172.21.15.149:0/3650804558 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c0004390 con 0x7fc8c40ccb00 2023-06-09T04:37:55.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.922+0000 7fc8bbfff700 1 -- 172.21.15.149:0/3650804558 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c00036a0 con 0x7fc8c40ccb00 2023-06-09T04:37:55.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 -- 172.21.15.149:0/3650804558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40ccb00 msgr2=0x7fc8c40d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3650804558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40ccb00 0x7fc8c40d0640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00098f0 tx=0x7fc8c0009c00 comp rx=0 tx=0).stop 2023-06-09T04:37:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 -- 172.21.15.149:0/3650804558 shutdown_connections 2023-06-09T04:37:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3650804558 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3650804558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40ccb00 0x7fc8c40d0640 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 -- 172.21.15.149:0/3650804558 >> 172.21.15.149:0/3650804558 conn(0x7fc8c4072120 msgr2=0x7fc8c406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 -- 172.21.15.149:0/3650804558 shutdown_connections 2023-06-09T04:37:55.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.923+0000 7fc8cb857700 1 -- 172.21.15.149:0/3650804558 wait complete. 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.924+0000 7fc8cb857700 1 Processor -- start 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.924+0000 7fc8cb857700 1 -- start start 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8cb857700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40b43f0 0x7fc8c415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8cb857700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8cb857700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c40ccb00 0x7fc8c40d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8cb857700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415f220 con 0x7fc8c40b43f0 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8cb857700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415dc40 con 0x7fc8c40ccb00 2023-06-09T04:37:55.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8cb857700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c415df20 con 0x7fc8c40b4ed0 2023-06-09T04:37:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40b43f0 0x7fc8c415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40b43f0 0x7fc8c415d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37870/0 (socket says 172.21.15.149:37870) 2023-06-09T04:37:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 -- 172.21.15.149:0/3242194931 learned_addr learned my addr 172.21.15.149:0/3242194931 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c8df2700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c9df4700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c40ccb00 0x7fc8c40d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 -- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 msgr2=0x7fc8c415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.929 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c415ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 -- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c40ccb00 msgr2=0x7fc8c40d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c40ccb00 0x7fc8c40d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 -- 172.21.15.149:0/3242194931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0009550 con 0x7fc8c40b43f0 2023-06-09T04:37:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8c95f3700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40b43f0 0x7fc8c415d660 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b4a0 tx=0x7fc8b400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8b9ffb700 1 -- 172.21.15.149:0/3242194931 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4011830 con 0x7fc8c40b43f0 2023-06-09T04:37:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8b9ffb700 1 -- 172.21.15.149:0/3242194931 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4011990 con 0x7fc8c40b43f0 2023-06-09T04:37:55.930 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c415e200 con 0x7fc8c40b43f0 2023-06-09T04:37:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.925+0000 7fc8b9ffb700 1 -- 172.21.15.149:0/3242194931 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4011d40 con 0x7fc8c40b43f0 2023-06-09T04:37:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.926+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c415e7c0 con 0x7fc8c40b43f0 2023-06-09T04:37:55.931 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.927+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c4073fa0 con 0x7fc8c40b43f0 2023-06-09T04:37:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.927+0000 7fc8b9ffb700 1 -- 172.21.15.149:0/3242194931 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8b401a400 con 0x7fc8c40b43f0 2023-06-09T04:37:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.927+0000 7fc8b9ffb700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc8a806ace0 0x7fc8a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.927+0000 7fc8b9ffb700 1 -- 172.21.15.149:0/3242194931 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc8b4089410 con 0x7fc8c40b43f0 2023-06-09T04:37:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.927+0000 7fc8c8df2700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc8a806ace0 0x7fc8a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.928+0000 7fc8c8df2700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc8a806ace0 0x7fc8a806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00098f0 tx=0x7fc8c0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:55.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:55.932+0000 7fc8b9ffb700 1 -- 172.21.15.149:0/3242194931 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc8b4054190 con 0x7fc8c40b43f0 2023-06-09T04:37:56.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.116+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8c40b7f90 con 0x7fc8c40b43f0 2023-06-09T04:37:56.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.117+0000 7fc8b9ffb700 1 -- 172.21.15.149:0/3242194931 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8b40577b0 con 0x7fc8c40b43f0 2023-06-09T04:37:56.117 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:56.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc8a806ace0 msgr2=0x7fc8a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc8a806ace0 0x7fc8a806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00098f0 tx=0x7fc8c0008030 comp rx=0 tx=0).stop 2023-06-09T04:37:56.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40b43f0 msgr2=0x7fc8c415d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40b43f0 0x7fc8c415d660 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc8b400b4a0 tx=0x7fc8b400b7b0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 shutdown_connections 2023-06-09T04:37:56.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc8a806ace0 0x7fc8a806d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8c40ccb00 0x7fc8c40d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc8c40b43f0 0x7fc8c415d660 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 --2- 172.21.15.149:0/3242194931 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc8c40b4ed0 0x7fc8c415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 >> 172.21.15.149:0/3242194931 conn(0x7fc8c4072120 msgr2=0x7fc8c40b77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:56.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 shutdown_connections 2023-06-09T04:37:56.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.119+0000 7fc8cb857700 1 -- 172.21.15.149:0/3242194931 wait complete. 2023-06-09T04:37:56.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:56.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.254+0000 7f65bac28700 1 Processor -- start 2023-06-09T04:37:56.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.254+0000 7f65bac28700 1 -- start start 2023-06-09T04:37:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65bac28700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 0x7f65b40716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65bac28700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b406f480 con 0x7f65b4159380 2023-06-09T04:37:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65bac28700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b406f760 con 0x7f65b40cd930 2023-06-09T04:37:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65bac28700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40b10d0 con 0x7f65b40b1dc0 2023-06-09T04:37:56.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b89c4700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f65b4159380 0x7f65b40cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33510/0 (socket says 172.21.15.149:33510) 2023-06-09T04:37:56.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b89c4700 1 -- 172.21.15.149:0/2881942800 learned_addr learned my addr 172.21.15.149:0/2881942800 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b91c5700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 0x7f65b40716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511325054 0 0) 0x7f65b406f480 con 0x7f65b4159380 2023-06-09T04:37:56.258 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a40035b0 con 0x7f65b4159380 2023-06-09T04:37:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2567135570 0 0) 0x7f65a40035b0 con 0x7f65b4159380 2023-06-09T04:37:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 msgr2=0x7f65b40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 0x7f65b40716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 >> v1:172.21.15.184:6789/0 conn(0x7f65b40cd930 legacy=0x7f65b40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40b12e0 con 0x7f65b4159380 2023-06-09T04:37:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f65a8001670 con 0x7f65b4159380 2023-06-09T04:37:56.259 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 >> v1:172.21.15.149:6789/0 conn(0x7f65b4159380 legacy=0x7f65b40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a4003a30 0x7f65a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 0x7f65a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a4004d90 0x7f65a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40b10d0 con 0x7f65a4004d90 2023-06-09T04:37:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a400bac0 con 0x7f65a4003a30 2023-06-09T04:37:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.255+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a400bc50 con 0x7f65b40b1dc0 2023-06-09T04:37:56.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b91c5700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a4004d90 0x7f65a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b89c4700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a4003a30 0x7f65a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b3fff700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 0x7f65a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b91c5700 1 -- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 msgr2=0x7f65a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b91c5700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65b40b1dc0 0x7f65a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b91c5700 1 -- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a4003a30 msgr2=0x7f65a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b91c5700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65a4003a30 0x7f65a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b91c5700 1 -- 172.21.15.149:0/2881942800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40035b0 con 0x7f65a4004d90 2023-06-09T04:37:56.261 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b91c5700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a4004d90 0x7f65a4005200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009f90 tx=0x7f65a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f133abbf29d62bc2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00ec30 con 0x7f65a4004d90 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00f040 con 0x7f65a4004d90 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.256+0000 7f65b37fe700 1 -- 172.21.15.149:0/2881942800 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac014480 con 0x7f65a4004d90 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.257+0000 7f65bac28700 1 -- 172.21.15.149:0/2881942800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a4004d90 msgr2=0x7f65a4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.257+0000 7f65bac28700 1 --2- 172.21.15.149:0/2881942800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65a4004d90 0x7f65a4005200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009f90 tx=0x7f65a4005880 comp rx=0 tx=0).stop 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.257+0000 7f65b91c5700 1 -- 172.21.15.149:0/2881942800 reap_dead start 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.257+0000 7f65bac28700 1 -- 172.21.15.149:0/2881942800 shutdown_connections 2023-06-09T04:37:56.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.257+0000 7f65bac28700 1 -- 172.21.15.149:0/2881942800 >> 172.21.15.149:0/2881942800 conn(0x7f65b406aec0 msgr2=0x7f65b406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:56.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.257+0000 7f65bac28700 1 -- 172.21.15.149:0/2881942800 shutdown_connections 2023-06-09T04:37:56.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.257+0000 7f65bac28700 1 -- 172.21.15.149:0/2881942800 wait complete. 2023-06-09T04:37:56.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.258+0000 7f65bac28700 1 Processor -- start 2023-06-09T04:37:56.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.258+0000 7f65bac28700 1 -- start start 2023-06-09T04:37:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65bac28700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a4004d90 0x7f65b4154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65bac28700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b415aa90 0x7f65b4150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65bac28700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65b415af00 0x7f65b40b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65bac28700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b415c760 con 0x7f65b415af00 2023-06-09T04:37:56.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65bac28700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40ae990 con 0x7f65b415aa90 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65bac28700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b415c1a0 con 0x7f65a4004d90 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65b415af00 0x7f65b40b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65b415af00 0x7f65b40b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37894/0 (socket says 172.21.15.149:37894) 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 -- 172.21.15.149:0/443500592 learned_addr learned my addr 172.21.15.149:0/443500592 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b3fff700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b415aa90 0x7f65b4150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b89c4700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a4004d90 0x7f65b4154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 -- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a4004d90 msgr2=0x7f65b4154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a4004d90 0x7f65b4154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 -- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b415aa90 msgr2=0x7f65b4150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b415aa90 0x7f65b4150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 -- 172.21.15.149:0/443500592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b415c480 con 0x7f65b415af00 2023-06-09T04:37:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.259+0000 7f65b91c5700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65b415af00 0x7f65b40b2db0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f65ac017040 tx=0x7f65ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.260+0000 7f65b17fa700 1 -- 172.21.15.149:0/443500592 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac007000 con 0x7f65b415af00 2023-06-09T04:37:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.260+0000 7f65b17fa700 1 -- 172.21.15.149:0/443500592 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac004470 con 0x7f65b415af00 2023-06-09T04:37:56.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.260+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b40abca0 con 0x7f65b415af00 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.260+0000 7f65b17fa700 1 -- 172.21.15.149:0/443500592 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac004820 con 0x7f65b415af00 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.260+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b41554c0 con 0x7f65b415af00 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.260+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b40abb00 con 0x7f65b415af00 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.261+0000 7f65b17fa700 1 -- 172.21.15.149:0/443500592 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f65ac023070 con 0x7f65b415af00 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.261+0000 7f65b17fa700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f659806ace0 0x7f659806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.261+0000 7f65b17fa700 1 -- 172.21.15.149:0/443500592 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f65ac08abc0 con 0x7f65b415af00 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.261+0000 7f65b89c4700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f659806ace0 0x7f659806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.262+0000 7f65b89c4700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f659806ace0 0x7f659806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000c00 tx=0x7f65a8000f80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.266+0000 7f65b17fa700 1 -- 172.21.15.149:0/443500592 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f65b40abb00 con 0x7f65b415af00 2023-06-09T04:37:56.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.454+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65b40ac1c0 con 0x7f65b415af00 2023-06-09T04:37:56.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.455+0000 7f65b17fa700 1 -- 172.21.15.149:0/443500592 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65b40ac1c0 con 0x7f65b415af00 2023-06-09T04:37:56.455 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:56.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f659806ace0 msgr2=0x7f659806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f659806ace0 0x7f659806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000c00 tx=0x7f65a8000f80 comp rx=0 tx=0).stop 2023-06-09T04:37:56.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65b415af00 msgr2=0x7f65b40b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65b415af00 0x7f65b40b2db0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f65ac017040 tx=0x7f65ac009750 comp rx=0 tx=0).stop 2023-06-09T04:37:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 shutdown_connections 2023-06-09T04:37:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f659806ace0 0x7f659806d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f65a4004d90 0x7f65b4154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f65b415af00 0x7f65b40b2db0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 --2- 172.21.15.149:0/443500592 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65b415aa90 0x7f65b4150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 >> 172.21.15.149:0/443500592 conn(0x7f65b406aec0 msgr2=0x7f65b40af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:56.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 shutdown_connections 2023-06-09T04:37:56.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.457+0000 7f65bac28700 1 -- 172.21.15.149:0/443500592 wait complete. 2023-06-09T04:37:56.469 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:56.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.593+0000 7f3f4a85f700 1 Processor -- start 2023-06-09T04:37:56.593 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.593+0000 7f3f4a85f700 1 -- start start 2023-06-09T04:37:56.594 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f4a85f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3f440ccb00 0x7f3f440d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f4a85f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f440b4ed0 0x7f3f440d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f4a85f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4415c750 con 0x7f3f440b43f0 2023-06-09T04:37:56.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f4a85f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440ccfc0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f4a85f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440cf740 con 0x7f3f440ccb00 2023-06-09T04:37:56.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f440b4ed0 0x7f3f440d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3f440b4ed0 0x7f3f440d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37902/0 (socket says 172.21.15.149:37902) 2023-06-09T04:37:56.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 -- 172.21.15.149:0/1177925156 learned_addr learned my addr 172.21.15.149:0/1177925156 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:56.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f437fe700 1 --2- 172.21.15.149:0/1177925156 >> v2:172.21.15.184:3300/0 conn(0x7f3f440ccb00 0x7f3f440d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 -- 172.21.15.149:0/1177925156 >> v2:172.21.15.184:3300/0 conn(0x7f3f440ccb00 msgr2=0x7f3f440d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:56.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 --2- 172.21.15.149:0/1177925156 >> v2:172.21.15.184:3300/0 conn(0x7f3f440ccb00 0x7f3f440d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 -- 172.21.15.149:0/1177925156 >> v1:172.21.15.184:6789/0 conn(0x7f3f440b43f0 legacy=0x7f3f440b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 -- 172.21.15.149:0/1177925156 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440cd540 con 0x7f3f440b4ed0 2023-06-09T04:37:56.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f437fe700 1 --2- 172.21.15.149:0/1177925156 >> v2:172.21.15.184:3300/0 conn(0x7f3f440ccb00 0x7f3f440d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:56.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f48dfc700 1 --2- 172.21.15.149:0/1177925156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f440d0b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3f440d2890 tx=0x7f3f3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ae7d43368c2932 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f42ffd700 1 -- 172.21.15.149:0/1177925156 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00e070 con 0x7f3f440b4ed0 2023-06-09T04:37:56.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f42ffd700 1 -- 172.21.15.149:0/1177925156 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00b9c0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.597 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.594+0000 7f3f42ffd700 1 -- 172.21.15.149:0/1177925156 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00bd70 con 0x7f3f440b4ed0 2023-06-09T04:37:56.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 -- 172.21.15.149:0/1177925156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 msgr2=0x7f3f440d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/1177925156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f440d0b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3f440d2890 tx=0x7f3f3c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:56.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 -- 172.21.15.149:0/1177925156 shutdown_connections 2023-06-09T04:37:56.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/1177925156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f440d0b80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/1177925156 >> v2:172.21.15.184:3300/0 conn(0x7f3f440ccb00 0x7f3f440d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 -- 172.21.15.149:0/1177925156 >> 172.21.15.149:0/1177925156 conn(0x7f3f44072120 msgr2=0x7f3f4406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:56.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 -- 172.21.15.149:0/1177925156 shutdown_connections 2023-06-09T04:37:56.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.595+0000 7f3f4a85f700 1 -- 172.21.15.149:0/1177925156 wait complete. 2023-06-09T04:37:56.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.596+0000 7f3f4a85f700 1 Processor -- start 2023-06-09T04:37:56.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.596+0000 7f3f4a85f700 1 -- start start 2023-06-09T04:37:56.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f4a85f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f440b43f0 0x7f3f4415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f4a85f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f441f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.601 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f4a85f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f440ccb00 0x7f3f44153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f4a85f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4415e9f0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f4a85f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4415db50 con 0x7f3f440b43f0 2023-06-09T04:37:56.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f4a85f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4415e0c0 con 0x7f3f440ccb00 2023-06-09T04:37:56.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f441f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f437fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f441f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37906/0 (socket says 172.21.15.149:37906) 2023-06-09T04:37:56.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.597+0000 7f3f437fe700 1 -- 172.21.15.149:0/3242279700 learned_addr learned my addr 172.21.15.149:0/3242279700 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:56.602 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f43fff700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f440b43f0 0x7f3f4415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f437fe700 1 -- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f440ccb00 msgr2=0x7f3f44153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f48dfc700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f440ccb00 0x7f3f44153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f437fe700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f440ccb00 0x7f3f44153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f437fe700 1 -- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f440b43f0 msgr2=0x7f3f4415d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f437fe700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f440b43f0 0x7f3f4415d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f437fe700 1 -- 172.21.15.149:0/3242279700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c009b30 con 0x7f3f440b4ed0 2023-06-09T04:37:56.603 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f437fe700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f441f4ea0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e840 tx=0x7f3f3800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f40ff9700 1 -- 172.21.15.149:0/3242279700 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800c030 con 0x7f3f440b4ed0 2023-06-09T04:37:56.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f40ff9700 1 -- 172.21.15.149:0/3242279700 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38013610 con 0x7f3f440b4ed0 2023-06-09T04:37:56.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4415e3a0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f40ff9700 1 -- 172.21.15.149:0/3242279700 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f380139a0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.598+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4415d840 con 0x7f3f440b4ed0 2023-06-09T04:37:56.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.599+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f44073fa0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.604 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.599+0000 7f3f40ff9700 1 -- 172.21.15.149:0/3242279700 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f38013b00 con 0x7f3f440b4ed0 2023-06-09T04:37:56.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.600+0000 7f3f40ff9700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f3006ace0 0x7f3f3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.600+0000 7f3f40ff9700 1 -- 172.21.15.149:0/3242279700 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f380891e0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.600+0000 7f3f43fff700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f3006ace0 0x7f3f3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.605 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.600+0000 7f3f43fff700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f3006ace0 0x7f3f3006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3f34000f60 tx=0x7f3f34009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.606 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.604+0000 7f3f40ff9700 1 -- 172.21.15.149:0/3242279700 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3f380579f0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.795 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.795+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f4406b8e0 con 0x7f3f440b4ed0 2023-06-09T04:37:56.796 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.795+0000 7f3f40ff9700 1 -- 172.21.15.149:0/3242279700 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f38057580 con 0x7f3f440b4ed0 2023-06-09T04:37:56.796 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f3006ace0 msgr2=0x7f3f3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f3006ace0 0x7f3f3006d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3f34000f60 tx=0x7f3f34009040 comp rx=0 tx=0).stop 2023-06-09T04:37:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 msgr2=0x7f3f441f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f441f4ea0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800e840 tx=0x7f3f3800ec00 comp rx=0 tx=0).stop 2023-06-09T04:37:56.798 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 shutdown_connections 2023-06-09T04:37:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3f3006ace0 0x7f3f3006d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3f440ccb00 0x7f3f44153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f440b43f0 0x7f3f4415d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 --2- 172.21.15.149:0/3242279700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3f440b4ed0 0x7f3f441f4ea0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 >> 172.21.15.149:0/3242279700 conn(0x7f3f44072120 msgr2=0x7f3f440b7850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 shutdown_connections 2023-06-09T04:37:56.799 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.798+0000 7f3f4a85f700 1 -- 172.21.15.149:0/3242279700 wait complete. 2023-06-09T04:37:56.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:56.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.933+0000 7fb96b9d9700 1 Processor -- start 2023-06-09T04:37:56.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.933+0000 7fb96b9d9700 1 -- start start 2023-06-09T04:37:56.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb96b9d9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb9640cf5b0 0x7fb9640cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb96b9d9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb96415e340 0x7fb9640cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb96b9d9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640cda20 con 0x7fb9640b60a0 2023-06-09T04:37:56.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb96b9d9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9640b6470 con 0x7fb96415e340 2023-06-09T04:37:56.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb96b9d9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96415e7a0 con 0x7fb9640cf5b0 2023-06-09T04:37:56.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb96415e340 0x7fb9640cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb96415e340 0x7fb9640cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37916/0 (socket says 172.21.15.149:37916) 2023-06-09T04:37:56.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 -- 172.21.15.149:0/3338780289 learned_addr learned my addr 172.21.15.149:0/3338780289 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:56.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb968f74700 1 --2- 172.21.15.149:0/3338780289 >> v2:172.21.15.184:3300/0 conn(0x7fb9640cf5b0 0x7fb9640cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 -- 172.21.15.149:0/3338780289 >> v2:172.21.15.184:3300/0 conn(0x7fb9640cf5b0 msgr2=0x7fb9640cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:56.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 --2- 172.21.15.149:0/3338780289 >> v2:172.21.15.184:3300/0 conn(0x7fb9640cf5b0 0x7fb9640cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 -- 172.21.15.149:0/3338780289 >> v1:172.21.15.184:6789/0 conn(0x7fb9640b60a0 legacy=0x7fb96415dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 -- 172.21.15.149:0/3338780289 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96415a520 con 0x7fb96415e340 2023-06-09T04:37:56.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb968f74700 1 --2- 172.21.15.149:0/3338780289 >> v2:172.21.15.184:3300/0 conn(0x7fb9640cf5b0 0x7fb9640cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:56.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb969f76700 1 --2- 172.21.15.149:0/3338780289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb96415e340 0x7fb9640cfb00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb9640cbd90 tx=0x7fb95c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7199996e7053c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb95bfff700 1 -- 172.21.15.149:0/3338780289 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00e070 con 0x7fb96415e340 2023-06-09T04:37:56.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb95bfff700 1 -- 172.21.15.149:0/3338780289 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c00b9c0 con 0x7fb96415e340 2023-06-09T04:37:56.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.934+0000 7fb95bfff700 1 -- 172.21.15.149:0/3338780289 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00bd70 con 0x7fb96415e340 2023-06-09T04:37:56.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 -- 172.21.15.149:0/3338780289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb96415e340 msgr2=0x7fb9640cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/3338780289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb96415e340 0x7fb9640cfb00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb9640cbd90 tx=0x7fb95c00b330 comp rx=0 tx=0).stop 2023-06-09T04:37:56.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 -- 172.21.15.149:0/3338780289 shutdown_connections 2023-06-09T04:37:56.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/3338780289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb96415e340 0x7fb9640cfb00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/3338780289 >> v2:172.21.15.184:3300/0 conn(0x7fb9640cf5b0 0x7fb9640cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 -- 172.21.15.149:0/3338780289 >> 172.21.15.149:0/3338780289 conn(0x7fb964069db0 msgr2=0x7fb96406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:56.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 -- 172.21.15.149:0/3338780289 shutdown_connections 2023-06-09T04:37:56.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.935+0000 7fb96b9d9700 1 -- 172.21.15.149:0/3338780289 wait complete. 2023-06-09T04:37:56.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.936+0000 7fb96b9d9700 1 Processor -- start 2023-06-09T04:37:56.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.936+0000 7fb96b9d9700 1 -- start start 2023-06-09T04:37:56.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb96b9d9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9640b60a0 0x7fb964152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb96b9d9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9640cf5b0 0x7fb9640c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb96b9d9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb96415e340 0x7fb964153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb96b9d9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964153220 con 0x7fb9640b60a0 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb96b9d9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96415a710 con 0x7fb96415e340 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb96b9d9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96415a960 con 0x7fb9640cf5b0 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9640b60a0 0x7fb964152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9640b60a0 0x7fb964152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37918/0 (socket says 172.21.15.149:37918) 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 -- 172.21.15.149:0/922981270 learned_addr learned my addr 172.21.15.149:0/922981270 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:56.941 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb968f74700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9640cf5b0 0x7fb9640c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969f76700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb96415e340 0x7fb964153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 -- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9640cf5b0 msgr2=0x7fb9640c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9640cf5b0 0x7fb9640c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 -- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb96415e340 msgr2=0x7fb964153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:56.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb96415e340 0x7fb964153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:56.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.937+0000 7fb969775700 1 -- 172.21.15.149:0/922981270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c009b30 con 0x7fb9640b60a0 2023-06-09T04:37:56.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.938+0000 7fb969775700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9640b60a0 0x7fb964152ce0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c480 tx=0x7fb96000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.938+0000 7fb959ffb700 1 -- 172.21.15.149:0/922981270 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600052d0 con 0x7fb9640b60a0 2023-06-09T04:37:56.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.938+0000 7fb959ffb700 1 -- 172.21.15.149:0/922981270 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb960005430 con 0x7fb9640b60a0 2023-06-09T04:37:56.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.938+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96415ac40 con 0x7fb9640b60a0 2023-06-09T04:37:56.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.938+0000 7fb959ffb700 1 -- 172.21.15.149:0/922981270 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600038c0 con 0x7fb9640b60a0 2023-06-09T04:37:56.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.938+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96415b200 con 0x7fb9640b60a0 2023-06-09T04:37:56.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.939+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb964073fa0 con 0x7fb9640b60a0 2023-06-09T04:37:56.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.939+0000 7fb959ffb700 1 -- 172.21.15.149:0/922981270 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb960003a20 con 0x7fb9640b60a0 2023-06-09T04:37:56.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.940+0000 7fb959ffb700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb94806ace0 0x7fb94806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:56.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.940+0000 7fb959ffb700 1 -- 172.21.15.149:0/922981270 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb960088b70 con 0x7fb9640b60a0 2023-06-09T04:37:56.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.940+0000 7fb968f74700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb94806ace0 0x7fb94806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:56.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.940+0000 7fb968f74700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb94806ace0 0x7fb94806d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9641f3060 tx=0x7fb954008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:56.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:56.944+0000 7fb959ffb700 1 -- 172.21.15.149:0/922981270 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb960053980 con 0x7fb9640b60a0 2023-06-09T04:37:57.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.134+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb9640b2790 con 0x7fb9640b60a0 2023-06-09T04:37:57.135 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.135+0000 7fb959ffb700 1 -- 172.21.15.149:0/922981270 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb960017020 con 0x7fb9640b60a0 2023-06-09T04:37:57.135 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:57.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb94806ace0 msgr2=0x7fb94806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb94806ace0 0x7fb94806d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9641f3060 tx=0x7fb954008040 comp rx=0 tx=0).stop 2023-06-09T04:37:57.137 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9640b60a0 msgr2=0x7fb964152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9640b60a0 0x7fb964152ce0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c480 tx=0x7fb96000c840 comp rx=0 tx=0).stop 2023-06-09T04:37:57.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 shutdown_connections 2023-06-09T04:37:57.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb94806ace0 0x7fb94806d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb96415e340 0x7fb964153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb9640b60a0 0x7fb964152ce0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 --2- 172.21.15.149:0/922981270 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb9640cf5b0 0x7fb9640c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.138 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 >> 172.21.15.149:0/922981270 conn(0x7fb964069db0 msgr2=0x7fb9640b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:57.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 shutdown_connections 2023-06-09T04:37:57.139 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.137+0000 7fb96b9d9700 1 -- 172.21.15.149:0/922981270 wait complete. 2023-06-09T04:37:57.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:37:57.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.269+0000 7f7e6f47f700 1 Processor -- start 2023-06-09T04:37:57.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.270+0000 7f7e6f47f700 1 -- start start 2023-06-09T04:37:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.270+0000 7f7e6f47f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6815f630 0x7f7e68069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.270+0000 7f7e6f47f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7e6806db50 0x7f7e680cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.270+0000 7f7e6f47f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e68070900 con 0x7f7e680cd910 2023-06-09T04:37:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.270+0000 7f7e6f47f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680ce2c0 con 0x7f7e6806db50 2023-06-09T04:37:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.270+0000 7f7e6f47f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68070be0 con 0x7f7e6815f630 2023-06-09T04:37:57.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6da1c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7e6806db50 0x7f7e680cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6d21b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6815f630 0x7f7e68069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6da1c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7e6806db50 0x7f7e680cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:57194/0 (socket says 172.21.15.149:57194) 2023-06-09T04:37:57.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6da1c700 1 -- 172.21.15.149:0/584366078 learned_addr learned my addr 172.21.15.149:0/584366078 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:57.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6d21b700 1 -- 172.21.15.149:0/584366078 >> v2:172.21.15.184:3300/0 conn(0x7f7e6806db50 msgr2=0x7f7e680cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:57.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6d21b700 1 --2- 172.21.15.149:0/584366078 >> v2:172.21.15.184:3300/0 conn(0x7f7e6806db50 0x7f7e680cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6d21b700 1 -- 172.21.15.149:0/584366078 >> v1:172.21.15.184:6789/0 conn(0x7f7e680cd910 legacy=0x7f7e6806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e5ffff700 1 -- 172.21.15.149:0/584366078 <== mon.1 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88740673 0 0) 0x7f7e68070900 con 0x7f7e680cd910 2023-06-09T04:37:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6d21b700 1 -- 172.21.15.149:0/584366078 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6815fa00 con 0x7f7e6815f630 2023-06-09T04:37:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6da1c700 1 --2- 172.21.15.149:0/584366078 >> v2:172.21.15.184:3300/0 conn(0x7f7e6806db50 0x7f7e680cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.271+0000 7f7e6d21b700 1 --2- 172.21.15.149:0/584366078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6815f630 0x7f7e68069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009840 tx=0x7f7e58009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48ed6ef11468b611 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e5ffff700 1 -- 172.21.15.149:0/584366078 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58011830 con 0x7f7e6815f630 2023-06-09T04:37:57.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e5ffff700 1 -- 172.21.15.149:0/584366078 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e58011990 con 0x7f7e6815f630 2023-06-09T04:37:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e5ffff700 1 -- 172.21.15.149:0/584366078 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e58011d20 con 0x7f7e6815f630 2023-06-09T04:37:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 -- 172.21.15.149:0/584366078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6815f630 msgr2=0x7f7e68069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/584366078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6815f630 0x7f7e68069db0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009840 tx=0x7f7e58009b50 comp rx=0 tx=0).stop 2023-06-09T04:37:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 -- 172.21.15.149:0/584366078 shutdown_connections 2023-06-09T04:37:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/584366078 >> v2:172.21.15.184:3300/0 conn(0x7f7e6806db50 0x7f7e680cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/584366078 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6815f630 0x7f7e68069db0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.275 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 -- 172.21.15.149:0/584366078 >> 172.21.15.149:0/584366078 conn(0x7f7e680cee30 msgr2=0x7f7e680cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 -- 172.21.15.149:0/584366078 shutdown_connections 2023-06-09T04:37:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.272+0000 7f7e6f47f700 1 -- 172.21.15.149:0/584366078 wait complete. 2023-06-09T04:37:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.273+0000 7f7e6f47f700 1 Processor -- start 2023-06-09T04:37:57.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.273+0000 7f7e6f47f700 1 -- start start 2023-06-09T04:37:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6f47f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6806db50 0x7f7e681e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6f47f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e680cd910 0x7f7e681f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6f47f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e6815f630 0x7f7e680c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6f47f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680adf10 con 0x7f7e680cd910 2023-06-09T04:37:57.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6f47f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681f52b0 con 0x7f7e6815f630 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6f47f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681e6bc0 con 0x7f7e6806db50 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6ca1a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e680cd910 0x7f7e681f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6d21b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6806db50 0x7f7e681e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6ca1a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e680cd910 0x7f7e681f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37934/0 (socket says 172.21.15.149:37934) 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6ca1a700 1 -- 172.21.15.149:0/4061820577 learned_addr learned my addr 172.21.15.149:0/4061820577 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.274+0000 7f7e6da1c700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e6815f630 0x7f7e680c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6ca1a700 1 -- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6806db50 msgr2=0x7f7e681e64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6ca1a700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6806db50 0x7f7e681e64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6ca1a700 1 -- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e6815f630 msgr2=0x7f7e680c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6ca1a700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e6815f630 0x7f7e680c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6ca1a700 1 -- 172.21.15.149:0/4061820577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009b30 con 0x7f7e680cd910 2023-06-09T04:37:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6d21b700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6806db50 0x7f7e681e64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6da1c700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e6815f630 0x7f7e680c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:37:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6ca1a700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e680cd910 0x7f7e681f4d70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e640011e0 tx=0x7f7e6400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e5dffb700 1 -- 172.21.15.149:0/4061820577 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e640054e0 con 0x7f7e680cd910 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e5dffb700 1 -- 172.21.15.149:0/4061820577 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64003680 con 0x7f7e680cd910 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e580094a0 con 0x7f7e680cd910 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e5dffb700 1 -- 172.21.15.149:0/4061820577 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64003a30 con 0x7f7e680cd910 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.275+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e681e7180 con 0x7f7e680cd910 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.276+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68073fa0 con 0x7f7e680cd910 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.276+0000 7f7e5dffb700 1 -- 172.21.15.149:0/4061820577 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e64003b90 con 0x7f7e680cd910 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.277+0000 7f7e5dffb700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e4c06ace0 0x7f7e4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.281 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.277+0000 7f7e5dffb700 1 -- 172.21.15.149:0/4061820577 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e64088c50 con 0x7f7e680cd910 2023-06-09T04:37:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.277+0000 7f7e6d21b700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e4c06ace0 0x7f7e4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.277+0000 7f7e6d21b700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e4c06ace0 0x7f7e4c06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7e58000c00 tx=0x7f7e5801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.281+0000 7f7e5dffb700 1 -- 172.21.15.149:0/4061820577 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7e6408e020 con 0x7f7e680cd910 2023-06-09T04:37:57.486 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.486+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e6806af40 con 0x7f7e680cd910 2023-06-09T04:37:57.487 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.486+0000 7f7e5dffb700 1 -- 172.21.15.149:0/4061820577 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e64017080 con 0x7f7e680cd910 2023-06-09T04:37:57.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e4c06ace0 msgr2=0x7f7e4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e4c06ace0 0x7f7e4c06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7e58000c00 tx=0x7f7e5801c040 comp rx=0 tx=0).stop 2023-06-09T04:37:57.489 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e680cd910 msgr2=0x7f7e681f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e680cd910 0x7f7e681f4d70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7e640011e0 tx=0x7f7e6400ca30 comp rx=0 tx=0).stop 2023-06-09T04:37:57.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 shutdown_connections 2023-06-09T04:37:57.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e4c06ace0 0x7f7e4c06d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.490 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e6806db50 0x7f7e681e64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e6815f630 0x7f7e680c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 --2- 172.21.15.149:0/4061820577 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e680cd910 0x7f7e681f4d70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 >> 172.21.15.149:0/4061820577 conn(0x7f7e680cee30 msgr2=0x7f7e6815fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:57.491 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 shutdown_connections 2023-06-09T04:37:57.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.489+0000 7f7e6f47f700 1 -- 172.21.15.149:0/4061820577 wait complete. 2023-06-09T04:37:57.492 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-06-09T04:37:57.501 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-09T04:37:57.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:57.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-09T04:37:57.554 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T04:37:57.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:37:57.554 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T04:37:57.572 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-09T04:37:57.573 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:37:57.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.693+0000 7f0637a33700 1 Processor -- start 2023-06-09T04:37:57.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.693+0000 7f0637a33700 1 -- start start 2023-06-09T04:37:57.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0637a33700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06300afa30 0x7f06300b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0637a33700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300b01a0 con 0x7f06300b0c40 2023-06-09T04:37:57.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0637a33700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300b0900 con 0x7f06300cd980 2023-06-09T04:37:57.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0637a33700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06300b06f0 con 0x7f06300afa30 2023-06-09T04:37:57.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f06357cf700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06300afa30 0x7f06300b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f06357cf700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f06300afa30 0x7f06300b24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37940/0 (socket says 172.21.15.149:37940) 2023-06-09T04:37:57.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0634fce700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f06300b0c40 0x7f06300cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33572/0 (socket says 172.21.15.149:33572) 2023-06-09T04:37:57.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f06357cf700 1 -- 172.21.15.149:0/58775487 learned_addr learned my addr 172.21.15.149:0/58775487 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:57.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f06357cf700 1 -- 172.21.15.149:0/58775487 >> v1:172.21.15.184:6789/0 conn(0x7f06300cd980 legacy=0x7f06300cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:57.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f06357cf700 1 -- 172.21.15.149:0/58775487 >> v1:172.21.15.149:6789/0 conn(0x7f06300b0c40 legacy=0x7f06300cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f06357cf700 1 -- 172.21.15.149:0/58775487 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300ca7a0 con 0x7f06300afa30 2023-06-09T04:37:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f06357cf700 1 --2- 172.21.15.149:0/58775487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06300b24f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab0fc94e86d04f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0627fff700 1 -- 172.21.15.149:0/58775487 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c005e30 con 0x7f06300afa30 2023-06-09T04:37:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0627fff700 1 -- 172.21.15.149:0/58775487 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c006030 con 0x7f06300afa30 2023-06-09T04:37:57.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.694+0000 7f0627fff700 1 -- 172.21.15.149:0/58775487 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0063e0 con 0x7f06300afa30 2023-06-09T04:37:57.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.695+0000 7f0637a33700 1 -- 172.21.15.149:0/58775487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 msgr2=0x7f06300b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.695+0000 7f0637a33700 1 --2- 172.21.15.149:0/58775487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06300b24f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f062c006fd0 tx=0x7f062c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.695+0000 7f0637a33700 1 -- 172.21.15.149:0/58775487 shutdown_connections 2023-06-09T04:37:57.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.695+0000 7f0637a33700 1 --2- 172.21.15.149:0/58775487 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06300b24f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.695+0000 7f0637a33700 1 -- 172.21.15.149:0/58775487 >> 172.21.15.149:0/58775487 conn(0x7f063006b7e0 msgr2=0x7f06300cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.695+0000 7f0637a33700 1 -- 172.21.15.149:0/58775487 shutdown_connections 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.695+0000 7f0637a33700 1 -- 172.21.15.149:0/58775487 wait complete. 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.696+0000 7f0637a33700 1 Processor -- start 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.696+0000 7f0637a33700 1 -- start start 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0637a33700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06301ee420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0637a33700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06300b0c40 0x7f06301f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0637a33700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06300cd980 0x7f06301f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0637a33700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300ace00 con 0x7f06300afa30 2023-06-09T04:37:57.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0637a33700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300b3e10 con 0x7f06300cd980 2023-06-09T04:37:57.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0637a33700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300af230 con 0x7f06300b0c40 2023-06-09T04:37:57.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06301ee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06301ee420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37946/0 (socket says 172.21.15.149:37946) 2023-06-09T04:37:57.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 -- 172.21.15.149:0/2177072498 learned_addr learned my addr 172.21.15.149:0/2177072498 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:57.700 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0634fce700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06300b0c40 0x7f06301f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f0635fd0700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06300cd980 0x7f06301f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 -- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06300b0c40 msgr2=0x7f06301f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06300b0c40 0x7f06301f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 -- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06300cd980 msgr2=0x7f06301f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06300cd980 0x7f06301f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 -- 172.21.15.149:0/2177072498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c009500 con 0x7f06300afa30 2023-06-09T04:37:57.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.697+0000 7f06357cf700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06301ee420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f062c012000 tx=0x7f062c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.698+0000 7f0625ffb700 1 -- 172.21.15.149:0/2177072498 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c025430 con 0x7f06300afa30 2023-06-09T04:37:57.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.698+0000 7f0625ffb700 1 -- 172.21.15.149:0/2177072498 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c020070 con 0x7f06300afa30 2023-06-09T04:37:57.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.698+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06300b3b30 con 0x7f06300afa30 2023-06-09T04:37:57.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.698+0000 7f0625ffb700 1 -- 172.21.15.149:0/2177072498 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0257d0 con 0x7f06300afa30 2023-06-09T04:37:57.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.698+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06300aca20 con 0x7f06300afa30 2023-06-09T04:37:57.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.699+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06300acf40 con 0x7f06300afa30 2023-06-09T04:37:57.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.699+0000 7f0625ffb700 1 -- 172.21.15.149:0/2177072498 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f062c022030 con 0x7f06300afa30 2023-06-09T04:37:57.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.700+0000 7f0625ffb700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f061406ace0 0x7f061406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:57.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.700+0000 7f0625ffb700 1 -- 172.21.15.149:0/2177072498 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f062c08aea0 con 0x7f06300afa30 2023-06-09T04:37:57.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.700+0000 7f0634fce700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f061406ace0 0x7f061406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:57.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.700+0000 7f0634fce700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f061406ace0 0x7f061406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06300b49b0 tx=0x7f0620007d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:57.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.704+0000 7f0625ffb700 1 -- 172.21.15.149:0/2177072498 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06300acf40 con 0x7f06300afa30 2023-06-09T04:37:57.934 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.934+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06300acf40 con 0x7f06300afa30 2023-06-09T04:37:57.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.935+0000 7f0625ffb700 1 -- 172.21.15.149:0/2177072498 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f06300acf40 con 0x7f06300afa30 2023-06-09T04:37:57.935 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:57.935 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:37:57.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f061406ace0 msgr2=0x7f061406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f061406ace0 0x7f061406d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f06300b49b0 tx=0x7f0620007d10 comp rx=0 tx=0).stop 2023-06-09T04:37:57.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 msgr2=0x7f06301ee420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:57.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06301ee420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f062c012000 tx=0x7f062c004750 comp rx=0 tx=0).stop 2023-06-09T04:37:57.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 shutdown_connections 2023-06-09T04:37:57.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f061406ace0 0x7f061406d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06300cd980 0x7f06301f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f06300afa30 0x7f06301ee420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 --2- 172.21.15.149:0/2177072498 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f06300b0c40 0x7f06301f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:57.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 >> 172.21.15.149:0/2177072498 conn(0x7f063006b7e0 msgr2=0x7f06300c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:57.938 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 shutdown_connections 2023-06-09T04:37:57.939 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:57.937+0000 7f0637a33700 1 -- 172.21.15.149:0/2177072498 wait complete. 2023-06-09T04:37:57.939 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:37:57.949 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:37:58.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.069+0000 7f3159eee700 1 Processor -- start 2023-06-09T04:37:58.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.069+0000 7f3159eee700 1 -- start start 2023-06-09T04:37:58.070 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3159eee700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f315415cd60 0x7f31540709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3159eee700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3154070ee0 0x7f315406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3159eee700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3154159d60 con 0x7f31541589c0 2023-06-09T04:37:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3159eee700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540712e0 con 0x7f3154070ee0 2023-06-09T04:37:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3159eee700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31540cce80 con 0x7f315415cd60 2023-06-09T04:37:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3154070ee0 0x7f315406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f3154070ee0 0x7f315406cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37958/0 (socket says 172.21.15.149:37958) 2023-06-09T04:37:58.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 -- 172.21.15.149:0/724154497 learned_addr learned my addr 172.21.15.149:0/724154497 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3152ffd700 1 --2- 172.21.15.149:0/724154497 >> v2:172.21.15.184:3300/0 conn(0x7f315415cd60 0x7f31540709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 -- 172.21.15.149:0/724154497 >> v2:172.21.15.184:3300/0 conn(0x7f315415cd60 msgr2=0x7f31540709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 --2- 172.21.15.149:0/724154497 >> v2:172.21.15.184:3300/0 conn(0x7f315415cd60 0x7f31540709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 -- 172.21.15.149:0/724154497 >> v1:172.21.15.184:6789/0 conn(0x7f31541589c0 legacy=0x7f3154159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 -- 172.21.15.149:0/724154497 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540cd160 con 0x7f3154070ee0 2023-06-09T04:37:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3152ffd700 1 --2- 172.21.15.149:0/724154497 >> v2:172.21.15.184:3300/0 conn(0x7f315415cd60 0x7f31540709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:37:58.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.070+0000 7f3153fff700 1 --2- 172.21.15.149:0/724154497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f315406cc30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3154070450 tx=0x7f314c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73b64a7fbb06d6a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f31527fc700 1 -- 172.21.15.149:0/724154497 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c010070 con 0x7f3154070ee0 2023-06-09T04:37:58.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f31527fc700 1 -- 172.21.15.149:0/724154497 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00db40 con 0x7f3154070ee0 2023-06-09T04:37:58.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f31527fc700 1 -- 172.21.15.149:0/724154497 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c003a20 con 0x7f3154070ee0 2023-06-09T04:37:58.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 -- 172.21.15.149:0/724154497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 msgr2=0x7f315406cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 --2- 172.21.15.149:0/724154497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f315406cc30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3154070450 tx=0x7f314c00d430 comp rx=0 tx=0).stop 2023-06-09T04:37:58.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 -- 172.21.15.149:0/724154497 shutdown_connections 2023-06-09T04:37:58.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 --2- 172.21.15.149:0/724154497 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f315406cc30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 --2- 172.21.15.149:0/724154497 >> v2:172.21.15.184:3300/0 conn(0x7f315415cd60 0x7f31540709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 -- 172.21.15.149:0/724154497 >> 172.21.15.149:0/724154497 conn(0x7f31540ceed0 msgr2=0x7f31540cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 -- 172.21.15.149:0/724154497 shutdown_connections 2023-06-09T04:37:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.071+0000 7f3159eee700 1 -- 172.21.15.149:0/724154497 wait complete. 2023-06-09T04:37:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.072+0000 7f3159eee700 1 Processor -- start 2023-06-09T04:37:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f3159eee700 1 -- start start 2023-06-09T04:37:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f3159eee700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f31541f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f3159eee700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31541589c0 0x7f3154144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f3159eee700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315415cd60 0x7f315415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f3159eee700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3154159ef0 con 0x7f3154070ee0 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f3159eee700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315415a190 con 0x7f315415cd60 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f3159eee700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315415a470 con 0x7f31541589c0 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f31537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f31541f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f31537fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f31541f0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37962/0 (socket says 172.21.15.149:37962) 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.073+0000 7f31537fe700 1 -- 172.21.15.149:0/2580841635 learned_addr learned my addr 172.21.15.149:0/2580841635 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:58.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f3153fff700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315415cd60 0x7f315415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f3152ffd700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31541589c0 0x7f3154144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f31537fe700 1 -- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31541589c0 msgr2=0x7f3154144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f31537fe700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31541589c0 0x7f3154144f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f31537fe700 1 -- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315415cd60 msgr2=0x7f315415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f31537fe700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315415cd60 0x7f315415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f31537fe700 1 -- 172.21.15.149:0/2580841635 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c00bd40 con 0x7f3154070ee0 2023-06-09T04:37:58.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f31537fe700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f31541f0ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f314800c4d0 tx=0x7f314800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f313bfff700 1 -- 172.21.15.149:0/2580841635 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148011790 con 0x7f3154070ee0 2023-06-09T04:37:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f313bfff700 1 -- 172.21.15.149:0/2580841635 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31480118f0 con 0x7f3154070ee0 2023-06-09T04:37:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315415a750 con 0x7f3154070ee0 2023-06-09T04:37:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f313bfff700 1 -- 172.21.15.149:0/2580841635 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3148011ca0 con 0x7f3154070ee0 2023-06-09T04:37:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.074+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31541f0ff0 con 0x7f3154070ee0 2023-06-09T04:37:58.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.075+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315415ac70 con 0x7f3154070ee0 2023-06-09T04:37:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.075+0000 7f313bfff700 1 -- 172.21.15.149:0/2580841635 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f314801c460 con 0x7f3154070ee0 2023-06-09T04:37:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.076+0000 7f313bfff700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f314006ace0 0x7f314006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.076+0000 7f313bfff700 1 -- 172.21.15.149:0/2580841635 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3148089660 con 0x7f3154070ee0 2023-06-09T04:37:58.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.076+0000 7f3152ffd700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f314006ace0 0x7f314006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.076+0000 7f3152ffd700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f314006ace0 0x7f314006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3144006fd0 tx=0x7f3144008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.080+0000 7f313bfff700 1 -- 172.21.15.149:0/2580841635 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f315415ac70 con 0x7f3154070ee0 2023-06-09T04:37:58.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.268+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f315415ac70 con 0x7f3154070ee0 2023-06-09T04:37:58.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.269+0000 7f313bfff700 1 -- 172.21.15.149:0/2580841635 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7f315415ac70 con 0x7f3154070ee0 2023-06-09T04:37:58.270 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:37:58.270 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:37:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f314006ace0 msgr2=0x7f314006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f314006ace0 0x7f314006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3144006fd0 tx=0x7f3144008040 comp rx=0 tx=0).stop 2023-06-09T04:37:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 msgr2=0x7f31541f0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f31541f0ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f314800c4d0 tx=0x7f314800c890 comp rx=0 tx=0).stop 2023-06-09T04:37:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 shutdown_connections 2023-06-09T04:37:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f314006ace0 0x7f314006d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f315415cd60 0x7f315415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3154070ee0 0x7f31541f0ab0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 --2- 172.21.15.149:0/2580841635 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f31541589c0 0x7f3154144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 >> 172.21.15.149:0/2580841635 conn(0x7f31540ceed0 msgr2=0x7f3154159550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:58.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 shutdown_connections 2023-06-09T04:37:58.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.272+0000 7f3159eee700 1 -- 172.21.15.149:0/2580841635 wait complete. 2023-06-09T04:37:58.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:36:50.781489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:36:52.029580+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:36:55.100412+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:37:58.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:37:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.409+0000 7f1f25177700 1 Processor -- start 2023-06-09T04:37:58.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.409+0000 7f1f25177700 1 -- start start 2023-06-09T04:37:58.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.409+0000 7f1f25177700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 0x7f1f200cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.409+0000 7f1f25177700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1f200cf5b0 0x7f1f2015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f25177700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f200cda20 con 0x7f1f2015e170 2023-06-09T04:37:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f25177700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f200b6470 con 0x7f1f200cf5b0 2023-06-09T04:37:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f25177700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015a520 con 0x7f1f200b60a0 2023-06-09T04:37:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1f59e700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1f2015e170 0x7f1f200ce310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33604/0 (socket says 172.21.15.149:33604) 2023-06-09T04:37:58.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1f59e700 1 -- 172.21.15.149:0/4068460451 learned_addr learned my addr 172.21.15.149:0/4068460451 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:37:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1e59c700 1 --2- 172.21.15.149:0/4068460451 >> v2:172.21.15.184:3300/0 conn(0x7f1f200cf5b0 0x7f1f2015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1ed9d700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 0x7f1f200cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3377474755 0 0) 0x7f1f200cda20 con 0x7f1f2015e170 2023-06-09T04:37:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f080035b0 con 0x7f1f2015e170 2023-06-09T04:37:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40972214 0 0) 0x7f1f080035b0 con 0x7f1f2015e170 2023-06-09T04:37:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 msgr2=0x7f1f200cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 0x7f1f200cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 >> v2:172.21.15.184:3300/0 conn(0x7f1f200cf5b0 msgr2=0x7f1f2015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 --2- 172.21.15.149:0/4068460451 >> v2:172.21.15.184:3300/0 conn(0x7f1f200cf5b0 0x7f1f2015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2015ea40 con 0x7f1f2015e170 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f1f180019f0 con 0x7f1f2015e170 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 >> v1:172.21.15.149:6789/0 conn(0x7f1f2015e170 legacy=0x7f1f200ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 0x7f1f08003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f08003f80 0x7f1f08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f08004d90 0x7f1f08005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f200b6470 con 0x7f1f08004d90 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015a520 con 0x7f1f08003f80 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0800ba40 con 0x7f1f200b60a0 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1f59e700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f08004d90 0x7f1f08005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1ed9d700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 0x7f1f08003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.410+0000 7f1f1e59c700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f08003f80 0x7f1f08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1f59e700 1 -- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 msgr2=0x7f1f08003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1f59e700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f200b60a0 0x7f1f08003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1f59e700 1 -- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f08003f80 msgr2=0x7f1f08004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1f59e700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f08003f80 0x7f1f08004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1f59e700 1 -- 172.21.15.149:0/4068460451 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080035b0 con 0x7f1f08004d90 2023-06-09T04:37:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1f59e700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f08004d90 0x7f1f08005200 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800a8d0 tx=0x7f1f08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbb0c9c7b88054 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1800a340 con 0x7f1f08004d90 2023-06-09T04:37:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18012600 con 0x7f1f08004d90 2023-06-09T04:37:58.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1dd9b700 1 -- 172.21.15.149:0/4068460451 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180129b0 con 0x7f1f08004d90 2023-06-09T04:37:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f25177700 1 -- 172.21.15.149:0/4068460451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f08004d90 msgr2=0x7f1f08005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f25177700 1 --2- 172.21.15.149:0/4068460451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f08004d90 0x7f1f08005200 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800a8d0 tx=0x7f1f08005880 comp rx=0 tx=0).stop 2023-06-09T04:37:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f1f59e700 1 -- 172.21.15.149:0/4068460451 reap_dead start 2023-06-09T04:37:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f25177700 1 -- 172.21.15.149:0/4068460451 shutdown_connections 2023-06-09T04:37:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.411+0000 7f1f25177700 1 -- 172.21.15.149:0/4068460451 >> 172.21.15.149:0/4068460451 conn(0x7f1f20069db0 msgr2=0x7f1f2006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.412+0000 7f1f25177700 1 -- 172.21.15.149:0/4068460451 shutdown_connections 2023-06-09T04:37:58.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.412+0000 7f1f25177700 1 -- 172.21.15.149:0/4068460451 wait complete. 2023-06-09T04:37:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.413+0000 7f1f25177700 1 Processor -- start 2023-06-09T04:37:58.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.413+0000 7f1f25177700 1 -- start start 2023-06-09T04:37:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f25177700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f20147aa0 0x7f1f200c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f25177700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f20147e70 0x7f1f20148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f25177700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f200ca630 0x7f1f200c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f25177700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015c7e0 con 0x7f1f200ca630 2023-06-09T04:37:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f25177700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015bba0 con 0x7f1f20147aa0 2023-06-09T04:37:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f25177700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2015be40 con 0x7f1f20147e70 2023-06-09T04:37:58.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f200ca630 0x7f1f200c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f200ca630 0x7f1f200c8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37982/0 (socket says 172.21.15.149:37982) 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 -- 172.21.15.149:0/1248816216 learned_addr learned my addr 172.21.15.149:0/1248816216 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1ed9d700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f20147aa0 0x7f1f200c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1e59c700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f20147e70 0x7f1f20148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 -- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f20147e70 msgr2=0x7f1f20148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f20147e70 0x7f1f20148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 -- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f20147aa0 msgr2=0x7f1f200c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f20147aa0 0x7f1f200c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 -- 172.21.15.149:0/1248816216 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2015c120 con 0x7f1f200ca630 2023-06-09T04:37:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1e59c700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f20147e70 0x7f1f20148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f1f59e700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f200ca630 0x7f1f200c8450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1f18015040 tx=0x7f1f18001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.414+0000 7f1f077fe700 1 -- 172.21.15.149:0/1248816216 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180019c0 con 0x7f1f200ca630 2023-06-09T04:37:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.415+0000 7f1f077fe700 1 -- 172.21.15.149:0/1248816216 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f180011c0 con 0x7f1f200ca630 2023-06-09T04:37:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.415+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2015c400 con 0x7f1f200ca630 2023-06-09T04:37:58.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.415+0000 7f1f077fe700 1 -- 172.21.15.149:0/1248816216 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18027410 con 0x7f1f200ca630 2023-06-09T04:37:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.415+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f201488b0 con 0x7f1f200ca630 2023-06-09T04:37:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.415+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2015c920 con 0x7f1f200ca630 2023-06-09T04:37:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.416+0000 7f1f077fe700 1 -- 172.21.15.149:0/1248816216 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f18019070 con 0x7f1f200ca630 2023-06-09T04:37:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.416+0000 7f1f077fe700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1f0c06ace0 0x7f1f0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.416+0000 7f1f077fe700 1 -- 172.21.15.149:0/1248816216 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f1808ae60 con 0x7f1f200ca630 2023-06-09T04:37:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.416+0000 7f1f1ed9d700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1f0c06ace0 0x7f1f0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.417+0000 7f1f1ed9d700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1f0c06ace0 0x7f1f0c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009c60 tx=0x7f1f10009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.421+0000 7f1f077fe700 1 -- 172.21.15.149:0/1248816216 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f2015c920 con 0x7f1f200ca630 2023-06-09T04:37:58.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:58.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:37:58.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.613+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f2015c920 con 0x7f1f200ca630 2023-06-09T04:37:58.613 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.613+0000 7f1f077fe700 1 -- 172.21.15.149:0/1248816216 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f2015c920 con 0x7f1f200ca630 2023-06-09T04:37:58.614 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:37:58.615 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1f0c06ace0 msgr2=0x7f1f0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1f0c06ace0 0x7f1f0c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009c60 tx=0x7f1f10009210 comp rx=0 tx=0).stop 2023-06-09T04:37:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f200ca630 msgr2=0x7f1f200c8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f200ca630 0x7f1f200c8450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1f18015040 tx=0x7f1f18001360 comp rx=0 tx=0).stop 2023-06-09T04:37:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 shutdown_connections 2023-06-09T04:37:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1f0c06ace0 0x7f1f0c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f200ca630 0x7f1f200c8450 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.616 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f20147aa0 0x7f1f200c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 --2- 172.21.15.149:0/1248816216 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f20147e70 0x7f1f20148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 >> 172.21.15.149:0/1248816216 conn(0x7f1f20069db0 msgr2=0x7f1f200b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 shutdown_connections 2023-06-09T04:37:58.617 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.615+0000 7f1f25177700 1 -- 172.21.15.149:0/1248816216 wait complete. 2023-06-09T04:37:58.628 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:37:58.752 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.752+0000 7f22fd025700 1 Processor -- start 2023-06-09T04:37:58.753 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22fd025700 1 -- start start 2023-06-09T04:37:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22fd025700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f22f815c320 0x7f22f80cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22fd025700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 0x7f22f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22fd025700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f22f815c6f0 0x7f22f806a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.754 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22fd025700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f8071290 con 0x7f22f815c320 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22fd025700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f80b2050 con 0x7f22f815c6f0 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22fd025700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80cd2c0 con 0x7f22f8071770 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22f6d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f22f815c320 0x7f22f80cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22f6d9d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f22f815c320 0x7f22f80cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37988/0 (socket says 172.21.15.149:37988) 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.753+0000 7f22f6d9d700 1 -- 172.21.15.149:0/871640267 learned_addr learned my addr 172.21.15.149:0/871640267 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f659c700 1 --2- 172.21.15.149:0/871640267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 0x7f22f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f759e700 1 --2- 172.21.15.149:0/871640267 >> v2:172.21.15.184:3300/0 conn(0x7f22f815c6f0 0x7f22f806a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.755 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f6d9d700 1 -- 172.21.15.149:0/871640267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 msgr2=0x7f22f8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f6d9d700 1 --2- 172.21.15.149:0/871640267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 0x7f22f8069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f6d9d700 1 -- 172.21.15.149:0/871640267 >> v2:172.21.15.184:3300/0 conn(0x7f22f815c6f0 msgr2=0x7f22f806a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f6d9d700 1 --2- 172.21.15.149:0/871640267 >> v2:172.21.15.184:3300/0 conn(0x7f22f815c6f0 0x7f22f806a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f6d9d700 1 -- 172.21.15.149:0/871640267 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f80cd5a0 con 0x7f22f815c320 2023-06-09T04:37:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f6d9d700 1 --2- 172.21.15.149:0/871640267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f80cee20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22f8072580 tx=0x7f22ec009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a7fa3c6f9e6079 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f5d9b700 1 -- 172.21.15.149:0/871640267 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00b870 con 0x7f22f815c320 2023-06-09T04:37:58.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f5d9b700 1 -- 172.21.15.149:0/871640267 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec00b9d0 con 0x7f22f815c320 2023-06-09T04:37:58.757 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22f5d9b700 1 -- 172.21.15.149:0/871640267 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec00bd60 con 0x7f22f815c320 2023-06-09T04:37:58.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22fd025700 1 -- 172.21.15.149:0/871640267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 msgr2=0x7f22f80cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.754+0000 7f22fd025700 1 --2- 172.21.15.149:0/871640267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f80cee20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f22f8072580 tx=0x7f22ec009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.755+0000 7f22fd025700 1 -- 172.21.15.149:0/871640267 shutdown_connections 2023-06-09T04:37:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.755+0000 7f22fd025700 1 --2- 172.21.15.149:0/871640267 >> v2:172.21.15.184:3300/0 conn(0x7f22f815c6f0 0x7f22f806a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.755+0000 7f22fd025700 1 --2- 172.21.15.149:0/871640267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f80cee20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.755+0000 7f22fd025700 1 --2- 172.21.15.149:0/871640267 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 0x7f22f8069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.755+0000 7f22fd025700 1 -- 172.21.15.149:0/871640267 >> 172.21.15.149:0/871640267 conn(0x7f22f806aec0 msgr2=0x7f22f806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:58.759 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.755+0000 7f22fd025700 1 -- 172.21.15.149:0/871640267 shutdown_connections 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.755+0000 7f22fd025700 1 -- 172.21.15.149:0/871640267 wait complete. 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.756+0000 7f22fd025700 1 Processor -- start 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.756+0000 7f22fd025700 1 -- start start 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.757+0000 7f22fd025700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 0x7f22f8157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.757+0000 7f22fd025700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.757+0000 7f22fd025700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f815c6f0 0x7f22f80c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.757+0000 7f22fd025700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c47d0 con 0x7f22f815c320 2023-06-09T04:37:58.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.757+0000 7f22fd025700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c4ed0 con 0x7f22f815c6f0 2023-06-09T04:37:58.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.757+0000 7f22fd025700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f80c5d10 con 0x7f22f8071770 2023-06-09T04:37:58.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.757+0000 7f22f659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f8151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:37994/0 (socket says 172.21.15.149:37994) 2023-06-09T04:37:58.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 -- 172.21.15.149:0/62479892 learned_addr learned my addr 172.21.15.149:0/62479892 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:58.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 -- 172.21.15.149:0/62479892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 msgr2=0x7f22f8157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 0x7f22f8157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 -- 172.21.15.149:0/62479892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f815c6f0 msgr2=0x7f22f80c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f759e700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f815c6f0 0x7f22f80c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f815c6f0 0x7f22f80c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 -- 172.21.15.149:0/62479892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec009550 con 0x7f22f815c320 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22f659c700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f8151ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f22e800e810 tx=0x7f22e800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22df7fe700 1 -- 172.21.15.149:0/62479892 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8013610 con 0x7f22f815c320 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22df7fe700 1 -- 172.21.15.149:0/62479892 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8013770 con 0x7f22f815c320 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f80c5100 con 0x7f22f815c320 2023-06-09T04:37:58.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22df7fe700 1 -- 172.21.15.149:0/62479892 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8013b00 con 0x7f22f815c320 2023-06-09T04:37:58.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.758+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f80c56c0 con 0x7f22f815c320 2023-06-09T04:37:58.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.759+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f8073fa0 con 0x7f22f815c320 2023-06-09T04:37:58.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.760+0000 7f22df7fe700 1 -- 172.21.15.149:0/62479892 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f22e8013c60 con 0x7f22f815c320 2023-06-09T04:37:58.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.760+0000 7f22df7fe700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f22e406ace0 0x7f22e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:58.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.760+0000 7f22df7fe700 1 -- 172.21.15.149:0/62479892 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f22e8089440 con 0x7f22f815c320 2023-06-09T04:37:58.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.760+0000 7f22f6d9d700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f22e406ace0 0x7f22e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:58.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.760+0000 7f22f6d9d700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f22e406ace0 0x7f22e406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22f806b800 tx=0x7f22ec010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:58.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.764+0000 7f22df7fe700 1 -- 172.21.15.149:0/62479892 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f22e8057c50 con 0x7f22f815c320 2023-06-09T04:37:58.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.950+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22f80b55d0 con 0x7f22f815c320 2023-06-09T04:37:58.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.950+0000 7f22df7fe700 1 -- 172.21.15.149:0/62479892 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22e80577e0 con 0x7f22f815c320 2023-06-09T04:37:58.950 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:37:58.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f22e406ace0 msgr2=0x7f22e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f22e406ace0 0x7f22e406d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f22f806b800 tx=0x7f22ec010000 comp rx=0 tx=0).stop 2023-06-09T04:37:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 msgr2=0x7f22f8151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f8151ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f22e800e810 tx=0x7f22e800ebd0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 shutdown_connections 2023-06-09T04:37:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f22e406ace0 0x7f22e406d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f22f8071770 0x7f22f8157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f22f815c6f0 0x7f22f80c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 --2- 172.21.15.149:0/62479892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f22f815c320 0x7f22f8151ca0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 >> 172.21.15.149:0/62479892 conn(0x7f22f806aec0 msgr2=0x7f22f80b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 shutdown_connections 2023-06-09T04:37:58.954 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:58.952+0000 7f22fd025700 1 -- 172.21.15.149:0/62479892 wait complete. 2023-06-09T04:37:58.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:37:59.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.088+0000 7f9060645700 1 Processor -- start 2023-06-09T04:37:59.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.088+0000 7f9060645700 1 -- start start 2023-06-09T04:37:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.088+0000 7f9060645700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90580cded0 0x7f905815d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f9060645700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90580cd300 0x7f90580ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f9060645700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f90581591d0 0x7f9058071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f9060645700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905806f4a0 con 0x7f90580cd300 2023-06-09T04:37:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f9060645700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90580716e0 con 0x7f90581591d0 2023-06-09T04:37:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f9060645700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905815dad0 con 0x7f90580cded0 2023-06-09T04:37:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90580cd300 0x7f90580ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f90580cd300 0x7f90580ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38002/0 (socket says 172.21.15.149:38002) 2023-06-09T04:37:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 -- 172.21.15.149:0/423557370 learned_addr learned my addr 172.21.15.149:0/423557370 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:59.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905e3e1700 1 --2- 172.21.15.149:0/423557370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90580cded0 0x7f905815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905ebe2700 1 --2- 172.21.15.149:0/423557370 >> v2:172.21.15.184:3300/0 conn(0x7f90581591d0 0x7f9058071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 -- 172.21.15.149:0/423557370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90580cded0 msgr2=0x7f905815d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 --2- 172.21.15.149:0/423557370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90580cded0 0x7f905815d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 -- 172.21.15.149:0/423557370 >> v2:172.21.15.184:3300/0 conn(0x7f90581591d0 msgr2=0x7f9058071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 --2- 172.21.15.149:0/423557370 >> v2:172.21.15.184:3300/0 conn(0x7f90581591d0 0x7f9058071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 -- 172.21.15.149:0/423557370 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580ce7e0 con 0x7f90580cd300 2023-06-09T04:37:59.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905dbe0700 1 --2- 172.21.15.149:0/423557370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90580ce2a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f90580c2fb0 tx=0x7f9054009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2fdd9e663e5590b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905d3df700 1 -- 172.21.15.149:0/423557370 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054011830 con 0x7f90580cd300 2023-06-09T04:37:59.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905d3df700 1 -- 172.21.15.149:0/423557370 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9054011990 con 0x7f90580cd300 2023-06-09T04:37:59.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.089+0000 7f905d3df700 1 -- 172.21.15.149:0/423557370 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054011d20 con 0x7f90580cd300 2023-06-09T04:37:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 -- 172.21.15.149:0/423557370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 msgr2=0x7f90580ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 --2- 172.21.15.149:0/423557370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90580ce2a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f90580c2fb0 tx=0x7f9054009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 -- 172.21.15.149:0/423557370 shutdown_connections 2023-06-09T04:37:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 --2- 172.21.15.149:0/423557370 >> v2:172.21.15.184:3300/0 conn(0x7f90581591d0 0x7f9058071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 --2- 172.21.15.149:0/423557370 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90580cded0 0x7f905815d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 --2- 172.21.15.149:0/423557370 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90580ce2a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 -- 172.21.15.149:0/423557370 >> 172.21.15.149:0/423557370 conn(0x7f905806aec0 msgr2=0x7f905806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 -- 172.21.15.149:0/423557370 shutdown_connections 2023-06-09T04:37:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.090+0000 7f9060645700 1 -- 172.21.15.149:0/423557370 wait complete. 2023-06-09T04:37:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.091+0000 7f9060645700 1 Processor -- start 2023-06-09T04:37:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.091+0000 7f9060645700 1 -- start start 2023-06-09T04:37:59.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f9060645700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90581f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f9060645700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90580cded0 0x7f9058158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f9060645700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90581591d0 0x7f905815b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f9060645700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90581f4260 con 0x7f90580cd300 2023-06-09T04:37:59.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f9060645700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90581f0cb0 con 0x7f90580cded0 2023-06-09T04:37:59.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f9060645700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90581f00a0 con 0x7f90581591d0 2023-06-09T04:37:59.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90581f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90581f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38006/0 (socket says 172.21.15.149:38006) 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 -- 172.21.15.149:0/1511529089 learned_addr learned my addr 172.21.15.149:0/1511529089 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905ebe2700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90581591d0 0x7f905815b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905dbe0700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90580cded0 0x7f9058158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 -- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90581591d0 msgr2=0x7f905815b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90581591d0 0x7f905815b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 -- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90580cded0 msgr2=0x7f9058158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90580cded0 0x7f9058158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 -- 172.21.15.149:0/1511529089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054009550 con 0x7f90580cd300 2023-06-09T04:37:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905ebe2700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90581591d0 0x7f905815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:37:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.092+0000 7f905e3e1700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90581f3d20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f904c00e9b0 tx=0x7f904c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.093+0000 7f904affd700 1 -- 172.21.15.149:0/1511529089 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c009710 con 0x7f90580cd300 2023-06-09T04:37:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.093+0000 7f904affd700 1 -- 172.21.15.149:0/1511529089 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c00c850 con 0x7f90580cd300 2023-06-09T04:37:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.093+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90581f0380 con 0x7f90580cd300 2023-06-09T04:37:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.093+0000 7f904affd700 1 -- 172.21.15.149:0/1511529089 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c00cbc0 con 0x7f90580cd300 2023-06-09T04:37:59.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.093+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90581f0940 con 0x7f90580cd300 2023-06-09T04:37:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.094+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9058073fa0 con 0x7f90580cd300 2023-06-09T04:37:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.095+0000 7f904affd700 1 -- 172.21.15.149:0/1511529089 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f904c00cd20 con 0x7f90580cd300 2023-06-09T04:37:59.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.095+0000 7f904affd700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f903c06ace0 0x7f903c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.095+0000 7f904affd700 1 -- 172.21.15.149:0/1511529089 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f904c089fb0 con 0x7f90580cd300 2023-06-09T04:37:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.095+0000 7f905dbe0700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f903c06ace0 0x7f903c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.096+0000 7f905dbe0700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f903c06ace0 0x7f903c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f90580cd6d0 tx=0x7f9054008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.099+0000 7f904affd700 1 -- 172.21.15.149:0/1511529089 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f904c054e10 con 0x7f90580cd300 2023-06-09T04:37:59.284 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.284+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90580b55d0 con 0x7f90580cd300 2023-06-09T04:37:59.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.285+0000 7f904affd700 1 -- 172.21.15.149:0/1511529089 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f904c058430 con 0x7f90580cd300 2023-06-09T04:37:59.285 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f903c06ace0 msgr2=0x7f903c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f903c06ace0 0x7f903c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f90580cd6d0 tx=0x7f9054008030 comp rx=0 tx=0).stop 2023-06-09T04:37:59.287 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 msgr2=0x7f90581f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90581f3d20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f904c00e9b0 tx=0x7f904c00ecc0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 shutdown_connections 2023-06-09T04:37:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f903c06ace0 0x7f903c06d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f90581591d0 0x7f905815b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f90580cd300 0x7f90581f3d20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.288 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 --2- 172.21.15.149:0/1511529089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90580cded0 0x7f9058158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 >> 172.21.15.149:0/1511529089 conn(0x7f905806aec0 msgr2=0x7f90580b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 shutdown_connections 2023-06-09T04:37:59.289 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.287+0000 7f9060645700 1 -- 172.21.15.149:0/1511529089 wait complete. 2023-06-09T04:37:59.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:37:59.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.422+0000 7f831cf99700 1 Processor -- start 2023-06-09T04:37:59.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.422+0000 7f831cf99700 1 -- start start 2023-06-09T04:37:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f831cf99700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8318159380 0x7f83180716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f831cf99700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83180b1dc0 0x7f83180cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f831cf99700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8318071d50 0x7f83180cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f831cf99700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180b10d0 con 0x7f83180b1dc0 2023-06-09T04:37:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f831cf99700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831806f480 con 0x7f8318159380 2023-06-09T04:37:59.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f831cf99700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831806f760 con 0x7f8318071d50 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83180b1dc0 0x7f83180cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f83180b1dc0 0x7f83180cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38016/0 (socket says 172.21.15.149:38016) 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 -- 172.21.15.149:0/4083731013 learned_addr learned my addr 172.21.15.149:0/4083731013 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f8316d9d700 1 --2- 172.21.15.149:0/4083731013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8318071d50 0x7f83180cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f831659c700 1 --2- 172.21.15.149:0/4083731013 >> v2:172.21.15.184:3300/0 conn(0x7f8318159380 0x7f83180716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 -- 172.21.15.149:0/4083731013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8318071d50 msgr2=0x7f83180cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 --2- 172.21.15.149:0/4083731013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8318071d50 0x7f83180cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 -- 172.21.15.149:0/4083731013 >> v2:172.21.15.184:3300/0 conn(0x7f8318159380 msgr2=0x7f83180716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 --2- 172.21.15.149:0/4083731013 >> v2:172.21.15.184:3300/0 conn(0x7f8318159380 0x7f83180716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 -- 172.21.15.149:0/4083731013 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180b12e0 con 0x7f83180b1dc0 2023-06-09T04:37:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.423+0000 7f830ffff700 1 --2- 172.21.15.149:0/4083731013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83180b1dc0 0x7f83180cd220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8318066830 tx=0x7f830000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d46523eb26bcbf5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f8315d9b700 1 -- 172.21.15.149:0/4083731013 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000dd30 con 0x7f83180b1dc0 2023-06-09T04:37:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f8315d9b700 1 -- 172.21.15.149:0/4083731013 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000de90 con 0x7f83180b1dc0 2023-06-09T04:37:59.426 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f8315d9b700 1 -- 172.21.15.149:0/4083731013 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300010690 con 0x7f83180b1dc0 2023-06-09T04:37:59.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 -- 172.21.15.149:0/4083731013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83180b1dc0 msgr2=0x7f83180cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 --2- 172.21.15.149:0/4083731013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83180b1dc0 0x7f83180cd220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8318066830 tx=0x7f830000be70 comp rx=0 tx=0).stop 2023-06-09T04:37:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 -- 172.21.15.149:0/4083731013 shutdown_connections 2023-06-09T04:37:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 --2- 172.21.15.149:0/4083731013 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8318071d50 0x7f83180cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 --2- 172.21.15.149:0/4083731013 >> v2:172.21.15.184:3300/0 conn(0x7f8318159380 0x7f83180716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 --2- 172.21.15.149:0/4083731013 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f83180b1dc0 0x7f83180cd220 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 -- 172.21.15.149:0/4083731013 >> 172.21.15.149:0/4083731013 conn(0x7f831806aec0 msgr2=0x7f831806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:59.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 -- 172.21.15.149:0/4083731013 shutdown_connections 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.424+0000 7f831cf99700 1 -- 172.21.15.149:0/4083731013 wait complete. 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.425+0000 7f831cf99700 1 Processor -- start 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.425+0000 7f831cf99700 1 -- start start 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f831cf99700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8318071d50 0x7f8318152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f831cf99700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83180b1dc0 0x7f8318154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f831cf99700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8318159380 0x7f8318154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f831cf99700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831815b4e0 con 0x7f8318159380 2023-06-09T04:37:59.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f831cf99700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831815a8d0 con 0x7f8318071d50 2023-06-09T04:37:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f831cf99700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831815abb0 con 0x7f83180b1dc0 2023-06-09T04:37:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f8316d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8318159380 0x7f8318154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f8316d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8318159380 0x7f8318154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38024/0 (socket says 172.21.15.149:38024) 2023-06-09T04:37:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f8316d9d700 1 -- 172.21.15.149:0/3894017359 learned_addr learned my addr 172.21.15.149:0/3894017359 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f831659c700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8318071d50 0x7f8318152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.426+0000 7f830ffff700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83180b1dc0 0x7f8318154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f8316d9d700 1 -- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83180b1dc0 msgr2=0x7f8318154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f8316d9d700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83180b1dc0 0x7f8318154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f8316d9d700 1 -- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8318071d50 msgr2=0x7f8318152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f8316d9d700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8318071d50 0x7f8318152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f8316d9d700 1 -- 172.21.15.149:0/3894017359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830000b7f0 con 0x7f8318159380 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f8316d9d700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8318159380 0x7f8318154980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f831000cd20 tx=0x7f831000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f830effd700 1 -- 172.21.15.149:0/3894017359 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000ce70 con 0x7f8318159380 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f830effd700 1 -- 172.21.15.149:0/3894017359 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310003a20 con 0x7f8318159380 2023-06-09T04:37:59.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831815ae90 con 0x7f8318159380 2023-06-09T04:37:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f830effd700 1 -- 172.21.15.149:0/3894017359 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310003db0 con 0x7f8318159380 2023-06-09T04:37:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.427+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831815b970 con 0x7f8318159380 2023-06-09T04:37:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.428+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318073fa0 con 0x7f8318159380 2023-06-09T04:37:59.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.428+0000 7f830effd700 1 -- 172.21.15.149:0/3894017359 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8310003f10 con 0x7f8318159380 2023-06-09T04:37:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.429+0000 7f830effd700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f82f806ace0 0x7f82f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.429+0000 7f830effd700 1 -- 172.21.15.149:0/3894017359 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8310012070 con 0x7f8318159380 2023-06-09T04:37:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.429+0000 7f831659c700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f82f806ace0 0x7f82f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.429+0000 7f831659c700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f82f806ace0 0x7f82f806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83181f0d70 tx=0x7f8308008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.433+0000 7f830effd700 1 -- 172.21.15.149:0/3894017359 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8310054b50 con 0x7f8318159380 2023-06-09T04:37:59.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.622+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f831815b620 con 0x7f8318159380 2023-06-09T04:37:59.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.622+0000 7f830effd700 1 -- 172.21.15.149:0/3894017359 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8310058170 con 0x7f8318159380 2023-06-09T04:37:59.623 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T04:37:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f82f806ace0 msgr2=0x7f82f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f82f806ace0 0x7f82f806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f83181f0d70 tx=0x7f8308008040 comp rx=0 tx=0).stop 2023-06-09T04:37:59.625 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8318159380 msgr2=0x7f8318154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8318159380 0x7f8318154980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f831000cd20 tx=0x7f831000a570 comp rx=0 tx=0).stop 2023-06-09T04:37:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 shutdown_connections 2023-06-09T04:37:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f82f806ace0 0x7f82f806d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8318159380 0x7f8318154980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8318071d50 0x7f8318152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 --2- 172.21.15.149:0/3894017359 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f83180b1dc0 0x7f8318154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.626 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 >> 172.21.15.149:0/3894017359 conn(0x7f831806aec0 msgr2=0x7f83180cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 shutdown_connections 2023-06-09T04:37:59.627 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.625+0000 7f831cf99700 1 -- 172.21.15.149:0/3894017359 wait complete. 2023-06-09T04:37:59.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:37:59.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.761+0000 7f0992007700 1 Processor -- start 2023-06-09T04:37:59.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.762+0000 7f0992007700 1 -- start start 2023-06-09T04:37:59.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f0992007700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f098c15a300 0x7f098c0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f0992007700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f098c0cb690 0x7f098c071e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f0992007700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0c9f30 con 0x7f098c069db0 2023-06-09T04:37:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f0992007700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c0cbea0 con 0x7f098c0cb690 2023-06-09T04:37:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f0992007700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c0723b0 con 0x7f098c15a300 2023-06-09T04:37:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f098c0cb690 0x7f098c071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f098c0cb690 0x7f098c071e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38030/0 (socket says 172.21.15.149:38030) 2023-06-09T04:37:59.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 -- 172.21.15.149:0/3881699750 learned_addr learned my addr 172.21.15.149:0/3881699750 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098b7fe700 1 --2- 172.21.15.149:0/3881699750 >> v2:172.21.15.184:3300/0 conn(0x7f098c15a300 0x7f098c0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 -- 172.21.15.149:0/3881699750 >> v2:172.21.15.184:3300/0 conn(0x7f098c15a300 msgr2=0x7f098c0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 --2- 172.21.15.149:0/3881699750 >> v2:172.21.15.184:3300/0 conn(0x7f098c15a300 0x7f098c0cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 -- 172.21.15.149:0/3881699750 >> v1:172.21.15.184:6789/0 conn(0x7f098c069db0 legacy=0x7f098c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 -- 172.21.15.149:0/3881699750 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0cbbc0 con 0x7f098c0cb690 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098affd700 1 --2- 172.21.15.149:0/3881699750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c0cb690 0x7f098c071e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f098c06bed0 tx=0x7f0980009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1208052a50f691ef server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098a7fc700 1 -- 172.21.15.149:0/3881699750 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000b870 con 0x7f098c0cb690 2023-06-09T04:37:59.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098a7fc700 1 -- 172.21.15.149:0/3881699750 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000b9d0 con 0x7f098c0cb690 2023-06-09T04:37:59.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.763+0000 7f098a7fc700 1 -- 172.21.15.149:0/3881699750 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000bd60 con 0x7f098c0cb690 2023-06-09T04:37:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 -- 172.21.15.149:0/3881699750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c0cb690 msgr2=0x7f098c071e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 --2- 172.21.15.149:0/3881699750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c0cb690 0x7f098c071e70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f098c06bed0 tx=0x7f0980009bd0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 -- 172.21.15.149:0/3881699750 shutdown_connections 2023-06-09T04:37:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 --2- 172.21.15.149:0/3881699750 >> v2:172.21.15.184:3300/0 conn(0x7f098c15a300 0x7f098c0cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 --2- 172.21.15.149:0/3881699750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c0cb690 0x7f098c071e70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 -- 172.21.15.149:0/3881699750 >> 172.21.15.149:0/3881699750 conn(0x7f098c06aec0 msgr2=0x7f098c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 -- 172.21.15.149:0/3881699750 shutdown_connections 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.764+0000 7f0992007700 1 -- 172.21.15.149:0/3881699750 wait complete. 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.766+0000 7f0992007700 1 Processor -- start 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.766+0000 7f0992007700 1 -- start start 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f098c069db0 0x7f098c15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098c0cb690 0x7f098c14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c15a300 0x7f098c0c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c15aec0 con 0x7f098c15a300 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c15ced0 con 0x7f098c0cb690 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c15d1b0 con 0x7f098c069db0 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c15a300 0x7f098c0c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c15a300 0x7f098c0c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38038/0 (socket says 172.21.15.149:38038) 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 -- 172.21.15.149:0/4142603543 learned_addr learned my addr 172.21.15.149:0/4142603543 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098b7fe700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f098c069db0 0x7f098c15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098affd700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098c0cb690 0x7f098c14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 -- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f098c069db0 msgr2=0x7f098c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f098c069db0 0x7f098c15bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 -- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098c0cb690 msgr2=0x7f098c14c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098c0cb690 0x7f098c14c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 -- 172.21.15.149:0/4142603543 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980009550 con 0x7f098c15a300 2023-06-09T04:37:59.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f098bfff700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c15a300 0x7f098c0c3180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f098400c3c0 tx=0x7f098400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0973fff700 1 -- 172.21.15.149:0/4142603543 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840052d0 con 0x7f098c15a300 2023-06-09T04:37:59.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0973fff700 1 -- 172.21.15.149:0/4142603543 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984005430 con 0x7f098c15a300 2023-06-09T04:37:59.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c15d490 con 0x7f098c15a300 2023-06-09T04:37:59.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0973fff700 1 -- 172.21.15.149:0/4142603543 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840038c0 con 0x7f098c15a300 2023-06-09T04:37:59.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.767+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c15abe0 con 0x7f098c15a300 2023-06-09T04:37:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.769+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c0b1e20 con 0x7f098c15a300 2023-06-09T04:37:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.769+0000 7f0973fff700 1 -- 172.21.15.149:0/4142603543 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0984003a20 con 0x7f098c15a300 2023-06-09T04:37:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.769+0000 7f0973fff700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f097806ace0 0x7f097806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:37:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.769+0000 7f0973fff700 1 -- 172.21.15.149:0/4142603543 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0984088b30 con 0x7f098c15a300 2023-06-09T04:37:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.769+0000 7f098b7fe700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f097806ace0 0x7f097806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:37:59.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.770+0000 7f098b7fe700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f097806ace0 0x7f097806d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b5660 tx=0x7f097c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:37:59.774 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.774+0000 7f0973fff700 1 -- 172.21.15.149:0/4142603543 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0984053940 con 0x7f098c15a300 2023-06-09T04:37:59.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.961+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f098c073fa0 con 0x7f098c15a300 2023-06-09T04:37:59.961 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.961+0000 7f0973fff700 1 -- 172.21.15.149:0/4142603543 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0984017020 con 0x7f098c15a300 2023-06-09T04:37:59.962 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T04:37:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f097806ace0 msgr2=0x7f097806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f097806ace0 0x7f097806d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f098c0b5660 tx=0x7f097c00b040 comp rx=0 tx=0).stop 2023-06-09T04:37:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c15a300 msgr2=0x7f098c0c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:37:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c15a300 0x7f098c0c3180 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f098400c3c0 tx=0x7f098400c780 comp rx=0 tx=0).stop 2023-06-09T04:37:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 shutdown_connections 2023-06-09T04:37:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f097806ace0 0x7f097806d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f098c069db0 0x7f098c15bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f098c15a300 0x7f098c0c3180 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 --2- 172.21.15.149:0/4142603543 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f098c0cb690 0x7f098c14c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:37:59.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.963+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 >> 172.21.15.149:0/4142603543 conn(0x7f098c06aec0 msgr2=0x7f098c0ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:37:59.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.964+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 shutdown_connections 2023-06-09T04:37:59.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:37:59.964+0000 7f0992007700 1 -- 172.21.15.149:0/4142603543 wait complete. 2023-06-09T04:37:59.976 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:00.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.095+0000 7faed294b700 1 Processor -- start 2023-06-09T04:38:00.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faed294b700 1 -- start start 2023-06-09T04:38:00.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faed294b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 0x7faecc071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faed294b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7faecc069db0 0x7faecc06a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faed294b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc071960 con 0x7faecc072030 2023-06-09T04:38:00.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faed294b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc06a790 con 0x7faecc069db0 2023-06-09T04:38:00.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faed294b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1606c0 con 0x7faecc0cb300 2023-06-09T04:38:00.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faecb7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7faecc072030 0x7faecc0cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33676/0 (socket says 172.21.15.149:33676) 2023-06-09T04:38:00.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.096+0000 7faecb7fe700 1 -- 172.21.15.149:0/3403824459 learned_addr learned my addr 172.21.15.149:0/3403824459 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:00.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 --2- 172.21.15.149:0/3403824459 >> v2:172.21.15.184:3300/0 conn(0x7faecc069db0 0x7faecc06a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecbfff700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 0x7faecc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727159432 0 0) 0x7faecc071960 con 0x7faecc072030 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb40035b0 con 0x7faecc072030 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4170838714 0 0) 0x7faeb40035b0 con 0x7faecc072030 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 msgr2=0x7faecc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 0x7faecc071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 >> v2:172.21.15.184:3300/0 conn(0x7faecc069db0 msgr2=0x7faecc06a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 --2- 172.21.15.149:0/3403824459 >> v2:172.21.15.184:3300/0 conn(0x7faecc069db0 0x7faecc06a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc160bb0 con 0x7faecc072030 2023-06-09T04:38:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7faebc001670 con 0x7faecc072030 2023-06-09T04:38:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 --2- 172.21.15.149:0/3403824459 >> v2:172.21.15.184:3300/0 conn(0x7faecc069db0 0x7faecc06a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 >> v1:172.21.15.149:6789/0 conn(0x7faecc072030 legacy=0x7faecc0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb4003a00 0x7faeb4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 0x7faeb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb4004d90 0x7faeb4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1606c0 con 0x7faeb4004d90 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb400ba10 con 0x7faeb4003a00 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb400bb50 con 0x7faecc0cb300 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb4004d90 0x7faeb4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecbfff700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb4003a00 0x7faeb4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faecb7fe700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 0x7faeb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 -- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 msgr2=0x7faeb4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc0cb300 0x7faeb4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 -- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb4003a00 msgr2=0x7faeb4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faeb4003a00 0x7faeb4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.097+0000 7faed0ee8700 1 -- 172.21.15.149:0/3403824459 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40035b0 con 0x7faeb4004d90 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed0ee8700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb4004d90 0x7faeb4005200 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faec400e350 tx=0x7faeb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45849c71f464dcdc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec400edf0 con 0x7faeb4004d90 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec400f040 con 0x7faeb4004d90 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faecaffd700 1 -- 172.21.15.149:0/3403824459 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40146a0 con 0x7faeb4004d90 2023-06-09T04:38:00.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed294b700 1 -- 172.21.15.149:0/3403824459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb4004d90 msgr2=0x7faeb4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed294b700 1 --2- 172.21.15.149:0/3403824459 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faeb4004d90 0x7faeb4005200 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faec400e350 tx=0x7faeb4005880 comp rx=0 tx=0).stop 2023-06-09T04:38:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed0ee8700 1 -- 172.21.15.149:0/3403824459 reap_dead start 2023-06-09T04:38:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed294b700 1 -- 172.21.15.149:0/3403824459 shutdown_connections 2023-06-09T04:38:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed294b700 1 -- 172.21.15.149:0/3403824459 >> 172.21.15.149:0/3403824459 conn(0x7faecc06d180 msgr2=0x7faecc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed294b700 1 -- 172.21.15.149:0/3403824459 shutdown_connections 2023-06-09T04:38:00.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.098+0000 7faed294b700 1 -- 172.21.15.149:0/3403824459 wait complete. 2023-06-09T04:38:00.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.100+0000 7faed294b700 1 Processor -- start 2023-06-09T04:38:00.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.100+0000 7faed294b700 1 -- start start 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.100+0000 7faed294b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faecc0cfc00 0x7faecc0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.100+0000 7faed294b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faecc0cffd0 0x7faecc0ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.100+0000 7faed294b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc1f1c40 0x7faecc154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.100+0000 7faed294b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0c6ad0 con 0x7faecc0cfc00 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.100+0000 7faed294b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0c6780 con 0x7faecc0cffd0 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faed294b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0b4cc0 con 0x7faecc1f1c40 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faecc0cfc00 0x7faecc0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faecc0cfc00 0x7faecc0b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38054/0 (socket says 172.21.15.149:38054) 2023-06-09T04:38:00.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 -- 172.21.15.149:0/3659204408 learned_addr learned my addr 172.21.15.149:0/3659204408 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:00.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 -- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc1f1c40 msgr2=0x7faecc154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc1f1c40 0x7faecc154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecb7fe700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faecc0cffd0 0x7faecc0ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 -- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faecc0cffd0 msgr2=0x7faecc0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faecc0cffd0 0x7faecc0ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 -- 172.21.15.149:0/3659204408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0b4fa0 con 0x7faecc0cfc00 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecb7fe700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faecc0cffd0 0x7faecc0ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faecbfff700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faecc0cfc00 0x7faecc0b46e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faec0011a20 tx=0x7faec0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faec8ff9700 1 -- 172.21.15.149:0/3659204408 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000f940 con 0x7faecc0cfc00 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faec8ff9700 1 -- 172.21.15.149:0/3659204408 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000faa0 con 0x7faecc0cfc00 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc0b5280 con 0x7faecc0cfc00 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faec8ff9700 1 -- 172.21.15.149:0/3659204408 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000fe50 con 0x7faecc0cfc00 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.101+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc155050 con 0x7faecc0cfc00 2023-06-09T04:38:00.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.102+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc073fa0 con 0x7faecc0cfc00 2023-06-09T04:38:00.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.102+0000 7faec8ff9700 1 -- 172.21.15.149:0/3659204408 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faec0014440 con 0x7faecc0cfc00 2023-06-09T04:38:00.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.103+0000 7faec8ff9700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faeb806ace0 0x7faeb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.103+0000 7faec8ff9700 1 -- 172.21.15.149:0/3659204408 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faec0089eb0 con 0x7faecc0cfc00 2023-06-09T04:38:00.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.103+0000 7faecb7fe700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faeb806ace0 0x7faeb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.103+0000 7faecb7fe700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faeb806ace0 0x7faeb806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faebc0048d0 tx=0x7faebc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.107+0000 7faec8ff9700 1 -- 172.21.15.149:0/3659204408 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faec0058810 con 0x7faecc0cfc00 2023-06-09T04:38:00.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.335+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faecc0b1ab0 con 0x7faecc0cfc00 2023-06-09T04:38:00.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.336+0000 7faec8ff9700 1 -- 172.21.15.149:0/3659204408 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7faec00583a0 con 0x7faecc0cfc00 2023-06-09T04:38:00.336 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:00.336 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:00.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faeb806ace0 msgr2=0x7faeb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faeb806ace0 0x7faeb806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7faebc0048d0 tx=0x7faebc009040 comp rx=0 tx=0).stop 2023-06-09T04:38:00.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faecc0cfc00 msgr2=0x7faecc0b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faecc0cfc00 0x7faecc0b46e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7faec0011a20 tx=0x7faec0011de0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.338 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 shutdown_connections 2023-06-09T04:38:00.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7faeb806ace0 0x7faeb806d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7faecc1f1c40 0x7faecc154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faecc0cfc00 0x7faecc0b46e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 --2- 172.21.15.149:0/3659204408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faecc0cffd0 0x7faecc0ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 >> 172.21.15.149:0/3659204408 conn(0x7faecc06d180 msgr2=0x7faecc0b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:00.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 shutdown_connections 2023-06-09T04:38:00.339 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.338+0000 7faed294b700 1 -- 172.21.15.149:0/3659204408 wait complete. 2023-06-09T04:38:00.340 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:38:00.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.472+0000 7fb2d300b700 1 Processor -- start 2023-06-09T04:38:00.472 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.472+0000 7fb2d300b700 1 -- start start 2023-06-09T04:38:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d300b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0afa30 0x7fb2cc0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.473 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d300b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb2cc0b0c40 0x7fb2cc0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d300b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2cc0cf140 0x7fb2cc0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d300b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc0b06f0 con 0x7fb2cc0cf140 2023-06-09T04:38:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d300b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2cc0b01a0 con 0x7fb2cc0b0c40 2023-06-09T04:38:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d300b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0b0900 con 0x7fb2cc0afa30 2023-06-09T04:38:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2cc0cf140 0x7fb2cc0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb2cc0cf140 0x7fb2cc0cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38066/0 (socket says 172.21.15.149:38066) 2023-06-09T04:38:00.474 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 -- 172.21.15.149:0/2823041901 learned_addr learned my addr 172.21.15.149:0/2823041901 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2cbfff700 1 --2- 172.21.15.149:0/2823041901 >> v2:172.21.15.184:3300/0 conn(0x7fb2cc0b0c40 0x7fb2cc0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 -- 172.21.15.149:0/2823041901 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0afa30 msgr2=0x7fb2cc0b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 --2- 172.21.15.149:0/2823041901 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0afa30 0x7fb2cc0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 -- 172.21.15.149:0/2823041901 >> v2:172.21.15.184:3300/0 conn(0x7fb2cc0b0c40 msgr2=0x7fb2cc0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 --2- 172.21.15.149:0/2823041901 >> v2:172.21.15.184:3300/0 conn(0x7fb2cc0b0c40 0x7fb2cc0cd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 -- 172.21.15.149:0/2823041901 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc0ca7a0 con 0x7fb2cc0cf140 2023-06-09T04:38:00.475 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2d15a8700 1 --2- 172.21.15.149:0/2823041901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0cf140 0x7fb2cc0cd7b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc070f50 tx=0x7fb2c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c7f1f45e9d7a19 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2cb7fe700 1 -- 172.21.15.149:0/2823041901 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400e070 con 0x7fb2cc0cf140 2023-06-09T04:38:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2cb7fe700 1 -- 172.21.15.149:0/2823041901 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c400b9c0 con 0x7fb2cc0cf140 2023-06-09T04:38:00.476 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.473+0000 7fb2cb7fe700 1 -- 172.21.15.149:0/2823041901 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400bd70 con 0x7fb2cc0cf140 2023-06-09T04:38:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 -- 172.21.15.149:0/2823041901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0cf140 msgr2=0x7fb2cc0cd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 --2- 172.21.15.149:0/2823041901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0cf140 0x7fb2cc0cd7b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc070f50 tx=0x7fb2c400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 -- 172.21.15.149:0/2823041901 shutdown_connections 2023-06-09T04:38:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 --2- 172.21.15.149:0/2823041901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0cf140 0x7fb2cc0cd7b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.478 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 --2- 172.21.15.149:0/2823041901 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0afa30 0x7fb2cc0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 --2- 172.21.15.149:0/2823041901 >> v2:172.21.15.184:3300/0 conn(0x7fb2cc0b0c40 0x7fb2cc0cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 -- 172.21.15.149:0/2823041901 >> 172.21.15.149:0/2823041901 conn(0x7fb2cc06b7e0 msgr2=0x7fb2cc0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 -- 172.21.15.149:0/2823041901 shutdown_connections 2023-06-09T04:38:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.474+0000 7fb2d300b700 1 -- 172.21.15.149:0/2823041901 wait complete. 2023-06-09T04:38:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.475+0000 7fb2d300b700 1 Processor -- start 2023-06-09T04:38:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.475+0000 7fb2d300b700 1 -- start start 2023-06-09T04:38:00.479 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d300b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0afa30 0x7fb2cc14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d300b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2cc0b0c40 0x7fb2cc0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d300b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0cf140 0x7fb2cc0c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d300b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0ac6b0 con 0x7fb2cc0afa30 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d300b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0ac990 con 0x7fb2cc0b0c40 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d300b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2cc0acc70 con 0x7fb2cc0cf140 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0afa30 0x7fb2cc14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0afa30 0x7fb2cc14e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38068/0 (socket says 172.21.15.149:38068) 2023-06-09T04:38:00.480 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 -- 172.21.15.149:0/231756930 learned_addr learned my addr 172.21.15.149:0/231756930 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2cbfff700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2cc0b0c40 0x7fb2cc0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d15a8700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0cf140 0x7fb2cc0c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 -- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0cf140 msgr2=0x7fb2cc0c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0cf140 0x7fb2cc0c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 -- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2cc0b0c40 msgr2=0x7fb2cc0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2cc0b0c40 0x7fb2cc0cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.476+0000 7fb2d0da7700 1 -- 172.21.15.149:0/231756930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c4009b30 con 0x7fb2cc0afa30 2023-06-09T04:38:00.481 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.477+0000 7fb2d0da7700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0afa30 0x7fb2cc14e240 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000b520 tx=0x7fb2c000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.477+0000 7fb2c97fa700 1 -- 172.21.15.149:0/231756930 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0005aa0 con 0x7fb2cc0afa30 2023-06-09T04:38:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.477+0000 7fb2c97fa700 1 -- 172.21.15.149:0/231756930 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0005c00 con 0x7fb2cc0afa30 2023-06-09T04:38:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.477+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2cc0acf50 con 0x7fb2cc0afa30 2023-06-09T04:38:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.477+0000 7fb2c97fa700 1 -- 172.21.15.149:0/231756930 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0011630 con 0x7fb2cc0afa30 2023-06-09T04:38:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.477+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2cc14e780 con 0x7fb2cc0afa30 2023-06-09T04:38:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.478+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2cc0afe00 con 0x7fb2cc0afa30 2023-06-09T04:38:00.482 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.478+0000 7fb2c97fa700 1 -- 172.21.15.149:0/231756930 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb2c0011790 con 0x7fb2cc0afa30 2023-06-09T04:38:00.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.479+0000 7fb2c97fa700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb2b006ace0 0x7fb2b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.479+0000 7fb2cbfff700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb2b006ace0 0x7fb2b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.483 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.479+0000 7fb2c97fa700 1 -- 172.21.15.149:0/231756930 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb2c00892a0 con 0x7fb2cc0afa30 2023-06-09T04:38:00.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.479+0000 7fb2cbfff700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb2b006ace0 0x7fb2b006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc15c510 tx=0x7fb2b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.484 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.483+0000 7fb2c97fa700 1 -- 172.21.15.149:0/231756930 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb2c00540b0 con 0x7fb2cc0afa30 2023-06-09T04:38:00.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.672+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2cc073fa0 con 0x7fb2cc0afa30 2023-06-09T04:38:00.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.673+0000 7fb2c97fa700 1 -- 172.21.15.149:0/231756930 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7fb2c00576d0 con 0x7fb2cc0afa30 2023-06-09T04:38:00.673 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:00.674 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:00.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb2b006ace0 msgr2=0x7fb2b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb2b006ace0 0x7fb2b006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc15c510 tx=0x7fb2b8008040 comp rx=0 tx=0).stop 2023-06-09T04:38:00.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0afa30 msgr2=0x7fb2cc14e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0afa30 0x7fb2cc14e240 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000b520 tx=0x7fb2c000b830 comp rx=0 tx=0).stop 2023-06-09T04:38:00.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 shutdown_connections 2023-06-09T04:38:00.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb2b006ace0 0x7fb2b006d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb2cc0cf140 0x7fb2cc0c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb2cc0afa30 0x7fb2cc14e240 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 --2- 172.21.15.149:0/231756930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb2cc0b0c40 0x7fb2cc0cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 >> 172.21.15.149:0/231756930 conn(0x7fb2cc06b7e0 msgr2=0x7fb2cc0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:00.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 shutdown_connections 2023-06-09T04:38:00.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.675+0000 7fb2d300b700 1 -- 172.21.15.149:0/231756930 wait complete. 2023-06-09T04:38:00.688 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T04:38:00.688 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.809+0000 7fdf77857700 1 Processor -- start 2023-06-09T04:38:00.809 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.809+0000 7fdf77857700 1 -- start start 2023-06-09T04:38:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf77857700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b80d0 0x7fdf701606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf77857700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf700b5000 0x7fdf700cf660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf77857700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700cf1d0 con 0x7fdf700cfba0 2023-06-09T04:38:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf77857700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700ccfc0 con 0x7fdf700b5000 2023-06-09T04:38:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf77857700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700cd790 con 0x7fdf700b80d0 2023-06-09T04:38:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf74df2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf700b5000 0x7fdf700cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.811 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf74df2700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdf700b5000 0x7fdf700cf660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38076/0 (socket says 172.21.15.149:38076) 2023-06-09T04:38:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf74df2700 1 -- 172.21.15.149:0/2987174434 learned_addr learned my addr 172.21.15.149:0/2987174434 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf74df2700 1 -- 172.21.15.149:0/2987174434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b80d0 msgr2=0x7fdf701606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf74df2700 1 --2- 172.21.15.149:0/2987174434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b80d0 0x7fdf701606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf74df2700 1 -- 172.21.15.149:0/2987174434 >> v1:172.21.15.184:6789/0 conn(0x7fdf700cfba0 legacy=0x7fdf700b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.810+0000 7fdf74df2700 1 -- 172.21.15.149:0/2987174434 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70160c30 con 0x7fdf700b5000 2023-06-09T04:38:00.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf74df2700 1 --2- 172.21.15.149:0/2987174434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700b5000 0x7fdf700cf660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098f0 tx=0x7fdf6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80a4d9a58b3fcaa server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf67fff700 1 -- 172.21.15.149:0/2987174434 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c004230 con 0x7fdf700b5000 2023-06-09T04:38:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf67fff700 1 -- 172.21.15.149:0/2987174434 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c004390 con 0x7fdf700b5000 2023-06-09T04:38:00.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf67fff700 1 -- 172.21.15.149:0/2987174434 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0036a0 con 0x7fdf700b5000 2023-06-09T04:38:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 -- 172.21.15.149:0/2987174434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700b5000 msgr2=0x7fdf700cf660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 --2- 172.21.15.149:0/2987174434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700b5000 0x7fdf700cf660 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0098f0 tx=0x7fdf6c009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:00.815 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 -- 172.21.15.149:0/2987174434 shutdown_connections 2023-06-09T04:38:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 --2- 172.21.15.149:0/2987174434 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b80d0 0x7fdf701606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 --2- 172.21.15.149:0/2987174434 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700b5000 0x7fdf700cf660 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 -- 172.21.15.149:0/2987174434 >> 172.21.15.149:0/2987174434 conn(0x7fdf70072120 msgr2=0x7fdf7006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 -- 172.21.15.149:0/2987174434 shutdown_connections 2023-06-09T04:38:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.811+0000 7fdf77857700 1 -- 172.21.15.149:0/2987174434 wait complete. 2023-06-09T04:38:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 Processor -- start 2023-06-09T04:38:00.816 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 -- start start 2023-06-09T04:38:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b5000 0x7fdf7015af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf700b80d0 0x7fdf700ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700cfba0 0x7fdf700cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700cc110 con 0x7fdf700cfba0 2023-06-09T04:38:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700cb290 con 0x7fdf700b80d0 2023-06-09T04:38:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf77857700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700cb490 con 0x7fdf700b5000 2023-06-09T04:38:00.817 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf75df4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700cfba0 0x7fdf700cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf75df4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700cfba0 0x7fdf700cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38086/0 (socket says 172.21.15.149:38086) 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.813+0000 7fdf75df4700 1 -- 172.21.15.149:0/2408841193 learned_addr learned my addr 172.21.15.149:0/2408841193 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf75df4700 1 -- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b5000 msgr2=0x7fdf7015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf74df2700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf700b80d0 0x7fdf700ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf755f3700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b5000 0x7fdf7015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf75df4700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b5000 0x7fdf7015af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf75df4700 1 -- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf700b80d0 msgr2=0x7fdf700ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:00.818 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf75df4700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf700b80d0 0x7fdf700ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf75df4700 1 -- 172.21.15.149:0/2408841193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009550 con 0x7fdf700cfba0 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf755f3700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b5000 0x7fdf7015af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf74df2700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf700b80d0 0x7fdf700ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf75df4700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700cfba0 0x7fdf700cad50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b990 tx=0x7fdf6800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf65ffb700 1 -- 172.21.15.149:0/2408841193 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800c9d0 con 0x7fdf700cfba0 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf65ffb700 1 -- 172.21.15.149:0/2408841193 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800cb30 con 0x7fdf700cfba0 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf700cb770 con 0x7fdf700cfba0 2023-06-09T04:38:00.819 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf65ffb700 1 -- 172.21.15.149:0/2408841193 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68014440 con 0x7fdf700cfba0 2023-06-09T04:38:00.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.814+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf700cbd30 con 0x7fdf700cfba0 2023-06-09T04:38:00.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.815+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf700cc250 con 0x7fdf700cfba0 2023-06-09T04:38:00.820 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.816+0000 7fdf65ffb700 1 -- 172.21.15.149:0/2408841193 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf68006d50 con 0x7fdf700cfba0 2023-06-09T04:38:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.816+0000 7fdf65ffb700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf5406ace0 0x7fdf5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.816+0000 7fdf65ffb700 1 -- 172.21.15.149:0/2408841193 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf68089290 con 0x7fdf700cfba0 2023-06-09T04:38:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.816+0000 7fdf755f3700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf5406ace0 0x7fdf5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.816+0000 7fdf755f3700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf5406ace0 0x7fdf5406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf60007900 tx=0x7fdf60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:00.821 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:00.821+0000 7fdf65ffb700 1 -- 172.21.15.149:0/2408841193 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf700cc250 con 0x7fdf700cfba0 2023-06-09T04:38:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.052+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf700cc250 con 0x7fdf700cfba0 2023-06-09T04:38:01.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.052+0000 7fdf65ffb700 1 -- 172.21.15.149:0/2408841193 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7fdf700cc250 con 0x7fdf700cfba0 2023-06-09T04:38:01.052 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:01.053 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf5406ace0 msgr2=0x7fdf5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf5406ace0 0x7fdf5406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf60007900 tx=0x7fdf60008040 comp rx=0 tx=0).stop 2023-06-09T04:38:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700cfba0 msgr2=0x7fdf700cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700cfba0 0x7fdf700cad50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800b990 tx=0x7fdf6800bd50 comp rx=0 tx=0).stop 2023-06-09T04:38:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 shutdown_connections 2023-06-09T04:38:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf5406ace0 0x7fdf5406d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf700b5000 0x7fdf7015af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf700cfba0 0x7fdf700cad50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 --2- 172.21.15.149:0/2408841193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf700b80d0 0x7fdf700ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.054+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 >> 172.21.15.149:0/2408841193 conn(0x7fdf70072120 msgr2=0x7fdf700b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.055+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 shutdown_connections 2023-06-09T04:38:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.055+0000 7fdf77857700 1 -- 172.21.15.149:0/2408841193 wait complete. 2023-06-09T04:38:01.056 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:38:01.067 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:01.189 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.189+0000 7f84c3e24700 1 Processor -- start 2023-06-09T04:38:01.190 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.190+0000 7f84c3e24700 1 -- start start 2023-06-09T04:38:01.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.190+0000 7f84c3e24700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f84bc0af220 0x7f84bc0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.190+0000 7f84c3e24700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0af050 con 0x7f84bc06a4c0 2023-06-09T04:38:01.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.190+0000 7f84c3e24700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0af800 con 0x7f84bc15c590 2023-06-09T04:38:01.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.190+0000 7f84c3e24700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0afae0 con 0x7f84bc0af220 2023-06-09T04:38:01.191 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c13bf700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f84bc06a4c0 0x7f84bc0ce0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33722/0 (socket says 172.21.15.149:33722) 2023-06-09T04:38:01.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c13bf700 1 -- 172.21.15.149:0/3007989321 learned_addr learned my addr 172.21.15.149:0/3007989321 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:01.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c23c1700 1 --2- 172.21.15.149:0/3007989321 >> v2:172.21.15.149:3300/0 conn(0x7f84bc0af220 0x7f84bc0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c23c1700 1 -- 172.21.15.149:0/3007989321 >> v1:172.21.15.184:6789/0 conn(0x7f84bc15c590 legacy=0x7f84bc069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:01.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c23c1700 1 -- 172.21.15.149:0/3007989321 >> v1:172.21.15.149:6789/0 conn(0x7f84bc06a4c0 legacy=0x7f84bc0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c0bbe700 1 -- 172.21.15.149:0/3007989321 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302961046 0 0) 0x7f84bc0af050 con 0x7f84bc06a4c0 2023-06-09T04:38:01.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c23c1700 1 -- 172.21.15.149:0/3007989321 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0cc0c0 con 0x7f84bc0af220 2023-06-09T04:38:01.192 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c23c1700 1 --2- 172.21.15.149:0/3007989321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc0ccba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009d90 tx=0x7f84b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caff18793763175 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.193 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c0bbe700 1 -- 172.21.15.149:0/3007989321 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400e070 con 0x7f84bc0af220 2023-06-09T04:38:01.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c0bbe700 1 -- 172.21.15.149:0/3007989321 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b400bbd0 con 0x7f84bc0af220 2023-06-09T04:38:01.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.191+0000 7f84c0bbe700 1 -- 172.21.15.149:0/3007989321 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4003a20 con 0x7f84bc0af220 2023-06-09T04:38:01.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.192+0000 7f84c3e24700 1 -- 172.21.15.149:0/3007989321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 msgr2=0x7f84bc0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.192+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3007989321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc0ccba0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009d90 tx=0x7f84b400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:01.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.192+0000 7f84c3e24700 1 -- 172.21.15.149:0/3007989321 shutdown_connections 2023-06-09T04:38:01.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.192+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3007989321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc0ccba0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.194 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.192+0000 7f84c3e24700 1 -- 172.21.15.149:0/3007989321 >> 172.21.15.149:0/3007989321 conn(0x7f84bc06b7e0 msgr2=0x7f84bc0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:01.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.192+0000 7f84c3e24700 1 -- 172.21.15.149:0/3007989321 shutdown_connections 2023-06-09T04:38:01.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.192+0000 7f84c3e24700 1 -- 172.21.15.149:0/3007989321 wait complete. 2023-06-09T04:38:01.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.193+0000 7f84c3e24700 1 Processor -- start 2023-06-09T04:38:01.195 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c3e24700 1 -- start start 2023-06-09T04:38:01.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c3e24700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84bc06a4c0 0x7f84bc15f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c3e24700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c3e24700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84bc15c590 0x7f84bc0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c3e24700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0af620 con 0x7f84bc0af220 2023-06-09T04:38:01.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c3e24700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc15cf20 con 0x7f84bc06a4c0 2023-06-09T04:38:01.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c3e24700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc15fcd0 con 0x7f84bc15c590 2023-06-09T04:38:01.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.194+0000 7f84c13bf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38096/0 (socket says 172.21.15.149:38096) 2023-06-09T04:38:01.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 -- 172.21.15.149:0/3692263977 learned_addr learned my addr 172.21.15.149:0/3692263977 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:01.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c1bc0700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84bc06a4c0 0x7f84bc15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c23c1700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84bc15c590 0x7f84bc0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.198 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 -- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84bc15c590 msgr2=0x7f84bc0c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84bc15c590 0x7f84bc0c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 -- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84bc06a4c0 msgr2=0x7f84bc15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84bc06a4c0 0x7f84bc15f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 -- 172.21.15.149:0/3692263977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4009a70 con 0x7f84bc0af220 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c13bf700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc14cba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f84b80011e0 tx=0x7f84b800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84b27fc700 1 -- 172.21.15.149:0/3692263977 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8004c80 con 0x7f84bc0af220 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84b27fc700 1 -- 172.21.15.149:0/3692263977 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8004e00 con 0x7f84bc0af220 2023-06-09T04:38:01.199 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0c5790 con 0x7f84bc0af220 2023-06-09T04:38:01.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84b27fc700 1 -- 172.21.15.149:0/3692263977 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8007310 con 0x7f84bc0af220 2023-06-09T04:38:01.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.195+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc14d130 con 0x7f84bc0af220 2023-06-09T04:38:01.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.196+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc0c5920 con 0x7f84bc0af220 2023-06-09T04:38:01.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.197+0000 7f84b27fc700 1 -- 172.21.15.149:0/3692263977 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84b8007470 con 0x7f84bc0af220 2023-06-09T04:38:01.200 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.197+0000 7f84b27fc700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a006ace0 0x7f84a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.197+0000 7f84b27fc700 1 -- 172.21.15.149:0/3692263977 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f84b80894c0 con 0x7f84bc0af220 2023-06-09T04:38:01.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.197+0000 7f84c1bc0700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a006ace0 0x7f84a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.198+0000 7f84c1bc0700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a006ace0 0x7f84a006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f84ac006fd0 tx=0x7f84ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.202+0000 7f84b27fc700 1 -- 172.21.15.149:0/3692263977 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84b80542d0 con 0x7f84bc0af220 2023-06-09T04:38:01.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.431+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84bc073fa0 con 0x7f84bc0af220 2023-06-09T04:38:01.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.431+0000 7f84b27fc700 1 -- 172.21.15.149:0/3692263977 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4679 (secure 0 0 0) 0x7f84b80578f0 con 0x7f84bc0af220 2023-06-09T04:38:01.431 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:01.431 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/3775169316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":3775169316},{"type":"v1","addr":"172.21.15.184:6835","nonce":3775169316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/1933770994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":1933770994},{"type":"v1","addr":"172.21.15.149:6836","nonce":1933770994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4184983918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":4184983918},{"type":"v1","addr":"172.21.15.149:6837","nonce":4184983918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:36:53.063490+0000","modified":"2023-06-09T04:37:15.514379+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6833/1611193931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1611193931},{"type":"v1","addr":"172.21.15.184:6833","nonce":1611193931}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:38:01.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.433+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a006ace0 msgr2=0x7f84a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.433+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a006ace0 0x7f84a006d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f84ac006fd0 tx=0x7f84ac008040 comp rx=0 tx=0).stop 2023-06-09T04:38:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.433+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 msgr2=0x7f84bc14cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.433+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc14cba0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f84b80011e0 tx=0x7f84b800cae0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.433+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 shutdown_connections 2023-06-09T04:38:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.433+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a006ace0 0x7f84a006d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.434 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.434+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84bc15c590 0x7f84bc0c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.434+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84bc06a4c0 0x7f84bc15f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.434+0000 7f84c3e24700 1 --2- 172.21.15.149:0/3692263977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84bc0af220 0x7f84bc14cba0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.434+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 >> 172.21.15.149:0/3692263977 conn(0x7f84bc06b7e0 msgr2=0x7f84bc06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:01.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.434+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 shutdown_connections 2023-06-09T04:38:01.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.434+0000 7f84c3e24700 1 -- 172.21.15.149:0/3692263977 wait complete. 2023-06-09T04:38:01.435 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 9 2023-06-09T04:38:01.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:01.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.566+0000 7fdc903d5700 1 Processor -- start 2023-06-09T04:38:01.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.566+0000 7fdc903d5700 1 -- start start 2023-06-09T04:38:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc903d5700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdc8815c590 0x7fdc880af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc903d5700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdc880ccba0 0x7fdc880b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc903d5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc88069db0 0x7fdc8806a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc903d5700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc880afae0 con 0x7fdc880ccba0 2023-06-09T04:38:01.569 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc903d5700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8806a770 con 0x7fdc8815c590 2023-06-09T04:38:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc903d5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880af050 con 0x7fdc88069db0 2023-06-09T04:38:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc8d970700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdc880ccba0 0x7fdc880b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc8d970700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fdc880ccba0 0x7fdc880b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38102/0 (socket says 172.21.15.149:38102) 2023-06-09T04:38:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.567+0000 7fdc8d970700 1 -- 172.21.15.149:0/2543605107 learned_addr learned my addr 172.21.15.149:0/2543605107 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8e171700 1 --2- 172.21.15.149:0/2543605107 >> v2:172.21.15.184:3300/0 conn(0x7fdc8815c590 0x7fdc880af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8e972700 1 --2- 172.21.15.149:0/2543605107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc88069db0 0x7fdc8806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d970700 1 -- 172.21.15.149:0/2543605107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc88069db0 msgr2=0x7fdc8806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d970700 1 --2- 172.21.15.149:0/2543605107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc88069db0 0x7fdc8806a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d970700 1 -- 172.21.15.149:0/2543605107 >> v2:172.21.15.184:3300/0 conn(0x7fdc8815c590 msgr2=0x7fdc880af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d970700 1 --2- 172.21.15.149:0/2543605107 >> v2:172.21.15.184:3300/0 conn(0x7fdc8815c590 0x7fdc880af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d970700 1 -- 172.21.15.149:0/2543605107 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc880af800 con 0x7fdc880ccba0 2023-06-09T04:38:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d970700 1 --2- 172.21.15.149:0/2543605107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc880ccba0 0x7fdc880b06d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdc8806fcd0 tx=0x7fdc84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c81f3e35d5fa1cf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d16f700 1 -- 172.21.15.149:0/2543605107 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400b870 con 0x7fdc880ccba0 2023-06-09T04:38:01.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d16f700 1 -- 172.21.15.149:0/2543605107 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400b9d0 con 0x7fdc880ccba0 2023-06-09T04:38:01.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc8d16f700 1 -- 172.21.15.149:0/2543605107 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400bd60 con 0x7fdc880ccba0 2023-06-09T04:38:01.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc903d5700 1 -- 172.21.15.149:0/2543605107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc880ccba0 msgr2=0x7fdc880b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.573 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.568+0000 7fdc903d5700 1 --2- 172.21.15.149:0/2543605107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc880ccba0 0x7fdc880b06d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdc8806fcd0 tx=0x7fdc84009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.569+0000 7fdc903d5700 1 -- 172.21.15.149:0/2543605107 shutdown_connections 2023-06-09T04:38:01.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.569+0000 7fdc903d5700 1 --2- 172.21.15.149:0/2543605107 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc88069db0 0x7fdc8806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.569+0000 7fdc903d5700 1 --2- 172.21.15.149:0/2543605107 >> v2:172.21.15.184:3300/0 conn(0x7fdc8815c590 0x7fdc880af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.569+0000 7fdc903d5700 1 --2- 172.21.15.149:0/2543605107 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc880ccba0 0x7fdc880b06d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.569+0000 7fdc903d5700 1 -- 172.21.15.149:0/2543605107 >> 172.21.15.149:0/2543605107 conn(0x7fdc8806b7e0 msgr2=0x7fdc880cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:01.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.569+0000 7fdc903d5700 1 -- 172.21.15.149:0/2543605107 shutdown_connections 2023-06-09T04:38:01.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.569+0000 7fdc903d5700 1 -- 172.21.15.149:0/2543605107 wait complete. 2023-06-09T04:38:01.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.570+0000 7fdc903d5700 1 Processor -- start 2023-06-09T04:38:01.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.570+0000 7fdc903d5700 1 -- start start 2023-06-09T04:38:01.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc88069db0 0x7fdc8814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880ccba0 0x7fdc880c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8815c590 0x7fdc880c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880b3760 con 0x7fdc88069db0 2023-06-09T04:38:01.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880c9880 con 0x7fdc8815c590 2023-06-09T04:38:01.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc880b39b0 con 0x7fdc880ccba0 2023-06-09T04:38:01.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc88069db0 0x7fdc8814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc88069db0 0x7fdc8814da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38108/0 (socket says 172.21.15.149:38108) 2023-06-09T04:38:01.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 -- 172.21.15.149:0/166617114 learned_addr learned my addr 172.21.15.149:0/166617114 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:01.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 -- 172.21.15.149:0/166617114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880ccba0 msgr2=0x7fdc880c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880ccba0 0x7fdc880c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 -- 172.21.15.149:0/166617114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8815c590 msgr2=0x7fdc880c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8815c590 0x7fdc880c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 -- 172.21.15.149:0/166617114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009550 con 0x7fdc88069db0 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc8e171700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc88069db0 0x7fdc8814da90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800d7d0 tx=0x7fdc7800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc7effd700 1 -- 172.21.15.149:0/166617114 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc780125f0 con 0x7fdc88069db0 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc7effd700 1 -- 172.21.15.149:0/166617114 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc78012750 con 0x7fdc88069db0 2023-06-09T04:38:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc880b3c90 con 0x7fdc88069db0 2023-06-09T04:38:01.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc7effd700 1 -- 172.21.15.149:0/166617114 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78012b00 con 0x7fdc88069db0 2023-06-09T04:38:01.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.571+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8814dfd0 con 0x7fdc88069db0 2023-06-09T04:38:01.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.572+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc880b41b0 con 0x7fdc88069db0 2023-06-09T04:38:01.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.573+0000 7fdc7effd700 1 -- 172.21.15.149:0/166617114 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc78012c60 con 0x7fdc88069db0 2023-06-09T04:38:01.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.573+0000 7fdc7effd700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdc6c06ace0 0x7fdc6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.573+0000 7fdc7effd700 1 -- 172.21.15.149:0/166617114 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc780899f0 con 0x7fdc88069db0 2023-06-09T04:38:01.580 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.573+0000 7fdc8d970700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdc6c06ace0 0x7fdc6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.574+0000 7fdc8d970700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdc6c06ace0 0x7fdc6c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc880c9130 tx=0x7fdc84010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.578+0000 7fdc7effd700 1 -- 172.21.15.149:0/166617114 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc880b41b0 con 0x7fdc88069db0 2023-06-09T04:38:01.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.768+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc880b41b0 con 0x7fdc88069db0 2023-06-09T04:38:01.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.769+0000 7fdc7effd700 1 -- 172.21.15.149:0/166617114 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20169 (secure 0 0 0) 0x7fdc880b41b0 con 0x7fdc88069db0 2023-06-09T04:38:01.770 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:01.770 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":28,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:37:41.665636+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:36:50.781489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:36:52.029580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:36:55.100412+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdc6c06ace0 msgr2=0x7fdc6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdc6c06ace0 0x7fdc6c06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc880c9130 tx=0x7fdc84010000 comp rx=0 tx=0).stop 2023-06-09T04:38:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc88069db0 msgr2=0x7fdc8814da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc88069db0 0x7fdc8814da90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800d7d0 tx=0x7fdc7800db90 comp rx=0 tx=0).stop 2023-06-09T04:38:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 shutdown_connections 2023-06-09T04:38:01.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdc6c06ace0 0x7fdc6c06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc8815c590 0x7fdc880c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdc88069db0 0x7fdc8814da90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 --2- 172.21.15.149:0/166617114 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdc880ccba0 0x7fdc880c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.771+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 >> 172.21.15.149:0/166617114 conn(0x7fdc8806b7e0 msgr2=0x7fdc880b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.772+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 shutdown_connections 2023-06-09T04:38:01.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.772+0000 7fdc903d5700 1 -- 172.21.15.149:0/166617114 wait complete. 2023-06-09T04:38:01.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-09T04:38:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.905+0000 7fda82178700 1 Processor -- start 2023-06-09T04:38:01.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.905+0000 7fda82178700 1 -- start start 2023-06-09T04:38:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda82178700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c15e050 0x7fda7c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda82178700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fda7c0cd150 0x7fda7c0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda82178700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda7c0cc500 0x7fda7c0cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda82178700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c15e960 con 0x7fda7c0cc500 2023-06-09T04:38:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda82178700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda7c0cdb80 con 0x7fda7c0cd150 2023-06-09T04:38:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda82178700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0ce310 con 0x7fda7c15e050 2023-06-09T04:38:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda7bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda7c0cc500 0x7fda7c0cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda7bfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fda7c0cc500 0x7fda7c0cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38120/0 (socket says 172.21.15.149:38120) 2023-06-09T04:38:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda7bfff700 1 -- 172.21.15.149:0/2274153607 learned_addr learned my addr 172.21.15.149:0/2274153607 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda7affd700 1 --2- 172.21.15.149:0/2274153607 >> v2:172.21.15.184:3300/0 conn(0x7fda7c0cd150 0x7fda7c0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.906+0000 7fda7b7fe700 1 --2- 172.21.15.149:0/2274153607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c15e050 0x7fda7c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7bfff700 1 -- 172.21.15.149:0/2274153607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c15e050 msgr2=0x7fda7c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7bfff700 1 --2- 172.21.15.149:0/2274153607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c15e050 0x7fda7c15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7bfff700 1 -- 172.21.15.149:0/2274153607 >> v2:172.21.15.184:3300/0 conn(0x7fda7c0cd150 msgr2=0x7fda7c0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7bfff700 1 --2- 172.21.15.149:0/2274153607 >> v2:172.21.15.184:3300/0 conn(0x7fda7c0cd150 0x7fda7c0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7bfff700 1 -- 172.21.15.149:0/2274153607 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c0ce5f0 con 0x7fda7c0cc500 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7affd700 1 --2- 172.21.15.149:0/2274153607 >> v2:172.21.15.184:3300/0 conn(0x7fda7c0cd150 0x7fda7c0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7bfff700 1 --2- 172.21.15.149:0/2274153607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cc500 0x7fda7c0cc940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0d1840 tx=0x7fda7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0818e43d15980a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7a7fc700 1 -- 172.21.15.149:0/2274153607 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400e070 con 0x7fda7c0cc500 2023-06-09T04:38:01.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7a7fc700 1 -- 172.21.15.149:0/2274153607 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7400b9c0 con 0x7fda7c0cc500 2023-06-09T04:38:01.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda7a7fc700 1 -- 172.21.15.149:0/2274153607 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7400bd70 con 0x7fda7c0cc500 2023-06-09T04:38:01.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda82178700 1 -- 172.21.15.149:0/2274153607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cc500 msgr2=0x7fda7c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda82178700 1 --2- 172.21.15.149:0/2274153607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cc500 0x7fda7c0cc940 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fda7c0d1840 tx=0x7fda7400b330 comp rx=0 tx=0).stop 2023-06-09T04:38:01.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda82178700 1 -- 172.21.15.149:0/2274153607 shutdown_connections 2023-06-09T04:38:01.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda82178700 1 --2- 172.21.15.149:0/2274153607 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cc500 0x7fda7c0cc940 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda82178700 1 --2- 172.21.15.149:0/2274153607 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c15e050 0x7fda7c15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda82178700 1 --2- 172.21.15.149:0/2274153607 >> v2:172.21.15.184:3300/0 conn(0x7fda7c0cd150 0x7fda7c0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.907+0000 7fda82178700 1 -- 172.21.15.149:0/2274153607 >> 172.21.15.149:0/2274153607 conn(0x7fda7c069db0 msgr2=0x7fda7c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.908+0000 7fda82178700 1 -- 172.21.15.149:0/2274153607 shutdown_connections 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.908+0000 7fda82178700 1 -- 172.21.15.149:0/2274153607 wait complete. 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.909+0000 7fda82178700 1 Processor -- start 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.909+0000 7fda82178700 1 -- start start 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c0cc500 0x7fda7c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cd150 0x7fda7c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c15e050 0x7fda7c1f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0c52c0 con 0x7fda7c0cd150 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0c5580 con 0x7fda7c15e050 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda7c0c5860 con 0x7fda7c0cc500 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cd150 0x7fda7c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cd150 0x7fda7c15a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38124/0 (socket says 172.21.15.149:38124) 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 -- 172.21.15.149:0/917021318 learned_addr learned my addr 172.21.15.149:0/917021318 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7bfff700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c15e050 0x7fda7c1f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.914 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7b7fe700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c0cc500 0x7fda7c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 -- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c0cc500 msgr2=0x7fda7c0c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c0cc500 0x7fda7c0c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 -- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c15e050 msgr2=0x7fda7c1f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:01.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c15e050 0x7fda7c1f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:01.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 -- 172.21.15.149:0/917021318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009b30 con 0x7fda7c0cd150 2023-06-09T04:38:01.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda7affd700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cd150 0x7fda7c15a550 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c750 tx=0x7fda6c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda73fff700 1 -- 172.21.15.149:0/917021318 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c011800 con 0x7fda7c0cd150 2023-06-09T04:38:01.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda73fff700 1 -- 172.21.15.149:0/917021318 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c011960 con 0x7fda7c0cd150 2023-06-09T04:38:01.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda73fff700 1 -- 172.21.15.149:0/917021318 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c011cd0 con 0x7fda7c0cd150 2023-06-09T04:38:01.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7c0c5b40 con 0x7fda7c0cd150 2023-06-09T04:38:01.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.910+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7c15aa90 con 0x7fda7c0cd150 2023-06-09T04:38:01.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.911+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7c0c6060 con 0x7fda7c0cd150 2023-06-09T04:38:01.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.912+0000 7fda73fff700 1 -- 172.21.15.149:0/917021318 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda6c021350 con 0x7fda7c0cd150 2023-06-09T04:38:01.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.912+0000 7fda73fff700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fda5c06ace0 0x7fda5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:01.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.912+0000 7fda73fff700 1 -- 172.21.15.149:0/917021318 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda6c089550 con 0x7fda7c0cd150 2023-06-09T04:38:01.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.912+0000 7fda7b7fe700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fda5c06ace0 0x7fda5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:01.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.913+0000 7fda7b7fe700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fda5c06ace0 0x7fda5c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda64006b20 tx=0x7fda64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:01.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:01.917+0000 7fda73fff700 1 -- 172.21.15.149:0/917021318 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda7c0c6060 con 0x7fda7c0cd150 2023-06-09T04:38:02.146 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.146+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fda7c0c6060 con 0x7fda7c0cd150 2023-06-09T04:38:02.750 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-06-09T04:38:02.750+0000 7f4f29c7c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-09T04:38:02.756 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.756+0000 7fda73fff700 1 -- 172.21.15.149:0/917021318 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fda7c0c6060 con 0x7fda7c0cd150 2023-06-09T04:38:02.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fda5c06ace0 msgr2=0x7fda5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fda5c06ace0 0x7fda5c06d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda64006b20 tx=0x7fda64008040 comp rx=0 tx=0).stop 2023-06-09T04:38:02.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cd150 msgr2=0x7fda7c15a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cd150 0x7fda7c15a550 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda6c00c750 tx=0x7fda6c00ca60 comp rx=0 tx=0).stop 2023-06-09T04:38:02.760 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 shutdown_connections 2023-06-09T04:38:02.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fda5c06ace0 0x7fda5c06d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fda7c0cc500 0x7fda7c0c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda7c15e050 0x7fda7c1f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 --2- 172.21.15.149:0/917021318 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda7c0cd150 0x7fda7c15a550 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 >> 172.21.15.149:0/917021318 conn(0x7fda7c069db0 msgr2=0x7fda7c0b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:02.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 shutdown_connections 2023-06-09T04:38:02.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.760+0000 7fda82178700 1 -- 172.21.15.149:0/917021318 wait complete. 2023-06-09T04:38:02.762 INFO:tasks.ceph.mds.d.smithi184.stderr: -5829> 2023-06-09T04:36:58.738+0000 7f273e8bb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:38:02.762 INFO:teuthology.orchestra.run.smithi149.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-09T04:38:02.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-09T04:38:02.795 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-06-09T04:38:02.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.898+0000 7f668cda9700 1 Processor -- start 2023-06-09T04:38:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.898+0000 7f668cda9700 1 -- start start 2023-06-09T04:38:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.899+0000 7f668cda9700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6688159380 0x7f66880716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.899+0000 7f668cda9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880cd930 0x7f66880ca580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.899+0000 7f668cda9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668806f480 con 0x7f66880b1dc0 2023-06-09T04:38:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.899+0000 7f668cda9700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880b10d0 con 0x7f6688159380 2023-06-09T04:38:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.899+0000 7f668cda9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668806f760 con 0x7f66880cd930 2023-06-09T04:38:02.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.899+0000 7f668659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6688159380 0x7f66880716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6686d9d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880cd930 0x7f66880ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6685d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f66880b1dc0 0x7f66880cd220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:39760/0 (socket says 172.21.15.149:39760) 2023-06-09T04:38:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f668659c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6688159380 0x7f66880716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:57394/0 (socket says 172.21.15.149:57394) 2023-06-09T04:38:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6685d9b700 1 -- 172.21.15.149:0/3608619583 learned_addr learned my addr 172.21.15.149:0/3608619583 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6686d9d700 1 -- 172.21.15.149:0/3608619583 >> v2:172.21.15.184:3300/0 conn(0x7f6688159380 msgr2=0x7f66880716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6686d9d700 1 --2- 172.21.15.149:0/3608619583 >> v2:172.21.15.184:3300/0 conn(0x7f6688159380 0x7f66880716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6686d9d700 1 -- 172.21.15.149:0/3608619583 >> v1:172.21.15.184:6789/0 conn(0x7f66880b1dc0 legacy=0x7f66880cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6686d9d700 1 -- 172.21.15.149:0/3608619583 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880b12e0 con 0x7f66880cd930 2023-06-09T04:38:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f668659c700 1 --2- 172.21.15.149:0/3608619583 >> v2:172.21.15.184:3300/0 conn(0x7f6688159380 0x7f66880716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f6686d9d700 1 --2- 172.21.15.149:0/3608619583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880cd930 0x7f66880ca580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6680009d90 tx=0x7f668000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da2ee91012d5feea server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f668559a700 1 -- 172.21.15.149:0/3608619583 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000e070 con 0x7f66880cd930 2023-06-09T04:38:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f668559a700 1 -- 172.21.15.149:0/3608619583 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668000bb20 con 0x7f66880cd930 2023-06-09T04:38:02.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.900+0000 7f668559a700 1 -- 172.21.15.149:0/3608619583 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680012430 con 0x7f66880cd930 2023-06-09T04:38:02.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 -- 172.21.15.149:0/3608619583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880cd930 msgr2=0x7f66880ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 --2- 172.21.15.149:0/3608619583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880cd930 0x7f66880ca580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6680009d90 tx=0x7f668000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 -- 172.21.15.149:0/3608619583 shutdown_connections 2023-06-09T04:38:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 --2- 172.21.15.149:0/3608619583 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880cd930 0x7f66880ca580 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 --2- 172.21.15.149:0/3608619583 >> v2:172.21.15.184:3300/0 conn(0x7f6688159380 0x7f66880716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 -- 172.21.15.149:0/3608619583 >> 172.21.15.149:0/3608619583 conn(0x7f668806aec0 msgr2=0x7f668806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 -- 172.21.15.149:0/3608619583 shutdown_connections 2023-06-09T04:38:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.901+0000 7f668cda9700 1 -- 172.21.15.149:0/3608619583 wait complete. 2023-06-09T04:38:02.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.902+0000 7f668cda9700 1 Processor -- start 2023-06-09T04:38:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.902+0000 7f668cda9700 1 -- start start 2023-06-09T04:38:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f668cda9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880b1dc0 0x7f66881f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f668cda9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66880cd930 0x7f66880c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f668cda9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688159380 0x7f66881524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f668cda9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880c9000 con 0x7f66880cd930 2023-06-09T04:38:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f668cda9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66881597e0 con 0x7f6688159380 2023-06-09T04:38:02.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f668cda9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880c9230 con 0x7f66880b1dc0 2023-06-09T04:38:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66880cd930 0x7f66880c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66880cd930 0x7f66880c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38138/0 (socket says 172.21.15.149:38138) 2023-06-09T04:38:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 -- 172.21.15.149:0/3537289705 learned_addr learned my addr 172.21.15.149:0/3537289705 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6686d9d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688159380 0x7f66881524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f668659c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880b1dc0 0x7f66881f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 -- 172.21.15.149:0/3537289705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880b1dc0 msgr2=0x7f66881f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880b1dc0 0x7f66881f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 -- 172.21.15.149:0/3537289705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688159380 msgr2=0x7f66881524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:02.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688159380 0x7f66881524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:02.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.903+0000 7f6685d9b700 1 -- 172.21.15.149:0/3537289705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0094a0 con 0x7f66880cd930 2023-06-09T04:38:02.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.904+0000 7f6685d9b700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66880cd930 0x7f66880c8ac0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f667800c520 tx=0x7f667800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:02.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.904+0000 7f6676ffd700 1 -- 172.21.15.149:0/3537289705 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678005d70 con 0x7f66880cd930 2023-06-09T04:38:02.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.904+0000 7f6676ffd700 1 -- 172.21.15.149:0/3537289705 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66780070d0 con 0x7f66880cd930 2023-06-09T04:38:02.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.904+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6680009a70 con 0x7f66880cd930 2023-06-09T04:38:02.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.904+0000 7f6676ffd700 1 -- 172.21.15.149:0/3537289705 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678007440 con 0x7f66880cd930 2023-06-09T04:38:02.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.904+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6688159a80 con 0x7f66880cd930 2023-06-09T04:38:02.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.905+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6688073fa0 con 0x7f66880cd930 2023-06-09T04:38:02.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.905+0000 7f6676ffd700 1 -- 172.21.15.149:0/3537289705 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66780075a0 con 0x7f66880cd930 2023-06-09T04:38:02.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.906+0000 7f6676ffd700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f666806ace0 0x7f666806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:02.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.906+0000 7f6676ffd700 1 -- 172.21.15.149:0/3537289705 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f6678088a50 con 0x7f66880cd930 2023-06-09T04:38:02.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.906+0000 7f668659c700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f666806ace0 0x7f666806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:02.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.906+0000 7f668659c700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f666806ace0 0x7f666806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f667c009cd0 tx=0x7f667c009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:02.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:02.911+0000 7f6676ffd700 1 -- 172.21.15.149:0/3537289705 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6678053840 con 0x7f66880cd930 2023-06-09T04:38:03.140 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.140+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f66880b15c0 con 0x7f66880cd930 2023-06-09T04:38:03.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.758+0000 7f6676ffd700 1 -- 172.21.15.149:0/3537289705 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6678056e60 con 0x7f66880cd930 2023-06-09T04:38:03.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f666806ace0 msgr2=0x7f666806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f666806ace0 0x7f666806d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f667c009cd0 tx=0x7f667c009210 comp rx=0 tx=0).stop 2023-06-09T04:38:03.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66880cd930 msgr2=0x7f66880c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66880cd930 0x7f66880c8ac0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f667800c520 tx=0x7f667800c830 comp rx=0 tx=0).stop 2023-06-09T04:38:03.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 shutdown_connections 2023-06-09T04:38:03.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f666806ace0 0x7f666806d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f66880b1dc0 0x7f66881f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688159380 0x7f66881524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 --2- 172.21.15.149:0/3537289705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f66880cd930 0x7f66880c8ac0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.760+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 >> 172.21.15.149:0/3537289705 conn(0x7f668806aec0 msgr2=0x7f6688157970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:03.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.761+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 shutdown_connections 2023-06-09T04:38:03.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.761+0000 7f668cda9700 1 -- 172.21.15.149:0/3537289705 wait complete. 2023-06-09T04:38:03.774 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-09T04:38:03.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.900+0000 7f3cbea50700 1 Processor -- start 2023-06-09T04:38:03.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.900+0000 7f3cbea50700 1 -- start start 2023-06-09T04:38:03.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cbea50700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb815c660 0x7f3cb80ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cbea50700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3cb806a4c0 0x7f3cb80ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.901 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cbea50700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb80ac380 con 0x7f3cb80cc180 2023-06-09T04:38:03.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cbea50700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb80acc20 con 0x7f3cb806a4c0 2023-06-09T04:38:03.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cbea50700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80c9dc0 con 0x7f3cb815c660 2023-06-09T04:38:03.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cb7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb815c660 0x7f3cb80ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cbcfed700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3cb806a4c0 0x7f3cb80ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cb77fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3cb80cc180 0x7f3cb8069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:39774/0 (socket says 172.21.15.149:39774) 2023-06-09T04:38:03.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cb77fe700 1 -- 172.21.15.149:0/205128070 learned_addr learned my addr 172.21.15.149:0/205128070 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:03.902 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cbcfed700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3cb806a4c0 0x7f3cb80ad0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:57412/0 (socket says 172.21.15.149:57412) 2023-06-09T04:38:03.903 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.901+0000 7f3cb7fff700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb815c660 0x7f3cb80ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:43756/0 (socket says 172.21.15.149:43756) 2023-06-09T04:38:03.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb7fff700 1 -- 172.21.15.149:0/205128070 >> v2:172.21.15.184:3300/0 conn(0x7f3cb806a4c0 msgr2=0x7f3cb80ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:03.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb7fff700 1 --2- 172.21.15.149:0/205128070 >> v2:172.21.15.184:3300/0 conn(0x7f3cb806a4c0 0x7f3cb80ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.904 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb7fff700 1 -- 172.21.15.149:0/205128070 >> v1:172.21.15.184:6789/0 conn(0x7f3cb80cc180 legacy=0x7f3cb8069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb7fff700 1 -- 172.21.15.149:0/205128070 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb80aecb0 con 0x7f3cb815c660 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cbcfed700 1 --2- 172.21.15.149:0/205128070 >> v2:172.21.15.184:3300/0 conn(0x7f3cb806a4c0 0x7f3cb80ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb7fff700 1 --2- 172.21.15.149:0/205128070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb815c660 0x7f3cb80ae5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009820 tx=0x7f3cac009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61940de377e8d8f3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb6ffd700 1 -- 172.21.15.149:0/205128070 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac005e30 con 0x7f3cb815c660 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb6ffd700 1 -- 172.21.15.149:0/205128070 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac006030 con 0x7f3cb815c660 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cb6ffd700 1 -- 172.21.15.149:0/205128070 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0063c0 con 0x7f3cb815c660 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cbea50700 1 -- 172.21.15.149:0/205128070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb815c660 msgr2=0x7f3cb80ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.905 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cbea50700 1 --2- 172.21.15.149:0/205128070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb815c660 0x7f3cb80ae5b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009820 tx=0x7f3cac009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:03.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cbea50700 1 -- 172.21.15.149:0/205128070 shutdown_connections 2023-06-09T04:38:03.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cbea50700 1 --2- 172.21.15.149:0/205128070 >> v2:172.21.15.184:3300/0 conn(0x7f3cb806a4c0 0x7f3cb80ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cbea50700 1 --2- 172.21.15.149:0/205128070 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb815c660 0x7f3cb80ae5b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.902+0000 7f3cbea50700 1 -- 172.21.15.149:0/205128070 >> 172.21.15.149:0/205128070 conn(0x7f3cb8098b20 msgr2=0x7f3cb806b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:03.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.903+0000 7f3cbea50700 1 -- 172.21.15.149:0/205128070 shutdown_connections 2023-06-09T04:38:03.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.903+0000 7f3cbea50700 1 -- 172.21.15.149:0/205128070 wait complete. 2023-06-09T04:38:03.906 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.904+0000 7f3cbea50700 1 Processor -- start 2023-06-09T04:38:03.907 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.904+0000 7f3cbea50700 1 -- start start 2023-06-09T04:38:03.908 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb806a4c0 0x7f3cb80c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb80cc180 0x7f3cb815aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb815c660 0x7f3cb80b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80c31d0 con 0x7f3cb815c660 2023-06-09T04:38:03.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80c3790 con 0x7f3cb806a4c0 2023-06-09T04:38:03.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb80b5170 con 0x7f3cb80cc180 2023-06-09T04:38:03.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb815c660 0x7f3cb80b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.909 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb815c660 0x7f3cb80b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38154/0 (socket says 172.21.15.149:38154) 2023-06-09T04:38:03.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 -- 172.21.15.149:0/1338198917 learned_addr learned my addr 172.21.15.149:0/1338198917 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:03.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cb77fe700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb80cc180 0x7f3cb815aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cb7fff700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb806a4c0 0x7f3cb80c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 -- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb80cc180 msgr2=0x7f3cb815aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb80cc180 0x7f3cb815aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 -- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb806a4c0 msgr2=0x7f3cb80c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:03.910 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb806a4c0 0x7f3cb80c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:03.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 -- 172.21.15.149:0/1338198917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0009a70 con 0x7f3cb815c660 2023-06-09T04:38:03.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cb7fff700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb806a4c0 0x7f3cb80c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:03.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbcfed700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb815c660 0x7f3cb80b3da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009f00 tx=0x7f3cb000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:03.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cb4ff9700 1 -- 172.21.15.149:0/1338198917 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0009d70 con 0x7f3cb815c660 2023-06-09T04:38:03.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cb4ff9700 1 -- 172.21.15.149:0/1338198917 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000f040 con 0x7f3cb815c660 2023-06-09T04:38:03.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cb4ff9700 1 -- 172.21.15.149:0/1338198917 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0014680 con 0x7f3cb815c660 2023-06-09T04:38:03.911 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cac009430 con 0x7f3cb815c660 2023-06-09T04:38:03.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.905+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb80c3420 con 0x7f3cb815c660 2023-06-09T04:38:03.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.906+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb806e860 con 0x7f3cb815c660 2023-06-09T04:38:03.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.907+0000 7f3cb4ff9700 1 -- 172.21.15.149:0/1338198917 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3cb00147e0 con 0x7f3cb815c660 2023-06-09T04:38:03.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.907+0000 7f3cb4ff9700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ca406ace0 0x7f3ca406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:03.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.907+0000 7f3cb4ff9700 1 -- 172.21.15.149:0/1338198917 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f3cb008a5b0 con 0x7f3cb815c660 2023-06-09T04:38:03.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.907+0000 7f3cb7fff700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ca406ace0 0x7f3ca406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:03.912 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.908+0000 7f3cb7fff700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ca406ace0 0x7f3ca406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009b70 tx=0x7f3cac008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:03.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:03.912+0000 7f3cb4ff9700 1 -- 172.21.15.149:0/1338198917 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3cb0055370 con 0x7f3cb815c660 2023-06-09T04:38:04.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.099+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3cb804e090 con 0x7f3cb815c660 2023-06-09T04:38:04.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.761+0000 7f3cb4ff9700 1 -- 172.21.15.149:0/1338198917 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3cb000cea0 con 0x7f3cb815c660 2023-06-09T04:38:04.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.766+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ca406ace0 msgr2=0x7f3ca406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.766+0000 7f3cbea50700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ca406ace0 0x7f3ca406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009b70 tx=0x7f3cac008070 comp rx=0 tx=0).stop 2023-06-09T04:38:04.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.766+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb815c660 msgr2=0x7f3cb80b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.767 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.767+0000 7f3cbea50700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb815c660 0x7f3cb80b3da0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009f00 tx=0x7f3cb000c3a0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.768+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 shutdown_connections 2023-06-09T04:38:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.768+0000 7f3cbea50700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f3ca406ace0 0x7f3ca406d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.768+0000 7f3cbea50700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3cb815c660 0x7f3cb80b3da0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.768+0000 7f3cbea50700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cb806a4c0 0x7f3cb80c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.768+0000 7f3cbea50700 1 --2- 172.21.15.149:0/1338198917 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3cb80cc180 0x7f3cb815aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.768+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 >> 172.21.15.149:0/1338198917 conn(0x7f3cb8098b20 msgr2=0x7f3cb80cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:04.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.768+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 shutdown_connections 2023-06-09T04:38:04.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.769+0000 7f3cbea50700 1 -- 172.21.15.149:0/1338198917 wait complete. 2023-06-09T04:38:04.771 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' removed 2023-06-09T04:38:04.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-09T04:38:04.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.915+0000 7fbd13442700 1 Processor -- start 2023-06-09T04:38:04.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.915+0000 7fbd13442700 1 -- start start 2023-06-09T04:38:04.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd13442700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbd0c15c660 0x7fbd0c0ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd13442700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbd0c0cc180 0x7fbd0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd13442700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0c0ac380 con 0x7fbd0c06a2f0 2023-06-09T04:38:04.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd13442700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c06a770 con 0x7fbd0c15c660 2023-06-09T04:38:04.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd13442700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0c0acc20 con 0x7fbd0c0cc180 2023-06-09T04:38:04.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd111de700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fbd0c15c660 0x7fbd0c0ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd119df700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fbd0c06a2f0 0x7fbd0c06cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33792/0 (socket says 172.21.15.149:33792) 2023-06-09T04:38:04.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd119df700 1 -- 172.21.15.149:0/1335416610 learned_addr learned my addr 172.21.15.149:0/1335416610 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:04.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd109dd700 1 --2- 172.21.15.149:0/1335416610 >> v2:172.21.15.184:3300/0 conn(0x7fbd0c0cc180 0x7fbd0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd111de700 1 -- 172.21.15.149:0/1335416610 >> v2:172.21.15.184:3300/0 conn(0x7fbd0c0cc180 msgr2=0x7fbd0c069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:04.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd111de700 1 --2- 172.21.15.149:0/1335416610 >> v2:172.21.15.184:3300/0 conn(0x7fbd0c0cc180 0x7fbd0c069db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd111de700 1 -- 172.21.15.149:0/1335416610 >> v1:172.21.15.149:6789/0 conn(0x7fbd0c06a2f0 legacy=0x7fbd0c06cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd111de700 1 -- 172.21.15.149:0/1335416610 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0c0c9dc0 con 0x7fbd0c15c660 2023-06-09T04:38:04.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd03fff700 1 -- 172.21.15.149:0/1335416610 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224898402 0 0) 0x7fbd0c0ac380 con 0x7fbd0c06a2f0 2023-06-09T04:38:04.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd111de700 1 --2- 172.21.15.149:0/1335416610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c15c660 0x7fbd0c0ae5b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0b2360 tx=0x7fbd08009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2032f41b61a7126 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd03fff700 1 -- 172.21.15.149:0/1335416610 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08005e30 con 0x7fbd0c15c660 2023-06-09T04:38:04.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd03fff700 1 -- 172.21.15.149:0/1335416610 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd08006030 con 0x7fbd0c15c660 2023-06-09T04:38:04.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.916+0000 7fbd03fff700 1 -- 172.21.15.149:0/1335416610 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd080063c0 con 0x7fbd0c15c660 2023-06-09T04:38:04.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 -- 172.21.15.149:0/1335416610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c15c660 msgr2=0x7fbd0c0ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 --2- 172.21.15.149:0/1335416610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c15c660 0x7fbd0c0ae5b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbd0c0b2360 tx=0x7fbd08009b00 comp rx=0 tx=0).stop 2023-06-09T04:38:04.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 -- 172.21.15.149:0/1335416610 shutdown_connections 2023-06-09T04:38:04.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 --2- 172.21.15.149:0/1335416610 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c15c660 0x7fbd0c0ae5b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 --2- 172.21.15.149:0/1335416610 >> v2:172.21.15.184:3300/0 conn(0x7fbd0c0cc180 0x7fbd0c069db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 -- 172.21.15.149:0/1335416610 >> 172.21.15.149:0/1335416610 conn(0x7fbd0c098b20 msgr2=0x7fbd0c06b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:04.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 -- 172.21.15.149:0/1335416610 shutdown_connections 2023-06-09T04:38:04.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.917+0000 7fbd13442700 1 -- 172.21.15.149:0/1335416610 wait complete. 2023-06-09T04:38:04.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.918+0000 7fbd13442700 1 Processor -- start 2023-06-09T04:38:04.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.918+0000 7fbd13442700 1 -- start start 2023-06-09T04:38:04.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd13442700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd0c06a2f0 0x7fbd0c150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd13442700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c0cc180 0x7fbd0c0cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd13442700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd0c15c660 0x7fbd0c0cf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd13442700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c3800 con 0x7fbd0c0cc180 2023-06-09T04:38:04.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd13442700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c0c31d0 con 0x7fbd0c06a2f0 2023-06-09T04:38:04.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd13442700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0c159b40 con 0x7fbd0c15c660 2023-06-09T04:38:04.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd109dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c0cc180 0x7fbd0c0cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd109dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c0cc180 0x7fbd0c0cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38166/0 (socket says 172.21.15.149:38166) 2023-06-09T04:38:04.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd109dd700 1 -- 172.21.15.149:0/2856189983 learned_addr learned my addr 172.21.15.149:0/2856189983 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:04.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd111de700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd0c06a2f0 0x7fbd0c150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.919+0000 7fbd119df700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd0c15c660 0x7fbd0c0cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd109dd700 1 -- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd0c15c660 msgr2=0x7fbd0c0cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd109dd700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd0c15c660 0x7fbd0c0cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd109dd700 1 -- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd0c06a2f0 msgr2=0x7fbd0c150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd109dd700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd0c06a2f0 0x7fbd0c150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd109dd700 1 -- 172.21.15.149:0/2856189983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd08009430 con 0x7fbd0c0cc180 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd109dd700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c0cc180 0x7fbd0c0cf120 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00e810 tx=0x7fbcfc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd01ffb700 1 -- 172.21.15.149:0/2856189983 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00c070 con 0x7fbd0c0cc180 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd01ffb700 1 -- 172.21.15.149:0/2856189983 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc013610 con 0x7fbd0c0cc180 2023-06-09T04:38:04.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0c159e20 con 0x7fbd0c0cc180 2023-06-09T04:38:04.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd01ffb700 1 -- 172.21.15.149:0/2856189983 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc0139c0 con 0x7fbd0c0cc180 2023-06-09T04:38:04.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.920+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0c1506a0 con 0x7fbd0c0cc180 2023-06-09T04:38:04.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.921+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0c0c3a70 con 0x7fbd0c0cc180 2023-06-09T04:38:04.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.921+0000 7fbd01ffb700 1 -- 172.21.15.149:0/2856189983 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbcfc013b20 con 0x7fbd0c0cc180 2023-06-09T04:38:04.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.922+0000 7fbd01ffb700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:04.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.922+0000 7fbd01ffb700 1 -- 172.21.15.149:0/2856189983 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fbcfc0893a0 con 0x7fbd0c0cc180 2023-06-09T04:38:04.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.922+0000 7fbd111de700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:04.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.922+0000 7fbd111de700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fbcf006ace0 0x7fbcf006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009b40 tx=0x7fbd08008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:04.928 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:04.926+0000 7fbd01ffb700 1 -- 172.21.15.149:0/2856189983 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbcfc057d20 con 0x7fbd0c0cc180 2023-06-09T04:38:05.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.117+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd0c04e090 con 0x7fbd0c0cc180 2023-06-09T04:38:05.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.764+0000 7fbd01ffb700 1 -- 172.21.15.149:0/2856189983 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbcfc0578b0 con 0x7fbd0c0cc180 2023-06-09T04:38:05.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fbcf006ace0 msgr2=0x7fbcf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fbcf006ace0 0x7fbcf006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbd08009b40 tx=0x7fbd08008070 comp rx=0 tx=0).stop 2023-06-09T04:38:05.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c0cc180 msgr2=0x7fbd0c0cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c0cc180 0x7fbd0c0cf120 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00e810 tx=0x7fbcfc00eb20 comp rx=0 tx=0).stop 2023-06-09T04:38:05.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 shutdown_connections 2023-06-09T04:38:05.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fbcf006ace0 0x7fbcf006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fbd0c15c660 0x7fbd0c0cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd0c06a2f0 0x7fbd0c150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 --2- 172.21.15.149:0/2856189983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd0c0cc180 0x7fbd0c0cf120 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.771+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 >> 172.21.15.149:0/2856189983 conn(0x7fbd0c098b20 msgr2=0x7fbd0c15bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.773+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 shutdown_connections 2023-06-09T04:38:05.773 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.773+0000 7fbd13442700 1 -- 172.21.15.149:0/2856189983 wait complete. 2023-06-09T04:38:05.774 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' removed 2023-06-09T04:38:05.787 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-09T04:38:05.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.915+0000 7ff495e9b700 1 Processor -- start 2023-06-09T04:38:05.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.915+0000 7ff495e9b700 1 -- start start 2023-06-09T04:38:05.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff495e9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff49015c320 0x7ff4900b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff495e9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff4900b4650 0x7ff4900b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.917 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff495e9b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4900d09c0 con 0x7ff4900b5f60 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff495e9b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900b5010 con 0x7ff4900b4650 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff495e9b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900d0f80 con 0x7ff49015c320 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff48ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff4900b4650 0x7ff4900b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff48ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff4900b4650 0x7ff4900b4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38176/0 (socket says 172.21.15.149:38176) 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.916+0000 7ff48ffff700 1 -- 172.21.15.149:0/737458687 learned_addr learned my addr 172.21.15.149:0/737458687 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48ffff700 1 -- 172.21.15.149:0/737458687 >> v2:172.21.15.184:3300/0 conn(0x7ff49015c320 msgr2=0x7ff4900b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48ffff700 1 --2- 172.21.15.149:0/737458687 >> v2:172.21.15.184:3300/0 conn(0x7ff49015c320 0x7ff4900b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.918 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48ffff700 1 -- 172.21.15.149:0/737458687 >> v1:172.21.15.184:6789/0 conn(0x7ff4900b5f60 legacy=0x7ff4900d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:05.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48ffff700 1 -- 172.21.15.149:0/737458687 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49015c6f0 con 0x7ff4900b4650 2023-06-09T04:38:05.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48ffff700 1 --2- 172.21.15.149:0/737458687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4900b4650 0x7ff4900b4ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4900738a0 tx=0x7ff48800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34ebbb6bed3ff14 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48e7fc700 1 -- 172.21.15.149:0/737458687 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800e070 con 0x7ff4900b4650 2023-06-09T04:38:05.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48e7fc700 1 -- 172.21.15.149:0/737458687 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488003a20 con 0x7ff4900b4650 2023-06-09T04:38:05.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.917+0000 7ff48e7fc700 1 -- 172.21.15.149:0/737458687 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488003dd0 con 0x7ff4900b4650 2023-06-09T04:38:05.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 -- 172.21.15.149:0/737458687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4900b4650 msgr2=0x7ff4900b4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 --2- 172.21.15.149:0/737458687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4900b4650 0x7ff4900b4ad0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff4900738a0 tx=0x7ff48800b330 comp rx=0 tx=0).stop 2023-06-09T04:38:05.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 -- 172.21.15.149:0/737458687 shutdown_connections 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 --2- 172.21.15.149:0/737458687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4900b4650 0x7ff4900b4ad0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 --2- 172.21.15.149:0/737458687 >> v2:172.21.15.184:3300/0 conn(0x7ff49015c320 0x7ff4900b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 -- 172.21.15.149:0/737458687 >> 172.21.15.149:0/737458687 conn(0x7ff49006bdf0 msgr2=0x7ff4900714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 -- 172.21.15.149:0/737458687 shutdown_connections 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.918+0000 7ff495e9b700 1 -- 172.21.15.149:0/737458687 wait complete. 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.919+0000 7ff495e9b700 1 Processor -- start 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.919+0000 7ff495e9b700 1 -- start start 2023-06-09T04:38:05.922 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff495e9b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900b4650 0x7ff49014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff495e9b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4900b5f60 0x7ff4900c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff495e9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49015c320 0x7ff4900c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff495e9b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900ca7e0 con 0x7ff49015c320 2023-06-09T04:38:05.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff495e9b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900caa80 con 0x7ff4900b5f60 2023-06-09T04:38:05.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff495e9b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900cad60 con 0x7ff4900b4650 2023-06-09T04:38:05.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49015c320 0x7ff4900c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.923 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49015c320 0x7ff4900c8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38182/0 (socket says 172.21.15.149:38182) 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 -- 172.21.15.149:0/1040461462 learned_addr learned my addr 172.21.15.149:0/1040461462 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48effd700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4900b5f60 0x7ff4900c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48f7fe700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900b4650 0x7ff49014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 -- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900b4650 msgr2=0x7ff49014adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900b4650 0x7ff49014adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 -- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4900b5f60 msgr2=0x7ff4900c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4900b5f60 0x7ff4900c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:05.924 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 -- 172.21.15.149:0/1040461462 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff488009b30 con 0x7ff49015c320 2023-06-09T04:38:05.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48f7fe700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900b4650 0x7ff49014adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:05.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.920+0000 7ff48ffff700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49015c320 0x7ff4900c8770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff488015040 tx=0x7ff488004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.921+0000 7ff477fff700 1 -- 172.21.15.149:0/1040461462 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488004440 con 0x7ff49015c320 2023-06-09T04:38:05.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.921+0000 7ff477fff700 1 -- 172.21.15.149:0/1040461462 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880045c0 con 0x7ff49015c320 2023-06-09T04:38:05.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.921+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4900cb040 con 0x7ff49015c320 2023-06-09T04:38:05.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.921+0000 7ff477fff700 1 -- 172.21.15.149:0/1040461462 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488004970 con 0x7ff49015c320 2023-06-09T04:38:05.925 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.921+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49014b300 con 0x7ff49015c320 2023-06-09T04:38:05.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.921+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49014b490 con 0x7ff49015c320 2023-06-09T04:38:05.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.922+0000 7ff477fff700 1 -- 172.21.15.149:0/1040461462 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff488012430 con 0x7ff49015c320 2023-06-09T04:38:05.926 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.922+0000 7ff477fff700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff47c06ace0 0x7ff47c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:05.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.922+0000 7ff477fff700 1 -- 172.21.15.149:0/1040461462 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6047+0+0 (secure 0 0 0) 0x7ff48808aa10 con 0x7ff49015c320 2023-06-09T04:38:05.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.922+0000 7ff48f7fe700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff47c06ace0 0x7ff47c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:05.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.923+0000 7ff48f7fe700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff47c06ace0 0x7ff47c06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff48400a8f0 tx=0x7ff484008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:05.927 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:05.927+0000 7ff477fff700 1 -- 172.21.15.149:0/1040461462 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff49014b490 con 0x7ff49015c320 2023-06-09T04:38:06.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.113+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff49014b490 con 0x7ff49015c320 2023-06-09T04:38:06.777 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.776+0000 7ff477fff700 1 -- 172.21.15.149:0/1040461462 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff49014b490 con 0x7ff49015c320 2023-06-09T04:38:06.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff47c06ace0 msgr2=0x7ff47c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.781 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff47c06ace0 0x7ff47c06d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff48400a8f0 tx=0x7ff484008040 comp rx=0 tx=0).stop 2023-06-09T04:38:06.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49015c320 msgr2=0x7ff4900c8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49015c320 0x7ff4900c8770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff488015040 tx=0x7ff488004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 shutdown_connections 2023-06-09T04:38:06.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff47c06ace0 0x7ff47c06d190 secure :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff48400a8f0 tx=0x7ff484008040 comp rx=0 tx=0).stop 2023-06-09T04:38:06.782 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff4900b4650 0x7ff49014adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff49015c320 0x7ff4900c8770 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 --2- 172.21.15.149:0/1040461462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4900b5f60 0x7ff4900c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.780+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 >> 172.21.15.149:0/1040461462 conn(0x7ff49006bdf0 msgr2=0x7ff4900cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:06.783 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.782+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 shutdown_connections 2023-06-09T04:38:06.784 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.782+0000 7ff495e9b700 1 -- 172.21.15.149:0/1040461462 wait complete. 2023-06-09T04:38:06.787 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data_ec' removed 2023-06-09T04:38:06.800 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:38:06.801 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-09T04:38:06.801 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-09T04:38:06.801 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:38:06.801 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:38:06.802 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-09T04:38:06.802 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-09T04:38:06.802 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:38:06.802 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:38:06.802 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-09T04:38:06.803 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-09T04:38:06.803 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:38:06.803 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:38:06.803 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-09T04:38:06.804 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-09T04:38:06.804 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:38:06.810 INFO:tasks.ceph.mds.a:Stopped 2023-06-09T04:38:06.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:38:06.811 INFO:tasks.ceph.mds.c:Stopped 2023-06-09T04:38:06.812 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:38:06.814 INFO:tasks.ceph.mds.b:Stopped 2023-06-09T04:38:06.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:38:06.815 INFO:tasks.ceph.mds.d:Stopped 2023-06-09T04:38:06.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:38:06.853 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:38:06.854 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:06.854 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:38:06.855 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:06.857 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:38:06.857 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:06.858 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:38:06.859 DEBUG:teuthology.parallel:result is None 2023-06-09T04:38:06.859 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-09T04:38:06.933 INFO:tasks.ceph.mds.c.smithi149.stdout:starting mds.c at 2023-06-09T04:38:06.934 INFO:tasks.ceph.mds.a.smithi149.stdout:starting mds.a at 2023-06-09T04:38:06.950 INFO:tasks.ceph.mds.d.smithi184.stdout:starting mds.d at 2023-06-09T04:38:06.951 INFO:tasks.ceph.mds.b.smithi184.stdout:starting mds.b at 2023-06-09T04:38:06.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.991+0000 7fd65ea44700 1 Processor -- start 2023-06-09T04:38:06.992 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.991+0000 7fd65ea44700 1 -- start start 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd65ea44700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815c170 0x7fd6580b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd65ea44700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6580ccf50 0x7fd6580cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd65ea44700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6580d14e0 con 0x7fd65815fc20 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd65ea44700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6580d06f0 con 0x7fd6580ccf50 2023-06-09T04:38:06.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd65ea44700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65815c540 con 0x7fd65815c170 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd6577fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd6580ccf50 0x7fd6580cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd65cfe1700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fd65815fc20 0x7fd6581600a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33842/0 (socket says 172.21.15.149:33842) 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd65cfe1700 1 -- 172.21.15.149:0/13354179 learned_addr learned my addr 172.21.15.149:0/13354179 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd657fff700 1 --2- 172.21.15.149:0/13354179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815c170 0x7fd6580b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd6577fe700 1 -- 172.21.15.149:0/13354179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815c170 msgr2=0x7fd6580b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd6577fe700 1 --2- 172.21.15.149:0/13354179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815c170 0x7fd6580b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd6577fe700 1 -- 172.21.15.149:0/13354179 >> v1:172.21.15.149:6789/0 conn(0x7fd65815fc20 legacy=0x7fd6581600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd656ffd700 1 -- 172.21.15.149:0/13354179 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131576091 0 0) 0x7fd6580d14e0 con 0x7fd65815fc20 2023-06-09T04:38:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd6577fe700 1 -- 172.21.15.149:0/13354179 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580d08d0 con 0x7fd6580ccf50 2023-06-09T04:38:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd6577fe700 1 --2- 172.21.15.149:0/13354179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd6580cd3c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd648009840 tx=0x7fd648009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4988f00d546d5cc8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.992+0000 7fd656ffd700 1 -- 172.21.15.149:0/13354179 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011830 con 0x7fd6580ccf50 2023-06-09T04:38:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd656ffd700 1 -- 172.21.15.149:0/13354179 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd648011990 con 0x7fd6580ccf50 2023-06-09T04:38:06.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd656ffd700 1 -- 172.21.15.149:0/13354179 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011d20 con 0x7fd6580ccf50 2023-06-09T04:38:06.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 -- 172.21.15.149:0/13354179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 msgr2=0x7fd6580cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:06.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 --2- 172.21.15.149:0/13354179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd6580cd3c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd648009840 tx=0x7fd648009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:06.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 -- 172.21.15.149:0/13354179 shutdown_connections 2023-06-09T04:38:06.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 --2- 172.21.15.149:0/13354179 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815c170 0x7fd6580b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:06.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 --2- 172.21.15.149:0/13354179 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd6580cd3c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 -- 172.21.15.149:0/13354179 >> 172.21.15.149:0/13354179 conn(0x7fd658069db0 msgr2=0x7fd65806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 -- 172.21.15.149:0/13354179 shutdown_connections 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.993+0000 7fd65ea44700 1 -- 172.21.15.149:0/13354179 wait complete. 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.994+0000 7fd65ea44700 1 Processor -- start 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65ea44700 1 -- start start 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65ea44700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd658150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65ea44700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65815c170 0x7fd658155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65ea44700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815fc20 0x7fd658156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65ea44700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580b1370 con 0x7fd6580ccf50 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65ea44700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580b0760 con 0x7fd65815c170 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65ea44700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6580b0a40 con 0x7fd65815fc20 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd657fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd658150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd657fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd658150820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38214/0 (socket says 172.21.15.149:38214) 2023-06-09T04:38:07.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd657fff700 1 -- 172.21.15.149:0/3266259007 learned_addr learned my addr 172.21.15.149:0/3266259007 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd65cfe1700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815fc20 0x7fd658156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.995+0000 7fd6577fe700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65815c170 0x7fd658155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd657fff700 1 -- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815fc20 msgr2=0x7fd658156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd657fff700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815fc20 0x7fd658156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd657fff700 1 -- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65815c170 msgr2=0x7fd658155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd657fff700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65815c170 0x7fd658155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd657fff700 1 -- 172.21.15.149:0/3266259007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480094a0 con 0x7fd6580ccf50 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd657fff700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd658150820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00e810 tx=0x7fd64c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd654ff9700 1 -- 172.21.15.149:0/3266259007 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c00c070 con 0x7fd6580ccf50 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd654ff9700 1 -- 172.21.15.149:0/3266259007 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c013610 con 0x7fd6580ccf50 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6580b0d20 con 0x7fd6580ccf50 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd654ff9700 1 -- 172.21.15.149:0/3266259007 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0139c0 con 0x7fd6580ccf50 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.996+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd658150d60 con 0x7fd6580ccf50 2023-06-09T04:38:07.003 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.997+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6580b14e0 con 0x7fd6580ccf50 2023-06-09T04:38:07.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.997+0000 7fd654ff9700 1 -- 172.21.15.149:0/3266259007 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd64c013b20 con 0x7fd6580ccf50 2023-06-09T04:38:07.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.998+0000 7fd654ff9700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd64406ace0 0x7fd64406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:07.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.998+0000 7fd654ff9700 1 -- 172.21.15.149:0/3266259007 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd64c089080 con 0x7fd6580ccf50 2023-06-09T04:38:07.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.998+0000 7fd6577fe700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd64406ace0 0x7fd64406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:07.004 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:06.998+0000 7fd6577fe700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd64406ace0 0x7fd64406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6480090b0 tx=0x7fd64801c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:07.005 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.002+0000 7fd654ff9700 1 -- 172.21.15.149:0/3266259007 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd64c054270 con 0x7fd6580ccf50 2023-06-09T04:38:07.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.205+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd658073fa0 con 0x7fd6580ccf50 2023-06-09T04:38:07.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.982+0000 7fd654ff9700 1 -- 172.21.15.149:0/3266259007 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd64c057890 con 0x7fd6580ccf50 2023-06-09T04:38:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd64406ace0 msgr2=0x7fd64406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd64406ace0 0x7fd64406d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6480090b0 tx=0x7fd64801c040 comp rx=0 tx=0).stop 2023-06-09T04:38:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 msgr2=0x7fd658150820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd658150820 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00e810 tx=0x7fd64c00eb20 comp rx=0 tx=0).stop 2023-06-09T04:38:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 shutdown_connections 2023-06-09T04:38:07.986 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd64406ace0 0x7fd64406d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd65815fc20 0x7fd658156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd6580ccf50 0x7fd658150820 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 --2- 172.21.15.149:0/3266259007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd65815c170 0x7fd658155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:07.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.984+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 >> 172.21.15.149:0/3266259007 conn(0x7fd658069db0 msgr2=0x7fd65815b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:07.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.985+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 shutdown_connections 2023-06-09T04:38:07.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:07.985+0000 7fd65ea44700 1 -- 172.21.15.149:0/3266259007 wait complete. 2023-06-09T04:38:07.988 INFO:teuthology.orchestra.run.smithi149.stderr: removed all blocklist entries 2023-06-09T04:38:07.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-09T04:38:08.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.119+0000 7fe61cf27700 1 Processor -- start 2023-06-09T04:38:08.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.119+0000 7fe61cf27700 1 -- start start 2023-06-09T04:38:08.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.120+0000 7fe61cf27700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe618069db0 0x7fe6180c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.122 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.120+0000 7fe61cf27700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6180ccc00 0x7fe6180b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.120+0000 7fe61cf27700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6180720f0 con 0x7fe61815a400 2023-06-09T04:38:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.120+0000 7fe61cf27700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6180ca1e0 con 0x7fe618069db0 2023-06-09T04:38:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.120+0000 7fe61cf27700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180cb960 con 0x7fe6180ccc00 2023-06-09T04:38:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe618069db0 0x7fe6180c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe618069db0 0x7fe6180c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38228/0 (socket says 172.21.15.149:38228) 2023-06-09T04:38:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 -- 172.21.15.149:0/1900315725 learned_addr learned my addr 172.21.15.149:0/1900315725 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:08.123 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe616d9d700 1 --2- 172.21.15.149:0/1900315725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6180ccc00 0x7fe6180b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 -- 172.21.15.149:0/1900315725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6180ccc00 msgr2=0x7fe6180b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 --2- 172.21.15.149:0/1900315725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6180ccc00 0x7fe6180b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 -- 172.21.15.149:0/1900315725 >> v1:172.21.15.184:6789/0 conn(0x7fe61815a400 legacy=0x7fe61806a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 -- 172.21.15.149:0/1900315725 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6180cbc40 con 0x7fe618069db0 2023-06-09T04:38:08.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61659c700 1 --2- 172.21.15.149:0/1900315725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180c9ca0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe6000098f0 tx=0x7fe600009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8991a00348fc2285 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61559a700 1 -- 172.21.15.149:0/1900315725 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600004230 con 0x7fe618069db0 2023-06-09T04:38:08.124 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61559a700 1 -- 172.21.15.149:0/1900315725 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe600004390 con 0x7fe618069db0 2023-06-09T04:38:08.125 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.121+0000 7fe61559a700 1 -- 172.21.15.149:0/1900315725 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000036a0 con 0x7fe618069db0 2023-06-09T04:38:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 -- 172.21.15.149:0/1900315725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 msgr2=0x7fe6180c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 --2- 172.21.15.149:0/1900315725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180c9ca0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe6000098f0 tx=0x7fe600009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 -- 172.21.15.149:0/1900315725 shutdown_connections 2023-06-09T04:38:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 --2- 172.21.15.149:0/1900315725 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe6180ccc00 0x7fe6180b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.127 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 --2- 172.21.15.149:0/1900315725 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180c9ca0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 -- 172.21.15.149:0/1900315725 >> 172.21.15.149:0/1900315725 conn(0x7fe61806aec0 msgr2=0x7fe61806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 -- 172.21.15.149:0/1900315725 shutdown_connections 2023-06-09T04:38:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.122+0000 7fe61cf27700 1 -- 172.21.15.149:0/1900315725 wait complete. 2023-06-09T04:38:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.123+0000 7fe61cf27700 1 Processor -- start 2023-06-09T04:38:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.123+0000 7fe61cf27700 1 -- start start 2023-06-09T04:38:08.128 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61cf27700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61cf27700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6180ccc00 0x7fe6180acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61cf27700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe61815a400 0x7fe6181510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61cf27700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180ced10 con 0x7fe618069db0 2023-06-09T04:38:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61cf27700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180d0280 con 0x7fe6180ccc00 2023-06-09T04:38:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61cf27700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180ce750 con 0x7fe61815a400 2023-06-09T04:38:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.129 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38234/0 (socket says 172.21.15.149:38234) 2023-06-09T04:38:08.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 -- 172.21.15.149:0/177035653 learned_addr learned my addr 172.21.15.149:0/177035653 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:08.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe615d9b700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6180ccc00 0x7fe6180acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe616d9d700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe61815a400 0x7fe6181510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 -- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe61815a400 msgr2=0x7fe6181510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe61815a400 0x7fe6181510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.130 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 -- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6180ccc00 msgr2=0x7fe6180acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6180ccc00 0x7fe6180acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 -- 172.21.15.149:0/177035653 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009550 con 0x7fe618069db0 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.124+0000 7fe61659c700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180cdc30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe600009130 tx=0x7fe600004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.125+0000 7fe60effd700 1 -- 172.21.15.149:0/177035653 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe600003cd0 con 0x7fe618069db0 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.125+0000 7fe60effd700 1 -- 172.21.15.149:0/177035653 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60001f070 con 0x7fe618069db0 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.125+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6180cea30 con 0x7fe618069db0 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.125+0000 7fe60effd700 1 -- 172.21.15.149:0/177035653 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000b8a0 con 0x7fe618069db0 2023-06-09T04:38:08.131 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.125+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe618151620 con 0x7fe618069db0 2023-06-09T04:38:08.132 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.126+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6180b3f90 con 0x7fe618069db0 2023-06-09T04:38:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.126+0000 7fe60effd700 1 -- 172.21.15.149:0/177035653 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe600021030 con 0x7fe618069db0 2023-06-09T04:38:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.126+0000 7fe60effd700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe5f806ace0 0x7fe5f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.127+0000 7fe60effd700 1 -- 172.21.15.149:0/177035653 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe60008a7d0 con 0x7fe618069db0 2023-06-09T04:38:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.127+0000 7fe615d9b700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe5f806ace0 0x7fe5f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.133 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.127+0000 7fe615d9b700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe5f806ace0 0x7fe5f806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe6180ae6b0 tx=0x7fe6080090e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.134 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.131+0000 7fe60effd700 1 -- 172.21.15.149:0/177035653 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6180b3f90 con 0x7fe618069db0 2023-06-09T04:38:08.395 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.394+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe6180b3f90 con 0x7fe618069db0 2023-06-09T04:38:08.396 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.395+0000 7fe60effd700 1 -- 172.21.15.149:0/177035653 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe6180b3f90 con 0x7fe618069db0 2023-06-09T04:38:08.396 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:08.397 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-06-09T04:38:08.397 INFO:teuthology.orchestra.run.smithi149.stdout: "auth_dump": [ 2023-06-09T04:38:08.397 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.397 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.a", 2023-06-09T04:38:08.397 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAwrIJkOxg4MhAA0mKD3EbWcN9NdMSj5X6ugg==", 2023-06-09T04:38:08.397 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.398 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.398 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-06-09T04:38:08.398 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-06-09T04:38:08.398 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.398 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.398 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.399 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.399 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.b", 2023-06-09T04:38:08.399 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAxrIJkBSuwAhAALUBpODXvUmsR/5njb3WVcw==", 2023-06-09T04:38:08.399 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.399 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.399 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-06-09T04:38:08.399 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-06-09T04:38:08.400 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.400 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.400 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.400 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.400 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.c", 2023-06-09T04:38:08.400 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAwrIJkgP1pORAAMV3u6xgej85xYE2v7QXRmQ==", 2023-06-09T04:38:08.400 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.402 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mds.d", 2023-06-09T04:38:08.402 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAxrIJkqO3lCRAAfpHkpnEzOtGcfxWznUoC0w==", 2023-06-09T04:38:08.402 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.402 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.402 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-06-09T04:38:08.402 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-06-09T04:38:08.402 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.403 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.403 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.403 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.403 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.0", 2023-06-09T04:38:08.403 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQA0rIJkCHNDLhAAJcROpElQl0GeISJ4LWwV0g==", 2023-06-09T04:38:08.403 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.403 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.404 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.404 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.404 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.404 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.404 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.404 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.1", 2023-06-09T04:38:08.404 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQA3rIJkcRY+LhAA3ehtWSzFGUk1s5cbuU7huQ==", 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.405 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.2", 2023-06-09T04:38:08.406 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQA6rIJkcucDLRAAJe1nvO9Qi0CIgqcJJDpQSA==", 2023-06-09T04:38:08.406 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.406 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.406 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.406 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.406 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.406 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.407 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.407 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.3", 2023-06-09T04:38:08.407 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQA9rIJkyUcsLBAAvaczCRou+iRo+SZKpk333Q==", 2023-06-09T04:38:08.407 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.407 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.407 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.407 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.408 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.408 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.408 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.408 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.4", 2023-06-09T04:38:08.408 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBDrIJkiE/9LhAAlFS2EeY53bjfW+yw2ESz2g==", 2023-06-09T04:38:08.408 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.408 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.409 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.409 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.409 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.409 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.409 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.409 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.5", 2023-06-09T04:38:08.409 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBGrIJkEgc2LhAAbcwqWh/ssrzFdpj4Lb8JOw==", 2023-06-09T04:38:08.410 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.410 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.410 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.410 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.410 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.410 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.410 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.411 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.6", 2023-06-09T04:38:08.411 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBJrIJkjtmbLRAA9n+zHQ8tc167dF8J2xJQzw==", 2023-06-09T04:38:08.411 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.411 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.411 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.411 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.411 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.412 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.412 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.412 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "osd.7", 2023-06-09T04:38:08.412 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBMrIJkxLiZLRAAzT0ZEyWHOh19YJtqO9SUtA==", 2023-06-09T04:38:08.412 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.412 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow profile osd", 2023-06-09T04:38:08.412 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile osd", 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.0", 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAxrIJktnEkDhAA+rHerKk2ySHGeQ7cztjsIw==", 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.413 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.414 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-06-09T04:38:08.414 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-06-09T04:38:08.414 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-06-09T04:38:08.414 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.415 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.415 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.415 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.1", 2023-06-09T04:38:08.415 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAxrIJkTwe6FBAAHoWLUAMxepprRks07H63Ow==", 2023-06-09T04:38:08.416 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.416 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.416 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-06-09T04:38:08.417 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-06-09T04:38:08.417 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-06-09T04:38:08.417 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.417 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.418 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.418 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.2", 2023-06-09T04:38:08.418 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAxrIJk0UVxERAALXvjqSqyxcNz8b5EsY8ySg==", 2023-06-09T04:38:08.419 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.419 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.419 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-06-09T04:38:08.419 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-06-09T04:38:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-06-09T04:38:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.420 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.3", 2023-06-09T04:38:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAxrIJkg2xmGhAAtCTewRUqbOL5wTS0IOKVpA==", 2023-06-09T04:38:08.421 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow", 2023-06-09T04:38:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow r", 2023-06-09T04:38:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow rw", 2023-06-09T04:38:08.422 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow rwx" 2023-06-09T04:38:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.423 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.admin", 2023-06-09T04:38:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw==", 2023-06-09T04:38:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.424 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-06-09T04:38:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: "mgr": "allow *", 2023-06-09T04:38:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow *", 2023-06-09T04:38:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.425 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-mds", 2023-06-09T04:38:08.426 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBSrIJkkgZUKRAAu6VJt6LXE+GycFHrmMEy5A==", 2023-06-09T04:38:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-mds" 2023-06-09T04:38:08.427 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-mgr", 2023-06-09T04:38:08.428 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBSrIJkcxhUKRAACAnIY1o4zeXGLGzJo5KnCA==", 2023-06-09T04:38:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-09T04:38:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.429 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-osd", 2023-06-09T04:38:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBSrIJkIyZUKRAAS+3aygL/MOCoP4DEY0FYjw==", 2023-06-09T04:38:08.430 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-osd" 2023-06-09T04:38:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.431 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rbd", 2023-06-09T04:38:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBSrIJkXjNUKRAAFf4/OSXlW1qPztxDx110FA==", 2023-06-09T04:38:08.432 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-09T04:38:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.433 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-09T04:38:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBSrIJkG0FUKRAArjUjyds1mjS+5dyB79JjIg==", 2023-06-09T04:38:08.434 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-09T04:38:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.435 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "client.bootstrap-rgw", 2023-06-09T04:38:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQBSrIJkHU9UKRAAhThmikSrf1T/GN5hFSHmDg==", 2023-06-09T04:38:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.436 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-09T04:38:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.437 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.x", 2023-06-09T04:38:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAwrIJksW/bLhAAsE9C4RNZwCpVVdfDNeu5yg==", 2023-06-09T04:38:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.438 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-06-09T04:38:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-06-09T04:38:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.439 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: "entity": "mgr.y", 2023-06-09T04:38:08.440 INFO:teuthology.orchestra.run.smithi149.stdout: "key": "AQAwrIJkETXLKBAAL4kg22/BkmCqzzjk81xNQA==", 2023-06-09T04:38:08.441 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": { 2023-06-09T04:38:08.441 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": "allow *", 2023-06-09T04:38:08.441 INFO:teuthology.orchestra.run.smithi149.stdout: "mon": "allow profile mgr", 2023-06-09T04:38:08.441 INFO:teuthology.orchestra.run.smithi149.stdout: "osd": "allow *" 2023-06-09T04:38:08.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.442 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:08.442 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2023-06-09T04:38:08.442 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-06-09T04:38:08.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe5f806ace0 msgr2=0x7fe5f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe5f806ace0 0x7fe5f806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe6180ae6b0 tx=0x7fe6080090e0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.445 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 msgr2=0x7fe6180cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180cdc30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe600009130 tx=0x7fe600004750 comp rx=0 tx=0).stop 2023-06-09T04:38:08.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 shutdown_connections 2023-06-09T04:38:08.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe5f806ace0 0x7fe5f806d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe61815a400 0x7fe6181510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe618069db0 0x7fe6180cdc30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 --2- 172.21.15.149:0/177035653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe6180ccc00 0x7fe6180acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 >> 172.21.15.149:0/177035653 conn(0x7fe61806aec0 msgr2=0x7fe6180af540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 shutdown_connections 2023-06-09T04:38:08.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.397+0000 7fe61cf27700 1 -- 172.21.15.149:0/177035653 wait complete. 2023-06-09T04:38:08.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-09T04:38:08.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.569+0000 7f72349f8700 1 Processor -- start 2023-06-09T04:38:08.570 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.569+0000 7f72349f8700 1 -- start start 2023-06-09T04:38:08.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.570+0000 7f72349f8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 0x7f72300cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.570+0000 7f72349f8700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72300d14e0 con 0x7f72300ccf50 2023-06-09T04:38:08.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.570+0000 7f72349f8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72300b2bb0 con 0x7f723015c170 2023-06-09T04:38:08.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.570+0000 7f72349f8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72300d06f0 con 0x7f72300cd3c0 2023-06-09T04:38:08.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.570+0000 7f722dd9b700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f72300ccf50 0x7f72300cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33874/0 (socket says 172.21.15.149:33874) 2023-06-09T04:38:08.572 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.570+0000 7f722dd9b700 1 -- 172.21.15.149:0/1096622306 learned_addr learned my addr 172.21.15.149:0/1096622306 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:08.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.570+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994540054 0 0) 0x7f72300d14e0 con 0x7f72300ccf50 2023-06-09T04:38:08.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72180035b0 con 0x7f72300ccf50 2023-06-09T04:38:08.574 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722ed9d700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 0x7f72300cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503651883 0 0) 0x7f72180035b0 con 0x7f72300ccf50 2023-06-09T04:38:08.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 msgr2=0x7f72300cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 0x7f72300cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 >> v1:172.21.15.184:6789/0 conn(0x7f723015c170 legacy=0x7f72300b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72300d08d0 con 0x7f72300ccf50 2023-06-09T04:38:08.575 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f7220001670 con 0x7f72300ccf50 2023-06-09T04:38:08.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 >> v1:172.21.15.149:6789/0 conn(0x7f72300ccf50 legacy=0x7f72300cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7218003a30 0x7f7218003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218004850 0x7f7218004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 0x7f7218005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300d06f0 con 0x7f7218003a30 2023-06-09T04:38:08.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721800bb10 con 0x7f7218004850 2023-06-09T04:38:08.576 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721800bcd0 con 0x7f72300cd3c0 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722e59c700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7218003a30 0x7f7218003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722dd9b700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218004850 0x7f7218004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722ed9d700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 0x7f7218005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722e59c700 1 -- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 msgr2=0x7f7218005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722e59c700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f72300cd3c0 0x7f7218005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722e59c700 1 -- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218004850 msgr2=0x7f7218004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722e59c700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218004850 0x7f7218004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.577 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722e59c700 1 -- 172.21.15.149:0/1096622306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180035b0 con 0x7f7218003a30 2023-06-09T04:38:08.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.571+0000 7f722e59c700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7218003a30 0x7f7218003e40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f72240017c0 tx=0x7f7218005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0a16aad0878efc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72240052d0 con 0x7f7218003a30 2023-06-09T04:38:08.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224005430 con 0x7f7218003a30 2023-06-09T04:38:08.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f722d59a700 1 -- 172.21.15.149:0/1096622306 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72240038c0 con 0x7f7218003a30 2023-06-09T04:38:08.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f72349f8700 1 -- 172.21.15.149:0/1096622306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7218003a30 msgr2=0x7f7218003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f72349f8700 1 --2- 172.21.15.149:0/1096622306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7218003a30 0x7f7218003e40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f72240017c0 tx=0x7f7218005880 comp rx=0 tx=0).stop 2023-06-09T04:38:08.578 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f722ed9d700 1 -- 172.21.15.149:0/1096622306 reap_dead start 2023-06-09T04:38:08.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f72349f8700 1 -- 172.21.15.149:0/1096622306 shutdown_connections 2023-06-09T04:38:08.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f72349f8700 1 -- 172.21.15.149:0/1096622306 >> 172.21.15.149:0/1096622306 conn(0x7f7230069db0 msgr2=0x7f723006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f72349f8700 1 -- 172.21.15.149:0/1096622306 shutdown_connections 2023-06-09T04:38:08.579 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.572+0000 7f72349f8700 1 -- 172.21.15.149:0/1096622306 wait complete. 2023-06-09T04:38:08.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.573+0000 7f72349f8700 1 Processor -- start 2023-06-09T04:38:08.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f72349f8700 1 -- start start 2023-06-09T04:38:08.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f72349f8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218003a30 0x7f723015a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.581 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f72349f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723014ba60 0x7f7230157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f72349f8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f723014bed0 0x7f7230158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f72349f8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230159cf0 con 0x7f723014ba60 2023-06-09T04:38:08.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f72349f8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72301560b0 con 0x7f7218003a30 2023-06-09T04:38:08.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f72349f8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7230158c30 con 0x7f723014bed0 2023-06-09T04:38:08.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f722dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723014ba60 0x7f7230157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f722dd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723014ba60 0x7f7230157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38254/0 (socket says 172.21.15.149:38254) 2023-06-09T04:38:08.582 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.574+0000 7f722dd9b700 1 -- 172.21.15.149:0/157547369 learned_addr learned my addr 172.21.15.149:0/157547369 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722e59c700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218003a30 0x7f723015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722ed9d700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f723014bed0 0x7f7230158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722dd9b700 1 -- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f723014bed0 msgr2=0x7f7230158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722dd9b700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f723014bed0 0x7f7230158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722dd9b700 1 -- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218003a30 msgr2=0x7f723015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722dd9b700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218003a30 0x7f723015a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722dd9b700 1 -- 172.21.15.149:0/157547369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230158950 con 0x7f723014ba60 2023-06-09T04:38:08.583 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f722dd9b700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723014ba60 0x7f7230157e00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f72200072c0 tx=0x7f7220007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f721effd700 1 -- 172.21.15.149:0/157547369 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200077a0 con 0x7f723014ba60 2023-06-09T04:38:08.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f721effd700 1 -- 172.21.15.149:0/157547369 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722000f8d0 con 0x7f723014ba60 2023-06-09T04:38:08.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7230159630 con 0x7f723014ba60 2023-06-09T04:38:08.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f721effd700 1 -- 172.21.15.149:0/157547369 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722000fc80 con 0x7f723014ba60 2023-06-09T04:38:08.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.575+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723015a650 con 0x7f723014ba60 2023-06-09T04:38:08.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.576+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7230073fa0 con 0x7f723014ba60 2023-06-09T04:38:08.584 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.577+0000 7f721effd700 1 -- 172.21.15.149:0/157547369 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f722001d460 con 0x7f723014ba60 2023-06-09T04:38:08.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.577+0000 7f721effd700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f721006ace0 0x7f721006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.577+0000 7f721effd700 1 -- 172.21.15.149:0/157547369 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7220089360 con 0x7f723014ba60 2023-06-09T04:38:08.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.577+0000 7f722e59c700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f721006ace0 0x7f721006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.577+0000 7f722e59c700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f721006ace0 0x7f721006d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f7224009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.585 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.581+0000 7f721effd700 1 -- 172.21.15.149:0/157547369 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7220054590 con 0x7f723014ba60 2023-06-09T04:38:08.850 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.849+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f72300b66c0 con 0x7f723014ba60 2023-06-09T04:38:08.853 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.852+0000 7f721effd700 1 -- 172.21.15.149:0/157547369 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7220057bb0 con 0x7f723014ba60 2023-06-09T04:38:08.855 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f721006ace0 msgr2=0x7f721006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f721006ace0 0x7f721006d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7224000c00 tx=0x7f7224009030 comp rx=0 tx=0).stop 2023-06-09T04:38:08.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723014ba60 msgr2=0x7f7230157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723014ba60 0x7f7230157e00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f72200072c0 tx=0x7f7220007680 comp rx=0 tx=0).stop 2023-06-09T04:38:08.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 shutdown_connections 2023-06-09T04:38:08.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f721006ace0 0x7f721006d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.856 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f723014bed0 0x7f7230158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7218003a30 0x7f723015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 --2- 172.21.15.149:0/157547369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723014ba60 0x7f7230157e00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 >> 172.21.15.149:0/157547369 conn(0x7f7230069db0 msgr2=0x7f72300b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 shutdown_connections 2023-06-09T04:38:08.857 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.854+0000 7f72349f8700 1 -- 172.21.15.149:0/157547369 wait complete. 2023-06-09T04:38:08.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-09T04:38:08.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.989+0000 7fc72b954700 1 Processor -- start 2023-06-09T04:38:08.990 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.989+0000 7fc72b954700 1 -- start start 2023-06-09T04:38:08.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc72b954700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72415f630 0x7fc724069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc72b954700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc72406db50 0x7fc7240cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc72b954700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc724070900 con 0x7fc7240cd910 2023-06-09T04:38:08.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc72b954700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7240ce2c0 con 0x7fc72406db50 2023-06-09T04:38:08.991 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc72b954700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc724070be0 con 0x7fc72415f630 2023-06-09T04:38:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc7296f0700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72415f630 0x7fc724069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc729ef1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc72406db50 0x7fc7240cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc729ef1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc72406db50 0x7fc7240cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:57528/0 (socket says 172.21.15.149:57528) 2023-06-09T04:38:08.993 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc728eef700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc7240cd910 0x7fc72406d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:39892/0 (socket says 172.21.15.149:39892) 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.990+0000 7fc729ef1700 1 -- 172.21.15.149:0/1010065286 learned_addr learned my addr 172.21.15.149:0/1010065286 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc7296f0700 1 -- 172.21.15.149:0/1010065286 >> v2:172.21.15.184:3300/0 conn(0x7fc72406db50 msgr2=0x7fc7240cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc7296f0700 1 --2- 172.21.15.149:0/1010065286 >> v2:172.21.15.184:3300/0 conn(0x7fc72406db50 0x7fc7240cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc7296f0700 1 -- 172.21.15.149:0/1010065286 >> v1:172.21.15.184:6789/0 conn(0x7fc7240cd910 legacy=0x7fc72406d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc7296f0700 1 -- 172.21.15.149:0/1010065286 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72415fa00 con 0x7fc72415f630 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc729ef1700 1 --2- 172.21.15.149:0/1010065286 >> v2:172.21.15.184:3300/0 conn(0x7fc72406db50 0x7fc7240cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc7296f0700 1 --2- 172.21.15.149:0/1010065286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72415f630 0x7fc724069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc720009840 tx=0x7fc720009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc56b5b17019c96 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:08.994 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc71bfff700 1 -- 172.21.15.149:0/1010065286 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720011830 con 0x7fc72415f630 2023-06-09T04:38:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc71bfff700 1 -- 172.21.15.149:0/1010065286 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc720011990 con 0x7fc72415f630 2023-06-09T04:38:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.991+0000 7fc71bfff700 1 -- 172.21.15.149:0/1010065286 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720011d20 con 0x7fc72415f630 2023-06-09T04:38:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 -- 172.21.15.149:0/1010065286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72415f630 msgr2=0x7fc724069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 --2- 172.21.15.149:0/1010065286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72415f630 0x7fc724069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc720009840 tx=0x7fc720009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 -- 172.21.15.149:0/1010065286 shutdown_connections 2023-06-09T04:38:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 --2- 172.21.15.149:0/1010065286 >> v2:172.21.15.184:3300/0 conn(0x7fc72406db50 0x7fc7240cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.995 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 --2- 172.21.15.149:0/1010065286 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72415f630 0x7fc724069db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 -- 172.21.15.149:0/1010065286 >> 172.21.15.149:0/1010065286 conn(0x7fc7240cee30 msgr2=0x7fc7240cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 -- 172.21.15.149:0/1010065286 shutdown_connections 2023-06-09T04:38:08.996 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.992+0000 7fc72b954700 1 -- 172.21.15.149:0/1010065286 wait complete. 2023-06-09T04:38:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.993+0000 7fc72b954700 1 Processor -- start 2023-06-09T04:38:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.993+0000 7fc72b954700 1 -- start start 2023-06-09T04:38:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc72b954700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72406db50 0x7fc7240c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc72b954700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7240cd910 0x7fc7240c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc72b954700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc72415f630 0x7fc7241f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:08.998 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc72b954700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c4cc0 con 0x7fc7240cd910 2023-06-09T04:38:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc72b954700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c40b0 con 0x7fc72415f630 2023-06-09T04:38:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc72b954700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c4390 con 0x7fc72406db50 2023-06-09T04:38:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7240cd910 0x7fc7240c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7240cd910 0x7fc7240c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38268/0 (socket says 172.21.15.149:38268) 2023-06-09T04:38:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 -- 172.21.15.149:0/2789112997 learned_addr learned my addr 172.21.15.149:0/2789112997 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc729ef1700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc72415f630 0x7fc7241f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:08.999 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc7296f0700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72406db50 0x7fc7240c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 -- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72406db50 msgr2=0x7fc7240c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72406db50 0x7fc7240c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 -- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc72415f630 msgr2=0x7fc7241f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc72415f630 0x7fc7241f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 -- 172.21.15.149:0/2789112997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c009b30 con 0x7fc7240cd910 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc7296f0700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72406db50 0x7fc7240c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:09.000 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc728eef700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7240cd910 0x7fc7240c3880 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c520 tx=0x7fc71400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc719ffb700 1 -- 172.21.15.149:0/2789112997 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714005cb0 con 0x7fc7240cd910 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc719ffb700 1 -- 172.21.15.149:0/2789112997 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc714005e10 con 0x7fc7240cd910 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc719ffb700 1 -- 172.21.15.149:0/2789112997 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7140072d0 con 0x7fc7240cd910 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.994+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7200094a0 con 0x7fc7240cd910 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.995+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7240c4950 con 0x7fc7240cd910 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.995+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc724073fa0 con 0x7fc7240cd910 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.996+0000 7fc719ffb700 1 -- 172.21.15.149:0/2789112997 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc714007430 con 0x7fc7240cd910 2023-06-09T04:38:09.001 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.996+0000 7fc719ffb700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc70806ace0 0x7fc70806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.996+0000 7fc7296f0700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc70806ace0 0x7fc70806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.996+0000 7fc719ffb700 1 -- 172.21.15.149:0/2789112997 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fc714088520 con 0x7fc7240cd910 2023-06-09T04:38:09.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:08.997+0000 7fc7296f0700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc70806ace0 0x7fc70806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc720000c00 tx=0x7fc720008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.002 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.001+0000 7fc719ffb700 1 -- 172.21.15.149:0/2789112997 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc714053920 con 0x7fc7240cd910 2023-06-09T04:38:09.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.267+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc7240b4db0 con 0x7fc7240cd910 2023-06-09T04:38:09.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.273+0000 7fc719ffb700 1 -- 172.21.15.149:0/2789112997 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc714001250 con 0x7fc7240cd910 2023-06-09T04:38:09.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc70806ace0 msgr2=0x7fc70806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc70806ace0 0x7fc70806d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc720000c00 tx=0x7fc720008030 comp rx=0 tx=0).stop 2023-06-09T04:38:09.276 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7240cd910 msgr2=0x7fc7240c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7240cd910 0x7fc7240c3880 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c520 tx=0x7fc71400c830 comp rx=0 tx=0).stop 2023-06-09T04:38:09.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 shutdown_connections 2023-06-09T04:38:09.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fc70806ace0 0x7fc70806d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fc72406db50 0x7fc7240c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc72415f630 0x7fc7241f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 --2- 172.21.15.149:0/2789112997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc7240cd910 0x7fc7240c3880 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.277 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 >> 172.21.15.149:0/2789112997 conn(0x7fc7240cee30 msgr2=0x7fc72406b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 shutdown_connections 2023-06-09T04:38:09.278 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.275+0000 7fc72b954700 1 -- 172.21.15.149:0/2789112997 wait complete. 2023-06-09T04:38:09.288 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-09T04:38:09.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.407+0000 7ff6523c6700 1 Processor -- start 2023-06-09T04:38:09.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.407+0000 7ff6523c6700 1 -- start start 2023-06-09T04:38:09.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.408+0000 7ff6523c6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff64c15bec0 0x7ff64c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.408+0000 7ff6523c6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c06d570 con 0x7ff64c0caeb0 2023-06-09T04:38:09.409 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.408+0000 7ff6523c6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c0ccc20 con 0x7ff64c15baf0 2023-06-09T04:38:09.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.408+0000 7ff6523c6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c06b210 con 0x7ff64c15bec0 2023-06-09T04:38:09.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.408+0000 7ff650963700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff64c0caeb0 0x7ff64c15c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33910/0 (socket says 172.21.15.149:33910) 2023-06-09T04:38:09.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.408+0000 7ff650963700 1 -- 172.21.15.149:0/3810408166 learned_addr learned my addr 172.21.15.149:0/3810408166 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:09.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.408+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3810408166 >> v2:172.21.15.184:3300/0 conn(0x7ff64c15bec0 0x7ff64c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857358415 0 0) 0x7ff64c06d570 con 0x7ff64c0caeb0 2023-06-09T04:38:09.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6340035b0 con 0x7ff64c0caeb0 2023-06-09T04:38:09.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3432783480 0 0) 0x7ff6340035b0 con 0x7ff64c0caeb0 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 >> v2:172.21.15.184:3300/0 conn(0x7ff64c15bec0 msgr2=0x7ff64c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 --2- 172.21.15.149:0/3810408166 >> v2:172.21.15.184:3300/0 conn(0x7ff64c15bec0 0x7ff64c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 >> v1:172.21.15.184:6789/0 conn(0x7ff64c15baf0 legacy=0x7ff64c0ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c06b420 con 0x7ff64c0caeb0 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7ff6440019f0 con 0x7ff64c0caeb0 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 >> v1:172.21.15.149:6789/0 conn(0x7ff64c0caeb0 legacy=0x7ff64c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff634003a00 0x7ff634003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff634004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff634005200 0x7ff63400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c06b210 con 0x7ff634004850 2023-06-09T04:38:09.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63400c080 con 0x7ff634003a00 2023-06-09T04:38:09.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63400e450 con 0x7ff634005200 2023-06-09T04:38:09.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff634004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64bfff700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff634003a00 0x7ff634003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff650963700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff634005200 0x7ff63400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64b7fe700 1 -- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff634005200 msgr2=0x7ff63400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff634005200 0x7ff63400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64b7fe700 1 -- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff634003a00 msgr2=0x7ff634003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff634003a00 0x7ff634003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64b7fe700 1 -- 172.21.15.149:0/3810408166 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340035b0 con 0x7ff634004850 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff650963700 1 -- 172.21.15.149:0/3810408166 reap_dead start 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.409+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff634004cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00aab0 tx=0x7ff634005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b886ddb85a744b4d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00e960 con 0x7ff634004850 2023-06-09T04:38:09.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c00eac0 con 0x7ff634004850 2023-06-09T04:38:09.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff64affd700 1 -- 172.21.15.149:0/3810408166 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00ee30 con 0x7ff634004850 2023-06-09T04:38:09.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff6523c6700 1 -- 172.21.15.149:0/3810408166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 msgr2=0x7ff634004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff634004cc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00aab0 tx=0x7ff634005880 comp rx=0 tx=0).stop 2023-06-09T04:38:09.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff6523c6700 1 -- 172.21.15.149:0/3810408166 shutdown_connections 2023-06-09T04:38:09.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3810408166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff634004cc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.416 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff6523c6700 1 -- 172.21.15.149:0/3810408166 >> 172.21.15.149:0/3810408166 conn(0x7ff64c0cee30 msgr2=0x7ff64c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff6523c6700 1 -- 172.21.15.149:0/3810408166 shutdown_connections 2023-06-09T04:38:09.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.410+0000 7ff6523c6700 1 -- 172.21.15.149:0/3810408166 wait complete. 2023-06-09T04:38:09.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.411+0000 7ff6523c6700 1 Processor -- start 2023-06-09T04:38:09.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff6523c6700 1 -- start start 2023-06-09T04:38:09.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff6523c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff64c0b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff6523c6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff64c1f5790 0x7ff64c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff6523c6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff64c09d450 0x7ff64c0b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff6523c6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c0c5090 con 0x7ff634004850 2023-06-09T04:38:09.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff6523c6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c1f21a0 con 0x7ff64c1f5790 2023-06-09T04:38:09.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff6523c6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c0b1200 con 0x7ff64c09d450 2023-06-09T04:38:09.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff64bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff64c0b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff64bfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff64c0b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38286/0 (socket says 172.21.15.149:38286) 2023-06-09T04:38:09.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.412+0000 7ff64bfff700 1 -- 172.21.15.149:0/3196131077 learned_addr learned my addr 172.21.15.149:0/3196131077 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:09.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff64bfff700 1 -- 172.21.15.149:0/3196131077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff64c09d450 msgr2=0x7ff64c0b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff64bfff700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff64c09d450 0x7ff64c0b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff64bfff700 1 -- 172.21.15.149:0/3196131077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff64c1f5790 msgr2=0x7ff64c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff64c1f5790 0x7ff64c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff64bfff700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff64c1f5790 0x7ff64c1590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff64bfff700 1 -- 172.21.15.149:0/3196131077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c1f5c70 con 0x7ff634004850 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff64bfff700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff64c0b0cc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff64000f7a0 tx=0x7ff64000fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff648ff9700 1 -- 172.21.15.149:0/3196131077 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400052e0 con 0x7ff634004850 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff648ff9700 1 -- 172.21.15.149:0/3196131077 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff640005440 con 0x7ff634004850 2023-06-09T04:38:09.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c1f5f50 con 0x7ff634004850 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff648ff9700 1 -- 172.21.15.149:0/3196131077 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400038c0 con 0x7ff634004850 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.413+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c1f6510 con 0x7ff634004850 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.414+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c1f24b0 con 0x7ff634004850 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.414+0000 7ff648ff9700 1 -- 172.21.15.149:0/3196131077 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff640003a20 con 0x7ff634004850 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.415+0000 7ff648ff9700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff63806ace0 0x7ff63806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.415+0000 7ff648ff9700 1 -- 172.21.15.149:0/3196131077 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff640089010 con 0x7ff634004850 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.415+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff63806ace0 0x7ff63806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.422 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.415+0000 7ff64b7fe700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff63806ace0 0x7ff63806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff63c000c00 tx=0x7ff63c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.419+0000 7ff648ff9700 1 -- 172.21.15.149:0/3196131077 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6400542d0 con 0x7ff634004850 2023-06-09T04:38:09.686 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.685+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff64c073fa0 con 0x7ff634004850 2023-06-09T04:38:09.689 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.688+0000 7ff648ff9700 1 -- 172.21.15.149:0/3196131077 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff6400578f0 con 0x7ff634004850 2023-06-09T04:38:09.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff63806ace0 msgr2=0x7ff63806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff63806ace0 0x7ff63806d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff63c000c00 tx=0x7ff63c008030 comp rx=0 tx=0).stop 2023-06-09T04:38:09.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 msgr2=0x7ff64c0b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff64c0b0cc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff64000f7a0 tx=0x7ff64000fb60 comp rx=0 tx=0).stop 2023-06-09T04:38:09.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 shutdown_connections 2023-06-09T04:38:09.692 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff63806ace0 0x7ff63806d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff64c09d450 0x7ff64c0b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff634004850 0x7ff64c0b0cc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 --2- 172.21.15.149:0/3196131077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff64c1f5790 0x7ff64c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.690+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 >> 172.21.15.149:0/3196131077 conn(0x7ff64c0cee30 msgr2=0x7ff64c159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.691+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 shutdown_connections 2023-06-09T04:38:09.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.691+0000 7ff6523c6700 1 -- 172.21.15.149:0/3196131077 wait complete. 2023-06-09T04:38:09.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-09T04:38:09.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.825+0000 7fdf3175c700 1 Processor -- start 2023-06-09T04:38:09.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.825+0000 7fdf3175c700 1 -- start start 2023-06-09T04:38:09.826 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.825+0000 7fdf3175c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 0x7fdf2c06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.825+0000 7fdf3175c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdf2c0cdf70 0x7fdf2c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.825+0000 7fdf3175c700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c15a430 con 0x7fdf2c069db0 2023-06-09T04:38:09.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.825+0000 7fdf3175c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0cc230 con 0x7fdf2c0cdf70 2023-06-09T04:38:09.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.825+0000 7fdf3175c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0cc510 con 0x7fdf2c15a060 2023-06-09T04:38:09.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf2b7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fdf2c069db0 0x7fdf2c0b1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33928/0 (socket says 172.21.15.149:33928) 2023-06-09T04:38:09.827 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf2b7fe700 1 -- 172.21.15.149:0/4085248306 learned_addr learned my addr 172.21.15.149:0/4085248306 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:09.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278124441 0 0) 0x7fdf24001490 con 0x7fdf2c069db0 2023-06-09T04:38:09.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf2a7fc700 1 --2- 172.21.15.149:0/4085248306 >> v2:172.21.15.184:3300/0 conn(0x7fdf2c0cdf70 0x7fdf2c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf2affd700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 0x7fdf2c06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf140035b0 con 0x7fdf2c069db0 2023-06-09T04:38:09.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2130004882 0 0) 0x7fdf140035b0 con 0x7fdf2c069db0 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 msgr2=0x7fdf2c06ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 0x7fdf2c06ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 >> v2:172.21.15.184:3300/0 conn(0x7fdf2c0cdf70 msgr2=0x7fdf2c0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 --2- 172.21.15.149:0/4085248306 >> v2:172.21.15.184:3300/0 conn(0x7fdf2c0cdf70 0x7fdf2c0cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0cc7f0 con 0x7fdf2c069db0 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7fdf24001b80 con 0x7fdf2c069db0 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 >> v1:172.21.15.149:6789/0 conn(0x7fdf2c069db0 legacy=0x7fdf2c0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf14003a00 0x7fdf14003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 0x7fdf14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14004d90 0x7fdf14005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0cc230 con 0x7fdf14003a00 2023-06-09T04:38:09.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0cc510 con 0x7fdf14004d90 2023-06-09T04:38:09.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1400ba10 con 0x7fdf2c15a060 2023-06-09T04:38:09.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf2affd700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf14003a00 0x7fdf14003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.832 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf2a7fc700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 0x7fdf14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.826+0000 7fdf2b7fe700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14004d90 0x7fdf14005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf2affd700 1 -- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 msgr2=0x7fdf14004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf2affd700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c15a060 0x7fdf14004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf2affd700 1 -- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14004d90 msgr2=0x7fdf14005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf2affd700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14004d90 0x7fdf14005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf2affd700 1 -- 172.21.15.149:0/4085248306 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140035b0 con 0x7fdf14003a00 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf2affd700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf14003a00 0x7fdf14003e10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009b60 tx=0x7fdf14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239a5ff4c9ba81fe server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00e6c0 con 0x7fdf14003a00 2023-06-09T04:38:09.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00e820 con 0x7fdf14003a00 2023-06-09T04:38:09.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf29ffb700 1 -- 172.21.15.149:0/4085248306 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00eb90 con 0x7fdf14003a00 2023-06-09T04:38:09.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf3175c700 1 -- 172.21.15.149:0/4085248306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf14003a00 msgr2=0x7fdf14003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf3175c700 1 --2- 172.21.15.149:0/4085248306 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf14003a00 0x7fdf14003e10 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009b60 tx=0x7fdf14005880 comp rx=0 tx=0).stop 2023-06-09T04:38:09.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf2b7fe700 1 -- 172.21.15.149:0/4085248306 reap_dead start 2023-06-09T04:38:09.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf3175c700 1 -- 172.21.15.149:0/4085248306 shutdown_connections 2023-06-09T04:38:09.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf3175c700 1 -- 172.21.15.149:0/4085248306 >> 172.21.15.149:0/4085248306 conn(0x7fdf2c0cf250 msgr2=0x7fdf2c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:09.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.827+0000 7fdf3175c700 1 -- 172.21.15.149:0/4085248306 shutdown_connections 2023-06-09T04:38:09.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.828+0000 7fdf3175c700 1 -- 172.21.15.149:0/4085248306 wait complete. 2023-06-09T04:38:09.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.829+0000 7fdf3175c700 1 Processor -- start 2023-06-09T04:38:09.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.829+0000 7fdf3175c700 1 -- start start 2023-06-09T04:38:09.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14003a00 0x7fdf2c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c141d50 0x7fdf2c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c156f20 0x7fdf2c1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c153cc0 con 0x7fdf2c141d50 2023-06-09T04:38:09.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b4570 con 0x7fdf14003a00 2023-06-09T04:38:09.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c1422f0 con 0x7fdf2c156f20 2023-06-09T04:38:09.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c141d50 0x7fdf2c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c141d50 0x7fdf2c15a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38306/0 (socket says 172.21.15.149:38306) 2023-06-09T04:38:09.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 -- 172.21.15.149:0/3032587369 learned_addr learned my addr 172.21.15.149:0/3032587369 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:09.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2affd700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14003a00 0x7fdf2c0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2b7fe700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c156f20 0x7fdf2c1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 -- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c156f20 msgr2=0x7fdf2c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c156f20 0x7fdf2c1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 -- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14003a00 msgr2=0x7fdf2c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14003a00 0x7fdf2c0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 -- 172.21.15.149:0/3032587369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0c57a0 con 0x7fdf2c141d50 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2b7fe700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c156f20 0x7fdf2c1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf2a7fc700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c141d50 0x7fdf2c15a840 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011aa0 tx=0x7fdf20011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf137fe700 1 -- 172.21.15.149:0/3032587369 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000f940 con 0x7fdf2c141d50 2023-06-09T04:38:09.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf137fe700 1 -- 172.21.15.149:0/3032587369 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000faa0 con 0x7fdf2c141d50 2023-06-09T04:38:09.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0c5a40 con 0x7fdf2c141d50 2023-06-09T04:38:09.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf137fe700 1 -- 172.21.15.149:0/3032587369 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000fe50 con 0x7fdf2c141d50 2023-06-09T04:38:09.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.830+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0c7080 con 0x7fdf2c141d50 2023-06-09T04:38:09.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.831+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c0c7660 con 0x7fdf2c141d50 2023-06-09T04:38:09.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.832+0000 7fdf137fe700 1 -- 172.21.15.149:0/3032587369 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf20014440 con 0x7fdf2c141d50 2023-06-09T04:38:09.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.832+0000 7fdf137fe700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf1806ace0 0x7fdf1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:09.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.832+0000 7fdf137fe700 1 -- 172.21.15.149:0/3032587369 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdf200899f0 con 0x7fdf2c141d50 2023-06-09T04:38:09.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.832+0000 7fdf2affd700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf1806ace0 0x7fdf1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:09.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.832+0000 7fdf2affd700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf1806ace0 0x7fdf1806d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0090b0 tx=0x7fdf1c01f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:09.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:09.837+0000 7fdf137fe700 1 -- 172.21.15.149:0/3032587369 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf2c0c7660 con 0x7fdf2c141d50 2023-06-09T04:38:10.106 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.105+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdf2c0c7660 con 0x7fdf2c141d50 2023-06-09T04:38:10.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.109+0000 7fdf137fe700 1 -- 172.21.15.149:0/3032587369 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdf2c0c7660 con 0x7fdf2c141d50 2023-06-09T04:38:10.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf1806ace0 msgr2=0x7fdf1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf1806ace0 0x7fdf1806d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0090b0 tx=0x7fdf1c01f040 comp rx=0 tx=0).stop 2023-06-09T04:38:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c141d50 msgr2=0x7fdf2c15a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c141d50 0x7fdf2c15a840 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011aa0 tx=0x7fdf20011db0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 shutdown_connections 2023-06-09T04:38:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fdf1806ace0 0x7fdf1806d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fdf2c156f20 0x7fdf2c1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf14003a00 0x7fdf2c0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 --2- 172.21.15.149:0/3032587369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf2c141d50 0x7fdf2c15a840 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 >> 172.21.15.149:0/3032587369 conn(0x7fdf2c0cf250 msgr2=0x7fdf2c15c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 shutdown_connections 2023-06-09T04:38:10.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.111+0000 7fdf3175c700 1 -- 172.21.15.149:0/3032587369 wait complete. 2023-06-09T04:38:10.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-09T04:38:10.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.244+0000 7f337054e700 1 Processor -- start 2023-06-09T04:38:10.245 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.244+0000 7f337054e700 1 -- start start 2023-06-09T04:38:10.246 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.245+0000 7f337054e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3368159260 0x7f3368071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.245+0000 7f337054e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f33680cc730 0x7f33680716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.245+0000 7f337054e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33680ceb10 con 0x7f33680ca5f0 2023-06-09T04:38:10.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.245+0000 7f337054e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680aeee0 con 0x7f33680cc730 2023-06-09T04:38:10.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.245+0000 7f337054e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3368159630 con 0x7f3368159260 2023-06-09T04:38:10.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336eaeb700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f33680cc730 0x7f33680716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336e2ea700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3368159260 0x7f3368071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.247 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336dae9700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f33680ca5f0 0x7f33680cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:39944/0 (socket says 172.21.15.149:39944) 2023-06-09T04:38:10.248 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336dae9700 1 -- 172.21.15.149:0/2298511809 learned_addr learned my addr 172.21.15.149:0/2298511809 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:10.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336e2ea700 1 -- 172.21.15.149:0/2298511809 >> v2:172.21.15.184:3300/0 conn(0x7f33680cc730 msgr2=0x7f33680716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:10.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336e2ea700 1 --2- 172.21.15.149:0/2298511809 >> v2:172.21.15.184:3300/0 conn(0x7f33680cc730 0x7f33680716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336e2ea700 1 -- 172.21.15.149:0/2298511809 >> v1:172.21.15.184:6789/0 conn(0x7f33680ca5f0 legacy=0x7f33680cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.249 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336e2ea700 1 -- 172.21.15.149:0/2298511809 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680ce680 con 0x7f3368159260 2023-06-09T04:38:10.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336eaeb700 1 --2- 172.21.15.149:0/2298511809 >> v2:172.21.15.184:3300/0 conn(0x7f33680cc730 0x7f33680716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:10.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336e2ea700 1 --2- 172.21.15.149:0/2298511809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3368159260 0x7f3368071ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3358009840 tx=0x7f3358009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701e0c89c91bf924 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336d2e8700 1 -- 172.21.15.149:0/2298511809 <== mon.2 v2:172.21.15.184:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358011830 con 0x7f3368159260 2023-06-09T04:38:10.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336d2e8700 1 -- 172.21.15.149:0/2298511809 <== mon.2 v2:172.21.15.184:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358011990 con 0x7f3368159260 2023-06-09T04:38:10.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.246+0000 7f336d2e8700 1 -- 172.21.15.149:0/2298511809 <== mon.2 v2:172.21.15.184:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358011d20 con 0x7f3368159260 2023-06-09T04:38:10.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 -- 172.21.15.149:0/2298511809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3368159260 msgr2=0x7f3368071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.250 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 --2- 172.21.15.149:0/2298511809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3368159260 0x7f3368071ce0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3358009840 tx=0x7f3358009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 -- 172.21.15.149:0/2298511809 shutdown_connections 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 --2- 172.21.15.149:0/2298511809 >> v2:172.21.15.184:3300/0 conn(0x7f33680cc730 0x7f33680716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 --2- 172.21.15.149:0/2298511809 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3368159260 0x7f3368071ce0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 -- 172.21.15.149:0/2298511809 >> 172.21.15.149:0/2298511809 conn(0x7f336806aec0 msgr2=0x7f336806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 -- 172.21.15.149:0/2298511809 shutdown_connections 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.247+0000 7f337054e700 1 -- 172.21.15.149:0/2298511809 wait complete. 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.248+0000 7f337054e700 1 Processor -- start 2023-06-09T04:38:10.251 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.248+0000 7f337054e700 1 -- start start 2023-06-09T04:38:10.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f337054e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33680ca5f0 0x7f33680c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f337054e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33680cc730 0x7f336815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f337054e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368159260 0x7f33680b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f337054e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33680c5a20 con 0x7f3368159260 2023-06-09T04:38:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f337054e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336815b7a0 con 0x7f33680ca5f0 2023-06-09T04:38:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f337054e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336815ab90 con 0x7f33680cc730 2023-06-09T04:38:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368159260 0x7f33680b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.254 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368159260 0x7f33680b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38322/0 (socket says 172.21.15.149:38322) 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 -- 172.21.15.149:0/1019843732 learned_addr learned my addr 172.21.15.149:0/1019843732 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336e2ea700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33680ca5f0 0x7f33680c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336dae9700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33680cc730 0x7f336815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 -- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33680cc730 msgr2=0x7f336815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33680cc730 0x7f336815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 -- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33680ca5f0 msgr2=0x7f33680c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33680ca5f0 0x7f33680c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.255 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.249+0000 7f336eaeb700 1 -- 172.21.15.149:0/1019843732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360009a70 con 0x7f3368159260 2023-06-09T04:38:10.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.250+0000 7f336eaeb700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368159260 0x7f33680b2e90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f336000ef90 tx=0x7f336000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.250+0000 7f335effd700 1 -- 172.21.15.149:0/1019843732 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336000cc90 con 0x7f3368159260 2023-06-09T04:38:10.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.250+0000 7f335effd700 1 -- 172.21.15.149:0/1019843732 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336000f040 con 0x7f3368159260 2023-06-09T04:38:10.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.250+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33580094a0 con 0x7f3368159260 2023-06-09T04:38:10.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.250+0000 7f335effd700 1 -- 172.21.15.149:0/1019843732 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600146c0 con 0x7f3368159260 2023-06-09T04:38:10.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.250+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336815b150 con 0x7f3368159260 2023-06-09T04:38:10.256 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.251+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336815b950 con 0x7f3368159260 2023-06-09T04:38:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.251+0000 7f335effd700 1 -- 172.21.15.149:0/1019843732 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3360014820 con 0x7f3368159260 2023-06-09T04:38:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.251+0000 7f335effd700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f334c06ad10 0x7f334c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.252+0000 7f335effd700 1 -- 172.21.15.149:0/1019843732 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3360089e10 con 0x7f3368159260 2023-06-09T04:38:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.252+0000 7f336e2ea700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f334c06ad10 0x7f334c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.252+0000 7f336e2ea700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f334c06ad10 0x7f334c06d1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3358000c00 tx=0x7f3358008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.257 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.256+0000 7f335effd700 1 -- 172.21.15.149:0/1019843732 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f336815b950 con 0x7f3368159260 2023-06-09T04:38:10.520 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.519+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f336815b910 con 0x7f3368159260 2023-06-09T04:38:10.524 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.523+0000 7f335effd700 1 -- 172.21.15.149:0/1019843732 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f33600180a0 con 0x7f3368159260 2023-06-09T04:38:10.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.525+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f334c06ad10 msgr2=0x7f334c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.525+0000 7f337054e700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f334c06ad10 0x7f334c06d1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3358000c00 tx=0x7f3358008030 comp rx=0 tx=0).stop 2023-06-09T04:38:10.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.525+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368159260 msgr2=0x7f33680b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.525+0000 7f337054e700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368159260 0x7f33680b2e90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f336000ef90 tx=0x7f336000c3a0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.525+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 shutdown_connections 2023-06-09T04:38:10.527 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.525+0000 7f337054e700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f334c06ad10 0x7f334c06d1c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.525+0000 7f337054e700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3368159260 0x7f33680b2e90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.526+0000 7f337054e700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33680ca5f0 0x7f33680c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.526+0000 7f337054e700 1 --2- 172.21.15.149:0/1019843732 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f33680cc730 0x7f336815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.526+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 >> 172.21.15.149:0/1019843732 conn(0x7f336806aec0 msgr2=0x7f33680afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.526+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 shutdown_connections 2023-06-09T04:38:10.528 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.526+0000 7f337054e700 1 -- 172.21.15.149:0/1019843732 wait complete. 2023-06-09T04:38:10.539 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-09T04:38:10.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.658+0000 7f3219079700 1 Processor -- start 2023-06-09T04:38:10.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.658+0000 7f3219079700 1 -- start start 2023-06-09T04:38:10.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f3219079700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f3214071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f3219079700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f32140cd220 0x7f321406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.661 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f3219079700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f32140b19a0 0x7f32140ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f3219079700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321406a6c0 con 0x7f32140b19a0 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f3219079700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3214071320 con 0x7f32140cd220 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f3219079700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3214071600 con 0x7f3214069db0 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f321359e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f32140b19a0 0x7f32140ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f321359e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f32140b19a0 0x7f32140ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38330/0 (socket says 172.21.15.149:38330) 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f321359e700 1 -- 172.21.15.149:0/3844565868 learned_addr learned my addr 172.21.15.149:0/3844565868 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f321259c700 1 --2- 172.21.15.149:0/3844565868 >> v2:172.21.15.184:3300/0 conn(0x7f32140cd220 0x7f321406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.662 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.659+0000 7f3212d9d700 1 --2- 172.21.15.149:0/3844565868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f3214071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f321359e700 1 -- 172.21.15.149:0/3844565868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 msgr2=0x7f3214071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:10.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f321359e700 1 --2- 172.21.15.149:0/3844565868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f3214071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f321359e700 1 -- 172.21.15.149:0/3844565868 >> v2:172.21.15.184:3300/0 conn(0x7f32140cd220 msgr2=0x7f321406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:10.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f321359e700 1 --2- 172.21.15.149:0/3844565868 >> v2:172.21.15.184:3300/0 conn(0x7f32140cd220 0x7f321406a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f321359e700 1 -- 172.21.15.149:0/3844565868 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140ced70 con 0x7f32140b19a0 2023-06-09T04:38:10.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f321359e700 1 --2- 172.21.15.149:0/3844565868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140b19a0 0x7f32140ab8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f32140cd1a0 tx=0x7f320c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172d6a1bf06d5985 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.663 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3211d9b700 1 -- 172.21.15.149:0/3844565868 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c00e070 con 0x7f32140b19a0 2023-06-09T04:38:10.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3211d9b700 1 -- 172.21.15.149:0/3844565868 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c00b910 con 0x7f32140b19a0 2023-06-09T04:38:10.664 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3211d9b700 1 -- 172.21.15.149:0/3844565868 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c00bcc0 con 0x7f32140b19a0 2023-06-09T04:38:10.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3219079700 1 -- 172.21.15.149:0/3844565868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140b19a0 msgr2=0x7f32140ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3219079700 1 --2- 172.21.15.149:0/3844565868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140b19a0 0x7f32140ab8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f32140cd1a0 tx=0x7f320c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:10.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3219079700 1 -- 172.21.15.149:0/3844565868 shutdown_connections 2023-06-09T04:38:10.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3219079700 1 --2- 172.21.15.149:0/3844565868 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140b19a0 0x7f32140ab8f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3219079700 1 --2- 172.21.15.149:0/3844565868 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f3214071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3219079700 1 --2- 172.21.15.149:0/3844565868 >> v2:172.21.15.184:3300/0 conn(0x7f32140cd220 0x7f321406a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.660+0000 7f3219079700 1 -- 172.21.15.149:0/3844565868 >> 172.21.15.149:0/3844565868 conn(0x7f321406aec0 msgr2=0x7f321406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.661+0000 7f3219079700 1 -- 172.21.15.149:0/3844565868 shutdown_connections 2023-06-09T04:38:10.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.661+0000 7f3219079700 1 -- 172.21.15.149:0/3844565868 wait complete. 2023-06-09T04:38:10.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.662+0000 7f3219079700 1 Processor -- start 2023-06-09T04:38:10.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.662+0000 7f3219079700 1 -- start start 2023-06-09T04:38:10.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f3219079700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f32140b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f3219079700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32140b19a0 0x7f32140c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f3219079700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140cd220 0x7f3214159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f3219079700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140b2860 con 0x7f32140cd220 2023-06-09T04:38:10.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f3219079700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32140b2b40 con 0x7f32140b19a0 2023-06-09T04:38:10.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f3219079700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140b2e20 con 0x7f3214069db0 2023-06-09T04:38:10.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140cd220 0x7f3214159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140cd220 0x7f3214159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38336/0 (socket says 172.21.15.149:38336) 2023-06-09T04:38:10.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 -- 172.21.15.149:0/2937212818 learned_addr learned my addr 172.21.15.149:0/2937212818 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f3212d9d700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f32140b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321259c700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32140b19a0 0x7f32140c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 -- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 msgr2=0x7f32140b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f32140b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 -- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32140b19a0 msgr2=0x7f32140c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32140b19a0 0x7f32140c5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 -- 172.21.15.149:0/2937212818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c009b30 con 0x7f32140cd220 2023-06-09T04:38:10.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f321359e700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140cd220 0x7f3214159540 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f32140cd1d0 tx=0x7f320c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f31fb7fe700 1 -- 172.21.15.149:0/2937212818 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c004880 con 0x7f32140cd220 2023-06-09T04:38:10.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.663+0000 7f31fb7fe700 1 -- 172.21.15.149:0/2937212818 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c0099b0 con 0x7f32140cd220 2023-06-09T04:38:10.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.664+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32140b3100 con 0x7f32140cd220 2023-06-09T04:38:10.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.664+0000 7f31fb7fe700 1 -- 172.21.15.149:0/2937212818 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c01b670 con 0x7f32140cd220 2023-06-09T04:38:10.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.664+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3214155f00 con 0x7f32140cd220 2023-06-09T04:38:10.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.664+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32140b3620 con 0x7f32140cd220 2023-06-09T04:38:10.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.665+0000 7f31fb7fe700 1 -- 172.21.15.149:0/2937212818 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f320c01b7d0 con 0x7f32140cd220 2023-06-09T04:38:10.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.665+0000 7f31fb7fe700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f320006ace0 0x7f320006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:10.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.665+0000 7f31fb7fe700 1 -- 172.21.15.149:0/2937212818 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f320c08a5b0 con 0x7f32140cd220 2023-06-09T04:38:10.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.665+0000 7f3212d9d700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f320006ace0 0x7f320006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:10.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.666+0000 7f3212d9d700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f320006ace0 0x7f320006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3208009ac0 tx=0x7f3208009210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:10.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.670+0000 7f31fb7fe700 1 -- 172.21.15.149:0/2937212818 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32140b3620 con 0x7f32140cd220 2023-06-09T04:38:10.940 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.939+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f32140b3620 con 0x7f32140cd220 2023-06-09T04:38:10.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.943+0000 7f31fb7fe700 1 -- 172.21.15.149:0/2937212818 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f32140b3620 con 0x7f32140cd220 2023-06-09T04:38:10.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f320006ace0 msgr2=0x7f320006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f320006ace0 0x7f320006d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3208009ac0 tx=0x7f3208009210 comp rx=0 tx=0).stop 2023-06-09T04:38:10.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140cd220 msgr2=0x7f3214159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:10.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140cd220 0x7f3214159540 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f32140cd1d0 tx=0x7f320c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 shutdown_connections 2023-06-09T04:38:10.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f320006ace0 0x7f320006d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f3214069db0 0x7f32140b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32140cd220 0x7f3214159540 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 --2- 172.21.15.149:0/2937212818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32140b19a0 0x7f32140c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:10.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 >> 172.21.15.149:0/2937212818 conn(0x7f321406aec0 msgr2=0x7f3214157290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:10.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 shutdown_connections 2023-06-09T04:38:10.948 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:10.945+0000 7f3219079700 1 -- 172.21.15.149:0/2937212818 wait complete. 2023-06-09T04:38:10.958 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.077+0000 7f694b4ae700 1 Processor -- start 2023-06-09T04:38:11.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.077+0000 7f694b4ae700 1 -- start start 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f694b4ae700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f69440cd980 0x7f69440b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f694b4ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f69440cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f694b4ae700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69440b01a0 con 0x7f69440afa30 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f694b4ae700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69440b06f0 con 0x7f69440cd980 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f694b4ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b0900 con 0x7f69440b0c40 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f694924a700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f69440afa30 0x7f69440cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33972/0 (socket says 172.21.15.149:33972) 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f694924a700 1 -- 172.21.15.149:0/4078355638 learned_addr learned my addr 172.21.15.149:0/4078355638 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f6948a49700 1 --2- 172.21.15.149:0/4078355638 >> v2:172.21.15.184:3300/0 conn(0x7f69440cd980 0x7f69440b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f6949a4b700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f69440cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951947084 0 0) 0x7f69440b01a0 con 0x7f69440afa30 2023-06-09T04:38:11.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69300035b0 con 0x7f69440afa30 2023-06-09T04:38:11.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1972002149 0 0) 0x7f69300035b0 con 0x7f69440afa30 2023-06-09T04:38:11.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 msgr2=0x7f69440cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f69440cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 >> v2:172.21.15.184:3300/0 conn(0x7f69440cd980 msgr2=0x7f69440b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 --2- 172.21.15.149:0/4078355638 >> v2:172.21.15.184:3300/0 conn(0x7f69440cd980 0x7f69440b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69440ca7a0 con 0x7f69440afa30 2023-06-09T04:38:11.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f69400017f0 con 0x7f69440afa30 2023-06-09T04:38:11.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f6948a49700 1 --2- 172.21.15.149:0/4078355638 >> v2:172.21.15.184:3300/0 conn(0x7f69440cd980 0x7f69440b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:11.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.078+0000 7f6949a4b700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f69440cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:38:11.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 >> v1:172.21.15.149:6789/0 conn(0x7f69440afa30 legacy=0x7f69440cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f6930003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6930003f40 0x7f6930004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930004d90 0x7f6930005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b06f0 con 0x7f6930003f40 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b0900 con 0x7f6930004d90 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693000dc20 con 0x7f69440b0c40 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6948a49700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6930003f40 0x7f6930004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f694924a700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f6930003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6949a4b700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930004d90 0x7f6930005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6948a49700 1 -- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 msgr2=0x7f6930003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6948a49700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f6930003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6948a49700 1 -- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930004d90 msgr2=0x7f6930005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6948a49700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930004d90 0x7f6930005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6948a49700 1 -- 172.21.15.149:0/4078355638 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c009a70 con 0x7f6930003f40 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f694924a700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b0c40 0x7f6930003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f6948a49700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6930003f40 0x7f6930004850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6944070840 tx=0x7f6930005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6437d70a8b303794 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693400e7e0 con 0x7f6930003f40 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693400e940 con 0x7f6930003f40 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.079+0000 7f693bfff700 1 -- 172.21.15.149:0/4078355638 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693400ecd0 con 0x7f6930003f40 2023-06-09T04:38:11.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.080+0000 7f694b4ae700 1 -- 172.21.15.149:0/4078355638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6930003f40 msgr2=0x7f6930004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.080+0000 7f694b4ae700 1 --2- 172.21.15.149:0/4078355638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6930003f40 0x7f6930004850 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6944070840 tx=0x7f6930005880 comp rx=0 tx=0).stop 2023-06-09T04:38:11.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.080+0000 7f6949a4b700 1 -- 172.21.15.149:0/4078355638 reap_dead start 2023-06-09T04:38:11.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.080+0000 7f694b4ae700 1 -- 172.21.15.149:0/4078355638 shutdown_connections 2023-06-09T04:38:11.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.080+0000 7f694b4ae700 1 -- 172.21.15.149:0/4078355638 >> 172.21.15.149:0/4078355638 conn(0x7f694406b7e0 msgr2=0x7f69440cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.080+0000 7f694b4ae700 1 -- 172.21.15.149:0/4078355638 shutdown_connections 2023-06-09T04:38:11.087 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.080+0000 7f694b4ae700 1 -- 172.21.15.149:0/4078355638 wait complete. 2023-06-09T04:38:11.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.081+0000 7f694b4ae700 1 Processor -- start 2023-06-09T04:38:11.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.081+0000 7f694b4ae700 1 -- start start 2023-06-09T04:38:11.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f694b4ae700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930003f40 0x7f694414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f694b4ae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440ac8a0 0x7f69440acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f694b4ae700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b3520 0x7f69440b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f694b4ae700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694414e160 con 0x7f69440ac8a0 2023-06-09T04:38:11.090 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f694b4ae700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440ad250 con 0x7f6930003f40 2023-06-09T04:38:11.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f694b4ae700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b3ed0 con 0x7f69440b3520 2023-06-09T04:38:11.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f6948a49700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440ac8a0 0x7f69440acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f6948a49700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440ac8a0 0x7f69440acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38354/0 (socket says 172.21.15.149:38354) 2023-06-09T04:38:11.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.082+0000 7f6948a49700 1 -- 172.21.15.149:0/3934356958 learned_addr learned my addr 172.21.15.149:0/3934356958 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:11.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f694924a700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930003f40 0x7f694414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6949a4b700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b3520 0x7f69440b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6948a49700 1 -- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b3520 msgr2=0x7f69440b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6948a49700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b3520 0x7f69440b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6948a49700 1 -- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930003f40 msgr2=0x7f694414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6948a49700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930003f40 0x7f694414dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6948a49700 1 -- 172.21.15.149:0/3934356958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694415adb0 con 0x7f69440ac8a0 2023-06-09T04:38:11.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f694924a700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930003f40 0x7f694414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:11.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6948a49700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440ac8a0 0x7f69440acd10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6930004690 tx=0x7f69340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6939ffb700 1 -- 172.21.15.149:0/3934356958 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934021070 con 0x7f69440ac8a0 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6939ffb700 1 -- 172.21.15.149:0/3934356958 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693400feb0 con 0x7f69440ac8a0 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69440c9b50 con 0x7f69440ac8a0 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f6939ffb700 1 -- 172.21.15.149:0/3934356958 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693400e7e0 con 0x7f69440ac8a0 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.083+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69440ad740 con 0x7f69440ac8a0 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.084+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694415af40 con 0x7f69440ac8a0 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.085+0000 7f6939ffb700 1 -- 172.21.15.149:0/3934356958 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6934025070 con 0x7f69440ac8a0 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.085+0000 7f6939ffb700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f692806ace0 0x7f692806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.085+0000 7f6939ffb700 1 -- 172.21.15.149:0/3934356958 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f693408a620 con 0x7f69440ac8a0 2023-06-09T04:38:11.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.085+0000 7f694924a700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f692806ace0 0x7f692806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.085+0000 7f694924a700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f692806ace0 0x7f692806d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6940001eb0 tx=0x7f6940009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.089+0000 7f6939ffb700 1 -- 172.21.15.149:0/3934356958 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6934055970 con 0x7f69440ac8a0 2023-06-09T04:38:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.281+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6944073fa0 con 0x7f69440ac8a0 2023-06-09T04:38:11.282 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.281+0000 7f6939ffb700 1 -- 172.21.15.149:0/3934356958 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14798 (secure 0 0 0) 0x7f6934058f90 con 0x7f69440ac8a0 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:11.283 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":37,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:38:07.979154+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:11.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f692806ace0 msgr2=0x7f692806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f692806ace0 0x7f692806d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6940001eb0 tx=0x7f6940009040 comp rx=0 tx=0).stop 2023-06-09T04:38:11.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440ac8a0 msgr2=0x7f69440acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.285 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440ac8a0 0x7f69440acd10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6930004690 tx=0x7f69340047c0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 shutdown_connections 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f692806ace0 0x7f692806d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f69440b3520 0x7f69440b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6930003f40 0x7f694414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 --2- 172.21.15.149:0/3934356958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f69440ac8a0 0x7f69440acd10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 >> 172.21.15.149:0/3934356958 conn(0x7f694406b7e0 msgr2=0x7f69440caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 shutdown_connections 2023-06-09T04:38:11.286 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.284+0000 7f694b4ae700 1 -- 172.21.15.149:0/3934356958 wait complete. 2023-06-09T04:38:11.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:38:11.298 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.420+0000 7ff421e1b700 1 Processor -- start 2023-06-09T04:38:11.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.420+0000 7ff421e1b700 1 -- start start 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff421e1b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff41c0cded0 0x7ff41c15d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff421e1b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff41c0cd300 0x7ff41c0ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff421e1b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff41c0716e0 con 0x7ff41c1591d0 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff421e1b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c072280 con 0x7ff41c0cd300 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff421e1b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c06f4a0 con 0x7ff41c0cded0 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff41c0cd300 0x7ff41c0ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.423 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41bfff700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7ff41c1591d0 0x7ff41c071b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:33996/0 (socket says 172.21.15.149:33996) 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41bfff700 1 -- 172.21.15.149:0/2652016376 learned_addr learned my addr 172.21.15.149:0/2652016376 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41b7fe700 1 --2- 172.21.15.149:0/2652016376 >> v2:172.21.15.184:3300/0 conn(0x7ff41c0cded0 0x7ff41c15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41affd700 1 -- 172.21.15.149:0/2652016376 >> v2:172.21.15.184:3300/0 conn(0x7ff41c0cded0 msgr2=0x7ff41c15d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41affd700 1 --2- 172.21.15.149:0/2652016376 >> v2:172.21.15.184:3300/0 conn(0x7ff41c0cded0 0x7ff41c15d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41affd700 1 -- 172.21.15.149:0/2652016376 >> v1:172.21.15.149:6789/0 conn(0x7ff41c1591d0 legacy=0x7ff41c071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41affd700 1 -- 172.21.15.149:0/2652016376 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c15dad0 con 0x7ff41c0cd300 2023-06-09T04:38:11.424 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41a7fc700 1 -- 172.21.15.149:0/2652016376 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545577564 0 0) 0x7ff41c0716e0 con 0x7ff41c1591d0 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.421+0000 7ff41affd700 1 --2- 172.21.15.149:0/2652016376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0ce2a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d06a0 tx=0x7ff410009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeac5ab6b065086 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff41a7fc700 1 -- 172.21.15.149:0/2652016376 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410011830 con 0x7ff41c0cd300 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff41a7fc700 1 -- 172.21.15.149:0/2652016376 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410011990 con 0x7ff41c0cd300 2023-06-09T04:38:11.425 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff41a7fc700 1 -- 172.21.15.149:0/2652016376 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410011d20 con 0x7ff41c0cd300 2023-06-09T04:38:11.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 -- 172.21.15.149:0/2652016376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 msgr2=0x7ff41c0ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 --2- 172.21.15.149:0/2652016376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0ce2a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0d06a0 tx=0x7ff410009b20 comp rx=0 tx=0).stop 2023-06-09T04:38:11.427 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 -- 172.21.15.149:0/2652016376 shutdown_connections 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 --2- 172.21.15.149:0/2652016376 >> v2:172.21.15.184:3300/0 conn(0x7ff41c0cded0 0x7ff41c15d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 --2- 172.21.15.149:0/2652016376 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0ce2a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 -- 172.21.15.149:0/2652016376 >> 172.21.15.149:0/2652016376 conn(0x7ff41c06aec0 msgr2=0x7ff41c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 -- 172.21.15.149:0/2652016376 shutdown_connections 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.422+0000 7ff421e1b700 1 -- 172.21.15.149:0/2652016376 wait complete. 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.423+0000 7ff421e1b700 1 Processor -- start 2023-06-09T04:38:11.428 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.423+0000 7ff421e1b700 1 -- start start 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff421e1b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff421e1b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff41c0cded0 0x7ff41c1eec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff421e1b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff41c1591d0 0x7ff41c1ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff421e1b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1f3c50 con 0x7ff41c0cd300 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff421e1b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1f2fd0 con 0x7ff41c1591d0 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff421e1b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1f32b0 con 0x7ff41c0cded0 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff41b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.429 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff41b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38366/0 (socket says 172.21.15.149:38366) 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff41b7fe700 1 -- 172.21.15.149:0/3742578119 learned_addr learned my addr 172.21.15.149:0/3742578119 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff41bfff700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff41c1591d0 0x7ff41c1ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.424+0000 7ff41affd700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff41c0cded0 0x7ff41c1eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff41b7fe700 1 -- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff41c0cded0 msgr2=0x7ff41c1eec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff41b7fe700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff41c0cded0 0x7ff41c1eec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff41b7fe700 1 -- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff41c1591d0 msgr2=0x7ff41c1ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff41b7fe700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff41c1591d0 0x7ff41c1ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.430 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff41b7fe700 1 -- 172.21.15.149:0/3742578119 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100094a0 con 0x7ff41c0cd300 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff41b7fe700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0c8ba0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00c7f0 tx=0x7ff40c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff403fff700 1 -- 172.21.15.149:0/3742578119 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c011800 con 0x7ff41c0cd300 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff403fff700 1 -- 172.21.15.149:0/3742578119 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c011960 con 0x7ff41c0cd300 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c1f3590 con 0x7ff41c0cd300 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff403fff700 1 -- 172.21.15.149:0/3742578119 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c011cf0 con 0x7ff41c0cd300 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.425+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c1ef6e0 con 0x7ff41c0cd300 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.426+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c073fa0 con 0x7ff41c0cd300 2023-06-09T04:38:11.431 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.426+0000 7ff403fff700 1 -- 172.21.15.149:0/3742578119 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff40c018360 con 0x7ff41c0cd300 2023-06-09T04:38:11.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.427+0000 7ff403fff700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff40806ace0 0x7ff40806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.432 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.427+0000 7ff403fff700 1 -- 172.21.15.149:0/3742578119 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff40c0892a0 con 0x7ff41c0cd300 2023-06-09T04:38:11.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.427+0000 7ff41affd700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff40806ace0 0x7ff40806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.427+0000 7ff41affd700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff40806ace0 0x7ff40806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0cd6d0 tx=0x7ff41001c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.433 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.431+0000 7ff403fff700 1 -- 172.21.15.149:0/3742578119 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff40c058000 con 0x7ff41c0cd300 2023-06-09T04:38:11.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.619+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff41c0b55d0 con 0x7ff41c0cd300 2023-06-09T04:38:11.620 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.619+0000 7ff403fff700 1 -- 172.21.15.149:0/3742578119 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff40c057b90 con 0x7ff41c0cd300 2023-06-09T04:38:11.620 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T04:38:11.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff40806ace0 msgr2=0x7ff40806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.622 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff40806ace0 0x7ff40806d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff41c0cd6d0 tx=0x7ff41001c040 comp rx=0 tx=0).stop 2023-06-09T04:38:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 msgr2=0x7ff41c0c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0c8ba0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00c7f0 tx=0x7ff40c00cbb0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 shutdown_connections 2023-06-09T04:38:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff40806ace0 0x7ff40806d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff41c1591d0 0x7ff41c1ef1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff41c0cd300 0x7ff41c0c8ba0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.623 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 --2- 172.21.15.149:0/3742578119 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff41c0cded0 0x7ff41c1eec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 >> 172.21.15.149:0/3742578119 conn(0x7ff41c06aec0 msgr2=0x7ff41c0cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 shutdown_connections 2023-06-09T04:38:11.624 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.621+0000 7ff421e1b700 1 -- 172.21.15.149:0/3742578119 wait complete. 2023-06-09T04:38:11.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:38:11.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.757+0000 7f2ad484b700 1 Processor -- start 2023-06-09T04:38:11.758 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.757+0000 7f2ad484b700 1 -- start start 2023-06-09T04:38:11.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2ad484b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 0x7f2ad0071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2ad484b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad015c990 con 0x7f2ad015c5c0 2023-06-09T04:38:11.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2ad484b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad00cd2c0 con 0x7f2ad0069db0 2023-06-09T04:38:11.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2ad484b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00cd5a0 con 0x7f2ad00b1a80 2023-06-09T04:38:11.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2ace59c700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2ad015c5c0 0x7f2ad00cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34006/0 (socket says 172.21.15.149:34006) 2023-06-09T04:38:11.761 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2ace59c700 1 -- 172.21.15.149:0/3558119672 learned_addr learned my addr 172.21.15.149:0/3558119672 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:11.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286238427 0 0) 0x7f2ad015c990 con 0x7f2ad015c5c0 2023-06-09T04:38:11.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acdd9b700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 0x7f2ad0071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab80035b0 con 0x7f2ad015c5c0 2023-06-09T04:38:11.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3453345098 0 0) 0x7f2ab80035b0 con 0x7f2ad015c5c0 2023-06-09T04:38:11.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 msgr2=0x7f2ad0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 0x7f2ad0071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.762 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 >> v1:172.21.15.184:6789/0 conn(0x7f2ad0069db0 legacy=0x7f2ad00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0071320 con 0x7f2ad015c5c0 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f2ac0001670 con 0x7f2ad015c5c0 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.758+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 >> v1:172.21.15.149:6789/0 conn(0x7f2ad015c5c0 legacy=0x7f2ad00cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8003a30 0x7f2ab8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8004850 0x7f2ab8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 0x7f2ab8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00cd5a0 con 0x7f2ab8003a30 2023-06-09T04:38:11.763 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab800bb40 con 0x7f2ab8004850 2023-06-09T04:38:11.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab800bd00 con 0x7f2ad00b1a80 2023-06-09T04:38:11.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2ace59c700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8003a30 0x7f2ab8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acdd9b700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8004850 0x7f2ab8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2aced9d700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 0x7f2ab8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2ace59c700 1 -- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 msgr2=0x7f2ab8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2ace59c700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad00b1a80 0x7f2ab8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.764 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2ace59c700 1 -- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8004850 msgr2=0x7f2ab8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2ace59c700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8004850 0x7f2ab8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2ace59c700 1 -- 172.21.15.149:0/3558119672 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80035b0 con 0x7f2ab8003a30 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2ace59c700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8003a30 0x7f2ab8003e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000c240 tx=0x7f2ab8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71eefef4bb8eceef server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0007c10 con 0x7f2ab8003a30 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000cde0 con 0x7f2ab8003a30 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.759+0000 7f2acd59a700 1 -- 172.21.15.149:0/3558119672 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0005ba0 con 0x7f2ab8003a30 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.760+0000 7f2ad484b700 1 -- 172.21.15.149:0/3558119672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8003a30 msgr2=0x7f2ab8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.765 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.760+0000 7f2ad484b700 1 --2- 172.21.15.149:0/3558119672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ab8003a30 0x7f2ab8003e40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000c240 tx=0x7f2ab8005880 comp rx=0 tx=0).stop 2023-06-09T04:38:11.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.760+0000 7f2aced9d700 1 -- 172.21.15.149:0/3558119672 reap_dead start 2023-06-09T04:38:11.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.760+0000 7f2ad484b700 1 -- 172.21.15.149:0/3558119672 shutdown_connections 2023-06-09T04:38:11.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.760+0000 7f2ad484b700 1 -- 172.21.15.149:0/3558119672 >> 172.21.15.149:0/3558119672 conn(0x7f2ad006aec0 msgr2=0x7f2ad006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.760+0000 7f2ad484b700 1 -- 172.21.15.149:0/3558119672 shutdown_connections 2023-06-09T04:38:11.766 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.760+0000 7f2ad484b700 1 -- 172.21.15.149:0/3558119672 wait complete. 2023-06-09T04:38:11.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.761+0000 7f2ad484b700 1 Processor -- start 2023-06-09T04:38:11.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.761+0000 7f2ad484b700 1 -- start start 2023-06-09T04:38:11.768 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2ad484b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8003a30 0x7f2ad014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2ad484b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad015db60 0x7f2ad00af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2ad484b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad015dfd0 0x7f2ad00af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2ad484b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00ad110 con 0x7f2ad015db60 2023-06-09T04:38:11.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2ad484b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00adb40 con 0x7f2ab8003a30 2023-06-09T04:38:11.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2ad484b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad00ade20 con 0x7f2ad015dfd0 2023-06-09T04:38:11.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad015db60 0x7f2ad00af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.769 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad015db60 0x7f2ad00af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38388/0 (socket says 172.21.15.149:38388) 2023-06-09T04:38:11.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 -- 172.21.15.149:0/3944348190 learned_addr learned my addr 172.21.15.149:0/3944348190 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:11.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2ace59c700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8003a30 0x7f2ad014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2aced9d700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad015dfd0 0x7f2ad00af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 -- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad015dfd0 msgr2=0x7f2ad00af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad015dfd0 0x7f2ad00af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 -- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8003a30 msgr2=0x7f2ad014fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.770 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8003a30 0x7f2ad014fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.762+0000 7f2acdd9b700 1 -- 172.21.15.149:0/3944348190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00ae100 con 0x7f2ad015db60 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.763+0000 7f2acdd9b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad015db60 0x7f2ad00af260 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4011660 tx=0x7f2ac4011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.763+0000 7f2abeffd700 1 -- 172.21.15.149:0/3944348190 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4015930 con 0x7f2ad015db60 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.763+0000 7f2abeffd700 1 -- 172.21.15.149:0/3944348190 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4015a90 con 0x7f2ad015db60 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.763+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad00ae3e0 con 0x7f2ad015db60 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.763+0000 7f2abeffd700 1 -- 172.21.15.149:0/3944348190 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4015e00 con 0x7f2ad015db60 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.763+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad00ad7f0 con 0x7f2ad015db60 2023-06-09T04:38:11.771 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.764+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad0073fa0 con 0x7f2ad015db60 2023-06-09T04:38:11.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.764+0000 7f2abeffd700 1 -- 172.21.15.149:0/3944348190 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ac40143e0 con 0x7f2ad015db60 2023-06-09T04:38:11.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.764+0000 7f2abeffd700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ab006ace0 0x7f2ab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:11.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.765+0000 7f2abeffd700 1 -- 172.21.15.149:0/3944348190 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2ac4089560 con 0x7f2ad015db60 2023-06-09T04:38:11.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.765+0000 7f2ace59c700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ab006ace0 0x7f2ab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:11.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.765+0000 7f2ace59c700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ab006ace0 0x7f2ab006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0001930 tx=0x7f2ac0007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:11.772 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.769+0000 7f2abeffd700 1 -- 172.21.15.149:0/3944348190 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2ac4054820 con 0x7f2ad015db60 2023-06-09T04:38:11.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.958+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ad00b55d0 con 0x7f2ad015db60 2023-06-09T04:38:11.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.959+0000 7f2abeffd700 1 -- 172.21.15.149:0/3944348190 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ac4057e40 con 0x7f2ad015db60 2023-06-09T04:38:11.960 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T04:38:11.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ab006ace0 msgr2=0x7f2ab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ab006ace0 0x7f2ab006d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0001930 tx=0x7f2ac0007000 comp rx=0 tx=0).stop 2023-06-09T04:38:11.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad015db60 msgr2=0x7f2ad00af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:11.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad015db60 0x7f2ad00af260 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4011660 tx=0x7f2ac4011970 comp rx=0 tx=0).stop 2023-06-09T04:38:11.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 shutdown_connections 2023-06-09T04:38:11.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ab006ace0 0x7f2ab006d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2ad015dfd0 0x7f2ad00af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab8003a30 0x7f2ad014fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 --2- 172.21.15.149:0/3944348190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2ad015db60 0x7f2ad00af260 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 >> 172.21.15.149:0/3944348190 conn(0x7f2ad006aec0 msgr2=0x7f2ad00b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 shutdown_connections 2023-06-09T04:38:11.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:11.961+0000 7f2ad484b700 1 -- 172.21.15.149:0/3944348190 wait complete. 2023-06-09T04:38:11.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:38:12.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.093+0000 7f15c232c700 1 Processor -- start 2023-06-09T04:38:12.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.093+0000 7f15c232c700 1 -- start start 2023-06-09T04:38:12.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15c232c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15bc158fc0 0x7f15bc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15c232c700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f15bc06c8f0 0x7f15bc06d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15c232c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15bc159390 con 0x7f15bc06cd90 2023-06-09T04:38:12.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15c232c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc0caee0 con 0x7f15bc158fc0 2023-06-09T04:38:12.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15c232c700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15bc0ae770 con 0x7f15bc06c8f0 2023-06-09T04:38:12.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15bc158fc0 0x7f15bc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f15bc158fc0 0x7f15bc069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38394/0 (socket says 172.21.15.149:38394) 2023-06-09T04:38:12.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 -- 172.21.15.149:0/1589834541 learned_addr learned my addr 172.21.15.149:0/1589834541 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:12.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 -- 172.21.15.149:0/1589834541 >> v2:172.21.15.184:3300/0 conn(0x7f15bc06c8f0 msgr2=0x7f15bc06d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 --2- 172.21.15.149:0/1589834541 >> v2:172.21.15.184:3300/0 conn(0x7f15bc06c8f0 0x7f15bc06d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 -- 172.21.15.149:0/1589834541 >> v1:172.21.15.184:6789/0 conn(0x7f15bc06cd90 legacy=0x7f15bc0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 -- 172.21.15.149:0/1589834541 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0ca920 con 0x7f15bc158fc0 2023-06-09T04:38:12.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15bbfff700 1 --2- 172.21.15.149:0/1589834541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc158fc0 0x7f15bc069db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f15bc070780 tx=0x7f15b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a7f32d8bfdee02 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15baffd700 1 -- 172.21.15.149:0/1589834541 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0004230 con 0x7f15bc158fc0 2023-06-09T04:38:12.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15baffd700 1 -- 172.21.15.149:0/1589834541 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0004390 con 0x7f15bc158fc0 2023-06-09T04:38:12.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.094+0000 7f15baffd700 1 -- 172.21.15.149:0/1589834541 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b00036a0 con 0x7f15bc158fc0 2023-06-09T04:38:12.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 -- 172.21.15.149:0/1589834541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc158fc0 msgr2=0x7f15bc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 --2- 172.21.15.149:0/1589834541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc158fc0 0x7f15bc069db0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f15bc070780 tx=0x7f15b0009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 -- 172.21.15.149:0/1589834541 shutdown_connections 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 --2- 172.21.15.149:0/1589834541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc158fc0 0x7f15bc069db0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 --2- 172.21.15.149:0/1589834541 >> v2:172.21.15.184:3300/0 conn(0x7f15bc06c8f0 0x7f15bc06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 -- 172.21.15.149:0/1589834541 >> 172.21.15.149:0/1589834541 conn(0x7f15bc0ceed0 msgr2=0x7f15bc0cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 -- 172.21.15.149:0/1589834541 shutdown_connections 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.095+0000 7f15c232c700 1 -- 172.21.15.149:0/1589834541 wait complete. 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.097+0000 7f15c232c700 1 Processor -- start 2023-06-09T04:38:12.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.097+0000 7f15c232c700 1 -- start start 2023-06-09T04:38:12.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc06c8f0 0x7f15bc0af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15bc06cd90 0x7f15bc15b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15bc158fc0 0x7f15bc15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc154540 con 0x7f15bc06c8f0 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc15c3c0 con 0x7f15bc06cd90 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc1e32e0 con 0x7f15bc158fc0 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc06c8f0 0x7f15bc0af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc06c8f0 0x7f15bc0af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38400/0 (socket says 172.21.15.149:38400) 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 -- 172.21.15.149:0/692094903 learned_addr learned my addr 172.21.15.149:0/692094903 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:12.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bb7fe700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15bc06cd90 0x7f15bc15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c08c9700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15bc158fc0 0x7f15bc15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 -- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15bc158fc0 msgr2=0x7f15bc15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15bc158fc0 0x7f15bc15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 -- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15bc06cd90 msgr2=0x7f15bc15b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15bc06cd90 0x7f15bc15b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 -- 172.21.15.149:0/692094903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b0009550 con 0x7f15bc06c8f0 2023-06-09T04:38:12.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15bbfff700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc06c8f0 0x7f15bc0af7d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0cfa00 tx=0x7f15b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15b8ff9700 1 -- 172.21.15.149:0/692094903 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0003d80 con 0x7f15bc06c8f0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15b8ff9700 1 -- 172.21.15.149:0/692094903 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b001f070 con 0x7f15bc06c8f0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc1e29b0 con 0x7f15bc06c8f0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15b8ff9700 1 -- 172.21.15.149:0/692094903 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0011870 con 0x7f15bc06c8f0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.098+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc1e2f70 con 0x7f15bc06c8f0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.099+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc073fa0 con 0x7f15bc06c8f0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.100+0000 7f15b8ff9700 1 -- 172.21.15.149:0/692094903 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15b0021030 con 0x7f15bc06c8f0 2023-06-09T04:38:12.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.100+0000 7f15b8ff9700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f15a806ace0 0x7f15a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.100+0000 7f15b8ff9700 1 -- 172.21.15.149:0/692094903 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f15b008a790 con 0x7f15bc06c8f0 2023-06-09T04:38:12.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.100+0000 7f15bb7fe700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f15a806ace0 0x7f15a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.101+0000 7f15bb7fe700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f15a806ace0 0x7f15a806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15ac006fd0 tx=0x7f15ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.105 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.105+0000 7f15b8ff9700 1 -- 172.21.15.149:0/692094903 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15b0055a40 con 0x7f15bc06c8f0 2023-06-09T04:38:12.296 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.295+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f15bc159390 con 0x7f15bc06c8f0 2023-06-09T04:38:12.297 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.296+0000 7f15b8ff9700 1 -- 172.21.15.149:0/692094903 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7f15bc159390 con 0x7f15bc06c8f0 2023-06-09T04:38:12.297 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:12.297 INFO:teuthology.orchestra.run.smithi149.stdout:[ 2023-06-09T04:38:12.297 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:12.297 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 1, 2023-06-09T04:38:12.298 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": "rbd" 2023-06-09T04:38:12.298 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2023-06-09T04:38:12.298 INFO:teuthology.orchestra.run.smithi149.stdout: { 2023-06-09T04:38:12.298 INFO:teuthology.orchestra.run.smithi149.stdout: "poolnum": 2, 2023-06-09T04:38:12.298 INFO:teuthology.orchestra.run.smithi149.stdout: "poolname": ".mgr" 2023-06-09T04:38:12.298 INFO:teuthology.orchestra.run.smithi149.stdout: } 2023-06-09T04:38:12.298 INFO:teuthology.orchestra.run.smithi149.stdout:] 2023-06-09T04:38:12.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f15a806ace0 msgr2=0x7f15a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f15a806ace0 0x7f15a806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15ac006fd0 tx=0x7f15ac008040 comp rx=0 tx=0).stop 2023-06-09T04:38:12.299 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc06c8f0 msgr2=0x7f15bc0af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc06c8f0 0x7f15bc0af7d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0cfa00 tx=0x7f15b0004750 comp rx=0 tx=0).stop 2023-06-09T04:38:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 shutdown_connections 2023-06-09T04:38:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f15a806ace0 0x7f15a806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f15bc158fc0 0x7f15bc15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15bc06c8f0 0x7f15bc0af7d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 --2- 172.21.15.149:0/692094903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f15bc06cd90 0x7f15bc15b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.300 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 >> 172.21.15.149:0/692094903 conn(0x7f15bc0ceed0 msgr2=0x7f15bc1585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 shutdown_connections 2023-06-09T04:38:12.301 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.298+0000 7f15c232c700 1 -- 172.21.15.149:0/692094903 wait complete. 2023-06-09T04:38:12.311 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:38:12.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:38:12.435 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.434+0000 7f85c7c4b700 1 Processor -- start 2023-06-09T04:38:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.434+0000 7f85c7c4b700 1 -- start start 2023-06-09T04:38:12.436 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.435+0000 7f85c7c4b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f85c006a4c0 0x7f85c00ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.435+0000 7f85c7c4b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00ac380 con 0x7f85c00cc180 2023-06-09T04:38:12.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.435+0000 7f85c7c4b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00acc20 con 0x7f85c015c660 2023-06-09T04:38:12.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.435+0000 7f85c7c4b700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00c9dc0 con 0x7f85c006a4c0 2023-06-09T04:38:12.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.435+0000 7f85c61e8700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f85c00cc180 0x7f85c00ad0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34044/0 (socket says 172.21.15.149:34044) 2023-06-09T04:38:12.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.435+0000 7f85c61e8700 1 -- 172.21.15.149:0/585111966 learned_addr learned my addr 172.21.15.149:0/585111966 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:12.437 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c51e6700 1 --2- 172.21.15.149:0/585111966 >> v2:172.21.15.184:3300/0 conn(0x7f85c006a4c0 0x7f85c00ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685839951 0 0) 0x7f85c00ac380 con 0x7f85c00cc180 2023-06-09T04:38:12.438 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85ac0035b0 con 0x7f85c00cc180 2023-06-09T04:38:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472092858 0 0) 0x7f85ac0035b0 con 0x7f85c00cc180 2023-06-09T04:38:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 >> v2:172.21.15.184:3300/0 conn(0x7f85c006a4c0 msgr2=0x7f85c00ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 --2- 172.21.15.149:0/585111966 >> v2:172.21.15.184:3300/0 conn(0x7f85c006a4c0 0x7f85c00ae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 >> v1:172.21.15.184:6789/0 conn(0x7f85c015c660 legacy=0x7f85c0069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.440 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00aecb0 con 0x7f85c00cc180 2023-06-09T04:38:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f85b80019f0 con 0x7f85c00cc180 2023-06-09T04:38:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 >> v1:172.21.15.149:6789/0 conn(0x7f85c00cc180 legacy=0x7f85c00ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85ac004850 0x7f85ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85ac005200 0x7f85ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c9dc0 con 0x7f85ac003a00 2023-06-09T04:38:12.441 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac00c110 con 0x7f85ac004850 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac00c2d0 con 0x7f85ac005200 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c59e7700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c51e6700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85ac004850 0x7f85ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c61e8700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85ac005200 0x7f85ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c59e7700 1 -- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85ac005200 msgr2=0x7f85ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c59e7700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85ac005200 0x7f85ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c59e7700 1 -- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85ac004850 msgr2=0x7f85ac004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:12.442 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c59e7700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85ac004850 0x7f85ac004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c59e7700 1 -- 172.21.15.149:0/585111966 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0035b0 con 0x7f85ac003a00 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c61e8700 1 -- 172.21.15.149:0/585111966 reap_dead start 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.436+0000 7f85c59e7700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85ac003e10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f85bc001820 tx=0x7f85ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a151eee590b8e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0012e0 con 0x7f85ac003a00 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc0052d0 con 0x7f85ac003a00 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c49e5700 1 -- 172.21.15.149:0/585111966 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0036d0 con 0x7f85ac003a00 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c7c4b700 1 -- 172.21.15.149:0/585111966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 msgr2=0x7f85ac003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.443 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85ac003e10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f85bc001820 tx=0x7f85ac005880 comp rx=0 tx=0).stop 2023-06-09T04:38:12.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c7c4b700 1 -- 172.21.15.149:0/585111966 shutdown_connections 2023-06-09T04:38:12.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/585111966 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85ac003e10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c7c4b700 1 -- 172.21.15.149:0/585111966 >> 172.21.15.149:0/585111966 conn(0x7f85c0098b20 msgr2=0x7f85c006b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c7c4b700 1 -- 172.21.15.149:0/585111966 shutdown_connections 2023-06-09T04:38:12.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.437+0000 7f85c7c4b700 1 -- 172.21.15.149:0/585111966 wait complete. 2023-06-09T04:38:12.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 Processor -- start 2023-06-09T04:38:12.444 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 -- start start 2023-06-09T04:38:12.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85c00c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c00c6840 0x7f85c015e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c01f2ae0 0x7f85c00b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c6cd0 con 0x7f85ac003a00 2023-06-09T04:38:12.446 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c6fb0 con 0x7f85c01f2ae0 2023-06-09T04:38:12.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c7c4b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c00c7290 con 0x7f85c00c6840 2023-06-09T04:38:12.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c59e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85c00c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c59e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85c00c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38420/0 (socket says 172.21.15.149:38420) 2023-06-09T04:38:12.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.439+0000 7f85c59e7700 1 -- 172.21.15.149:0/1694689795 learned_addr learned my addr 172.21.15.149:0/1694689795 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:12.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c59e7700 1 -- 172.21.15.149:0/1694689795 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c00c6840 msgr2=0x7f85c015e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c59e7700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c00c6840 0x7f85c015e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.447 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c59e7700 1 -- 172.21.15.149:0/1694689795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c01f2ae0 msgr2=0x7f85c00b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c59e7700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c01f2ae0 0x7f85c00b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c59e7700 1 -- 172.21.15.149:0/1694689795 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00c7570 con 0x7f85ac003a00 2023-06-09T04:38:12.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c59e7700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85c00c89a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f85bc000c00 tx=0x7f85bc001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85b67fc700 1 -- 172.21.15.149:0/1694689795 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc001280 con 0x7f85ac003a00 2023-06-09T04:38:12.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85b67fc700 1 -- 172.21.15.149:0/1694689795 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc007040 con 0x7f85ac003a00 2023-06-09T04:38:12.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c00c8ee0 con 0x7f85ac003a00 2023-06-09T04:38:12.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85b67fc700 1 -- 172.21.15.149:0/1694689795 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0073b0 con 0x7f85ac003a00 2023-06-09T04:38:12.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.440+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c015eca0 con 0x7f85ac003a00 2023-06-09T04:38:12.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.441+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c01f1b00 con 0x7f85ac003a00 2023-06-09T04:38:12.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.441+0000 7f85b67fc700 1 -- 172.21.15.149:0/1694689795 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85bc007510 con 0x7f85ac003a00 2023-06-09T04:38:12.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.442+0000 7f85b67fc700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f85a406ace0 0x7f85a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.442+0000 7f85b67fc700 1 -- 172.21.15.149:0/1694689795 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f85bc089da0 con 0x7f85ac003a00 2023-06-09T04:38:12.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.442+0000 7f85c51e6700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f85a406ace0 0x7f85a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.449 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.442+0000 7f85c51e6700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f85a406ace0 0x7f85a406d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85b0006f10 tx=0x7f85b0006e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.450 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.446+0000 7f85b67fc700 1 -- 172.21.15.149:0/1694689795 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85bc055050 con 0x7f85ac003a00 2023-06-09T04:38:12.635 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.633+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f85c004e090 con 0x7f85ac003a00 2023-06-09T04:38:12.797 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.796+0000 7f85b67fc700 1 -- 172.21.15.149:0/1694689795 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f85bc058670 con 0x7f85ac003a00 2023-06-09T04:38:12.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f85a406ace0 msgr2=0x7f85a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f85a406ace0 0x7f85a406d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85b0006f10 tx=0x7f85b0006e80 comp rx=0 tx=0).stop 2023-06-09T04:38:12.801 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 msgr2=0x7f85c00c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85c00c89a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f85bc000c00 tx=0x7f85bc001170 comp rx=0 tx=0).stop 2023-06-09T04:38:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 shutdown_connections 2023-06-09T04:38:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f85a406ace0 0x7f85a406d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85c01f2ae0 0x7f85c00b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85ac003a00 0x7f85c00c89a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 --2- 172.21.15.149:0/1694689795 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f85c00c6840 0x7f85c015e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.802 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 >> 172.21.15.149:0/1694689795 conn(0x7f85c0098b20 msgr2=0x7f85c0069db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 shutdown_connections 2023-06-09T04:38:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.800+0000 7f85c7c4b700 1 -- 172.21.15.149:0/1694689795 wait complete. 2023-06-09T04:38:12.803 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_metadata' created 2023-06-09T04:38:12.814 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:38:12.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.941+0000 7f1f14529700 1 Processor -- start 2023-06-09T04:38:12.942 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.941+0000 7f1f14529700 1 -- start start 2023-06-09T04:38:12.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f14529700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1f0c071770 0x7f1f0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f14529700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0c071290 con 0x7f1f0c15c320 2023-06-09T04:38:12.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f14529700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0c0b2050 con 0x7f1f0c15c6f0 2023-06-09T04:38:12.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f14529700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0c0cd2c0 con 0x7f1f0c071770 2023-06-09T04:38:12.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f11ac4700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f1f0c071770 0x7f1f0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.943 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f122c5700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f1f0c15c320 0x7f1f0c0cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34060/0 (socket says 172.21.15.149:34060) 2023-06-09T04:38:12.944 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f122c5700 1 -- 172.21.15.149:0/3686142565 learned_addr learned my addr 172.21.15.149:0/3686142565 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:12.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f11ac4700 1 -- 172.21.15.149:0/3686142565 >> v1:172.21.15.184:6789/0 conn(0x7f1f0c15c6f0 legacy=0x7f1f0c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f11ac4700 1 -- 172.21.15.149:0/3686142565 >> v1:172.21.15.149:6789/0 conn(0x7f1f0c15c320 legacy=0x7f1f0c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f112c3700 1 -- 172.21.15.149:0/3686142565 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046392964 0 0) 0x7f1f0c071290 con 0x7f1f0c15c320 2023-06-09T04:38:12.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f11ac4700 1 -- 172.21.15.149:0/3686142565 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c0cd5a0 con 0x7f1f0c071770 2023-06-09T04:38:12.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f11ac4700 1 --2- 172.21.15.149:0/3686142565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009840 tx=0x7f1efc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee4a9b1b0f1f474 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.945 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.942+0000 7f1f112c3700 1 -- 172.21.15.149:0/3686142565 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011830 con 0x7f1f0c071770 2023-06-09T04:38:12.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f112c3700 1 -- 172.21.15.149:0/3686142565 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc011990 con 0x7f1f0c071770 2023-06-09T04:38:12.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f112c3700 1 -- 172.21.15.149:0/3686142565 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011d20 con 0x7f1f0c071770 2023-06-09T04:38:12.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f14529700 1 -- 172.21.15.149:0/3686142565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 msgr2=0x7f1f0c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f14529700 1 --2- 172.21.15.149:0/3686142565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c069db0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009840 tx=0x7f1efc009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:12.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f14529700 1 -- 172.21.15.149:0/3686142565 shutdown_connections 2023-06-09T04:38:12.946 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f14529700 1 --2- 172.21.15.149:0/3686142565 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c069db0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f14529700 1 -- 172.21.15.149:0/3686142565 >> 172.21.15.149:0/3686142565 conn(0x7f1f0c06aec0 msgr2=0x7f1f0c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:12.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f14529700 1 -- 172.21.15.149:0/3686142565 shutdown_connections 2023-06-09T04:38:12.947 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.943+0000 7f1f14529700 1 -- 172.21.15.149:0/3686142565 wait complete. 2023-06-09T04:38:12.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.944+0000 7f1f14529700 1 Processor -- start 2023-06-09T04:38:12.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.944+0000 7f1f14529700 1 -- start start 2023-06-09T04:38:12.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f14529700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f14529700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f0c15c320 0x7f1f0c1535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f14529700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f0c15c6f0 0x7f1f0c0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.949 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f14529700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c1575f0 con 0x7f1f0c071770 2023-06-09T04:38:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f14529700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c1578d0 con 0x7f1f0c15c320 2023-06-09T04:38:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f14529700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c157bb0 con 0x7f1f0c15c6f0 2023-06-09T04:38:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f122c5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f122c5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38434/0 (socket says 172.21.15.149:38434) 2023-06-09T04:38:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f122c5700 1 -- 172.21.15.149:0/942334369 learned_addr learned my addr 172.21.15.149:0/942334369 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f11ac4700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f0c15c320 0x7f1f0c1535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.950 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.945+0000 7f1f12ac6700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f0c15c6f0 0x7f1f0c0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f122c5700 1 -- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f0c15c6f0 msgr2=0x7f1f0c0ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f122c5700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f0c15c6f0 0x7f1f0c0ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f122c5700 1 -- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f0c15c320 msgr2=0x7f1f0c1535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f122c5700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f0c15c320 0x7f1f0c1535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f122c5700 1 -- 172.21.15.149:0/942334369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0094a0 con 0x7f1f0c071770 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f12ac6700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f0c15c6f0 0x7f1f0c0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f122c5700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c152db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c520 tx=0x7f1f0800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.951 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f02ffd700 1 -- 172.21.15.149:0/942334369 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08004c80 con 0x7f1f0c071770 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f02ffd700 1 -- 172.21.15.149:0/942334369 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08004de0 con 0x7f1f0c071770 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f02ffd700 1 -- 172.21.15.149:0/942334369 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08007310 con 0x7f1f0c071770 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0c0ac770 con 0x7f1f0c071770 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.946+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0c0acc90 con 0x7f1f0c071770 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.947+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0c073fa0 con 0x7f1f0c071770 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.947+0000 7f1f02ffd700 1 -- 172.21.15.149:0/942334369 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f08007470 con 0x7f1f0c071770 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.948+0000 7f1f02ffd700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1ef006ace0 0x7f1ef006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:12.952 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.948+0000 7f1f02ffd700 1 -- 172.21.15.149:0/942334369 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f1f08089070 con 0x7f1f0c071770 2023-06-09T04:38:12.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.948+0000 7f1f11ac4700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1ef006ace0 0x7f1ef006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:12.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.948+0000 7f1f11ac4700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1ef006ace0 0x7f1ef006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c071b60 tx=0x7f1efc01c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:12.953 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:12.952+0000 7f1f02ffd700 1 -- 172.21.15.149:0/942334369 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f080541c0 con 0x7f1f0c071770 2023-06-09T04:38:13.141 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.140+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1f0c157d70 con 0x7f1f0c071770 2023-06-09T04:38:13.805 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.804+0000 7f1f02ffd700 1 -- 172.21.15.149:0/942334369 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1f080577e0 con 0x7f1f0c071770 2023-06-09T04:38:13.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.808+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1ef006ace0 msgr2=0x7f1ef006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.808+0000 7f1f14529700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1ef006ace0 0x7f1ef006d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c071b60 tx=0x7f1efc01c040 comp rx=0 tx=0).stop 2023-06-09T04:38:13.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.808+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 msgr2=0x7f1f0c152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.810 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.808+0000 7f1f14529700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c152db0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c520 tx=0x7f1f0800c830 comp rx=0 tx=0).stop 2023-06-09T04:38:13.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.810+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 shutdown_connections 2023-06-09T04:38:13.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.810+0000 7f1f14529700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f1ef006ace0 0x7f1ef006d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.810+0000 7f1f14529700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1f0c15c6f0 0x7f1f0c0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.810+0000 7f1f14529700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1f0c071770 0x7f1f0c152db0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.810+0000 7f1f14529700 1 --2- 172.21.15.149:0/942334369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f0c15c320 0x7f1f0c1535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.812 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.810+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 >> 172.21.15.149:0/942334369 conn(0x7f1f0c06aec0 msgr2=0x7f1f0c0cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:13.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.811+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 shutdown_connections 2023-06-09T04:38:13.813 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.811+0000 7f1f14529700 1 -- 172.21.15.149:0/942334369 wait complete. 2023-06-09T04:38:13.816 INFO:teuthology.orchestra.run.smithi149.stderr:pool 'cephfs_data' created 2023-06-09T04:38:13.832 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:38:13.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.955+0000 7f95a3eb6700 1 Processor -- start 2023-06-09T04:38:13.956 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.955+0000 7f95a3eb6700 1 -- start start 2023-06-09T04:38:13.957 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a3eb6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f959c0cc750 0x7f959c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a3eb6700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f959c0aea80 0x7f959c0cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a3eb6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c15d900 con 0x7f959c159070 2023-06-09T04:38:13.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a3eb6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0723d0 con 0x7f959c0cc750 2023-06-09T04:38:13.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a3eb6700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c071480 con 0x7f959c0aea80 2023-06-09T04:38:13.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f959c0cc750 0x7f959c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f959c0cc750 0x7f959c071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38444/0 (socket says 172.21.15.149:38444) 2023-06-09T04:38:13.958 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 -- 172.21.15.149:0/3054695843 learned_addr learned my addr 172.21.15.149:0/3054695843 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a2453700 1 --2- 172.21.15.149:0/3054695843 >> v2:172.21.15.184:3300/0 conn(0x7f959c0aea80 0x7f959c0cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 -- 172.21.15.149:0/3054695843 >> v2:172.21.15.184:3300/0 conn(0x7f959c0aea80 msgr2=0x7f959c0cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 --2- 172.21.15.149:0/3054695843 >> v2:172.21.15.184:3300/0 conn(0x7f959c0aea80 0x7f959c0cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 -- 172.21.15.149:0/3054695843 >> v1:172.21.15.184:6789/0 conn(0x7f959c159070 legacy=0x7f959c0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 -- 172.21.15.149:0/3054695843 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c071760 con 0x7f959c0cc750 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a1451700 1 --2- 172.21.15.149:0/3054695843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c0cc750 0x7f959c071be0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f959c15cb50 tx=0x7f958c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660f24613fffd7f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.956+0000 7f95a0c50700 1 -- 172.21.15.149:0/3054695843 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c004230 con 0x7f959c0cc750 2023-06-09T04:38:13.959 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a0c50700 1 -- 172.21.15.149:0/3054695843 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c004390 con 0x7f959c0cc750 2023-06-09T04:38:13.960 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a0c50700 1 -- 172.21.15.149:0/3054695843 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0036a0 con 0x7f959c0cc750 2023-06-09T04:38:13.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 -- 172.21.15.149:0/3054695843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c0cc750 msgr2=0x7f959c071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/3054695843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c0cc750 0x7f959c071be0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f959c15cb50 tx=0x7f958c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 -- 172.21.15.149:0/3054695843 shutdown_connections 2023-06-09T04:38:13.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/3054695843 >> v2:172.21.15.184:3300/0 conn(0x7f959c0aea80 0x7f959c0cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/3054695843 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c0cc750 0x7f959c071be0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.962 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 -- 172.21.15.149:0/3054695843 >> 172.21.15.149:0/3054695843 conn(0x7f959c06d0f0 msgr2=0x7f959c06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:13.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 -- 172.21.15.149:0/3054695843 shutdown_connections 2023-06-09T04:38:13.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.957+0000 7f95a3eb6700 1 -- 172.21.15.149:0/3054695843 wait complete. 2023-06-09T04:38:13.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.959+0000 7f95a3eb6700 1 Processor -- start 2023-06-09T04:38:13.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.959+0000 7f95a3eb6700 1 -- start start 2023-06-09T04:38:13.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0aea80 0x7f959c0c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0cc750 0x7f959c15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.963 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c159070 0x7f959c153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c15b0f0 con 0x7f959c159070 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c1595c0 con 0x7f959c0cc750 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c15b320 con 0x7f959c0aea80 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c159070 0x7f959c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c159070 0x7f959c153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38452/0 (socket says 172.21.15.149:38452) 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 -- 172.21.15.149:0/2939059824 learned_addr learned my addr 172.21.15.149:0/2939059824 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a1c52700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0aea80 0x7f959c0c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.964 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a1451700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0cc750 0x7f959c15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 -- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0aea80 msgr2=0x7f959c0c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0aea80 0x7f959c0c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 -- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0cc750 msgr2=0x7f959c15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:13.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0cc750 0x7f959c15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:13.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 -- 172.21.15.149:0/2939059824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c009550 con 0x7f959c159070 2023-06-09T04:38:13.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a1451700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0cc750 0x7f959c15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:13.965 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a1c52700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0aea80 0x7f959c0c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:13.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a2453700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c159070 0x7f959c153980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9594007e40 tx=0x7f959400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:13.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95927fc700 1 -- 172.21.15.149:0/2939059824 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959400eea0 con 0x7f959c159070 2023-06-09T04:38:13.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95927fc700 1 -- 172.21.15.149:0/2939059824 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9594014420 con 0x7f959c159070 2023-06-09T04:38:13.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c15b600 con 0x7f959c159070 2023-06-09T04:38:13.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95927fc700 1 -- 172.21.15.149:0/2939059824 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940147b0 con 0x7f959c159070 2023-06-09T04:38:13.966 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.960+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c159b60 con 0x7f959c159070 2023-06-09T04:38:13.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.961+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c073fa0 con 0x7f959c159070 2023-06-09T04:38:13.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.962+0000 7f95927fc700 1 -- 172.21.15.149:0/2939059824 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9594014910 con 0x7f959c159070 2023-06-09T04:38:13.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.962+0000 7f95927fc700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f958006ace0 0x7f958006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:13.967 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.962+0000 7f95927fc700 1 -- 172.21.15.149:0/2939059824 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f9594089d10 con 0x7f959c159070 2023-06-09T04:38:13.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.962+0000 7f95a1c52700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f958006ace0 0x7f958006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:13.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.963+0000 7f95a1c52700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f958006ace0 0x7f958006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95980017b0 tx=0x7f9598009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:13.968 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:13.967+0000 7f95927fc700 1 -- 172.21.15.149:0/2939059824 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9594054d70 con 0x7f959c159070 2023-06-09T04:38:14.197 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.196+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f959c0b55e0 con 0x7f959c159070 2023-06-09T04:38:14.201 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.200+0000 7f95927fc700 1 -- 172.21.15.149:0/2939059824 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9594058390 con 0x7f959c159070 2023-06-09T04:38:14.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f958006ace0 msgr2=0x7f958006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f958006ace0 0x7f958006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f95980017b0 tx=0x7f9598009040 comp rx=0 tx=0).stop 2023-06-09T04:38:14.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c159070 msgr2=0x7f959c153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c159070 0x7f959c153980 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9594007e40 tx=0x7f959400e3c0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 shutdown_connections 2023-06-09T04:38:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f958006ace0 0x7f958006d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f959c0aea80 0x7f959c0c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f959c159070 0x7f959c153980 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 --2- 172.21.15.149:0/2939059824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f959c0cc750 0x7f959c15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.207 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.205+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 >> 172.21.15.149:0/2939059824 conn(0x7f959c06d0f0 msgr2=0x7f959c0b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.206+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 shutdown_connections 2023-06-09T04:38:14.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.209+0000 7f95a3eb6700 1 -- 172.21.15.149:0/2939059824 wait complete. 2023-06-09T04:38:14.214 INFO:teuthology.orchestra.run.smithi149.stderr:new fs with metadata pool 6 and data pool 7 2023-06-09T04:38:14.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.354+0000 7f71f6fd9700 1 Processor -- start 2023-06-09T04:38:14.355 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.354+0000 7f71f6fd9700 1 -- start start 2023-06-09T04:38:14.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.354+0000 7f71f6fd9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f71f00cd680 0x7f71f00b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71f6fd9700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f00cdc60 con 0x7f71f015c0b0 2023-06-09T04:38:14.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71f6fd9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f00cb4a0 con 0x7f71f015fcb0 2023-06-09T04:38:14.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71f6fd9700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f00b2f60 con 0x7f71f00cd680 2023-06-09T04:38:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71effff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f71f00cd680 0x7f71f00b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71f4d75700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f71f015c0b0 0x7f71f00cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34088/0 (socket says 172.21.15.149:34088) 2023-06-09T04:38:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71f4d75700 1 -- 172.21.15.149:0/2341884813 learned_addr learned my addr 172.21.15.149:0/2341884813 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71effff700 1 -- 172.21.15.149:0/2341884813 >> v1:172.21.15.184:6789/0 conn(0x7f71f015fcb0 legacy=0x7f71f01600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71effff700 1 -- 172.21.15.149:0/2341884813 >> v1:172.21.15.149:6789/0 conn(0x7f71f015c0b0 legacy=0x7f71f00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71effff700 1 -- 172.21.15.149:0/2341884813 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00cfdf0 con 0x7f71f00cd680 2023-06-09T04:38:14.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71ef7fe700 1 -- 172.21.15.149:0/2341884813 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145553326 0 0) 0x7f71f00cdc60 con 0x7f71f015c0b0 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71effff700 1 --2- 172.21.15.149:0/2341884813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f00cd680 0x7f71f00b2a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009840 tx=0x7f71dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2edd7a56e41fa2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71ef7fe700 1 -- 172.21.15.149:0/2341884813 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc011830 con 0x7f71f00cd680 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71ef7fe700 1 -- 172.21.15.149:0/2341884813 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc011990 con 0x7f71f00cd680 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.355+0000 7f71ef7fe700 1 -- 172.21.15.149:0/2341884813 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc011d20 con 0x7f71f00cd680 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.356+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2341884813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f00cd680 msgr2=0x7f71f00b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.356+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2341884813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f00cd680 0x7f71f00b2a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009840 tx=0x7f71dc009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.356+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2341884813 shutdown_connections 2023-06-09T04:38:14.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.356+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2341884813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f00cd680 0x7f71f00b2a20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.356+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2341884813 >> 172.21.15.149:0/2341884813 conn(0x7f71f0069db0 msgr2=0x7f71f006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.356+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2341884813 shutdown_connections 2023-06-09T04:38:14.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.356+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2341884813 wait complete. 2023-06-09T04:38:14.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.357+0000 7f71f6fd9700 1 Processor -- start 2023-06-09T04:38:14.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.357+0000 7f71f6fd9700 1 -- start start 2023-06-09T04:38:14.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f6fd9700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71f00cd680 0x7f71f0153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f6fd9700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f015c0b0 0x7f71f00b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f6fd9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f015fcb0 0x7f71f00b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f6fd9700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00b06e0 con 0x7f71f015fcb0 2023-06-09T04:38:14.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f6fd9700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00b1220 con 0x7f71f015c0b0 2023-06-09T04:38:14.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f6fd9700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00b0980 con 0x7f71f00cd680 2023-06-09T04:38:14.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f015fcb0 0x7f71f00b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f015fcb0 0x7f71f00b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38466/0 (socket says 172.21.15.149:38466) 2023-06-09T04:38:14.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 -- 172.21.15.149:0/2349325736 learned_addr learned my addr 172.21.15.149:0/2349325736 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71effff700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f015c0b0 0x7f71f00b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f4d75700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71f00cd680 0x7f71f0153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 -- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71f00cd680 msgr2=0x7f71f0153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71f00cd680 0x7f71f0153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 -- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f015c0b0 msgr2=0x7f71f00b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f015c0b0 0x7f71f00b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f5576700 1 -- 172.21.15.149:0/2349325736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc0094a0 con 0x7f71f015fcb0 2023-06-09T04:38:14.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71f4d75700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71f00cd680 0x7f71f0153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.358+0000 7f71effff700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f015c0b0 0x7f71f00b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.359+0000 7f71f5576700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f015fcb0 0x7f71f00b01a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f71e800cba0 tx=0x7f71e800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.359+0000 7f71ed7fa700 1 -- 172.21.15.149:0/2349325736 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8003c00 con 0x7f71f015fcb0 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.359+0000 7f71ed7fa700 1 -- 172.21.15.149:0/2349325736 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8003d60 con 0x7f71f015fcb0 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.359+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f00b0c60 con 0x7f71f015fcb0 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.359+0000 7f71ed7fa700 1 -- 172.21.15.149:0/2349325736 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e800aba0 con 0x7f71f015fcb0 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.359+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f00c8d50 con 0x7f71f015fcb0 2023-06-09T04:38:14.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.360+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f00cf270 con 0x7f71f015fcb0 2023-06-09T04:38:14.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.360+0000 7f71ed7fa700 1 -- 172.21.15.149:0/2349325736 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71e800ad00 con 0x7f71f015fcb0 2023-06-09T04:38:14.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.361+0000 7f71ed7fa700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f71d406ace0 0x7f71d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.361+0000 7f71ed7fa700 1 -- 172.21.15.149:0/2349325736 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f71e8089620 con 0x7f71f015fcb0 2023-06-09T04:38:14.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.361+0000 7f71f4d75700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f71d406ace0 0x7f71d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.361+0000 7f71f4d75700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f71d406ace0 0x7f71d406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71e4000f60 tx=0x7f71e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.365+0000 7f71ed7fa700 1 -- 172.21.15.149:0/2349325736 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71e8054620 con 0x7f71f015fcb0 2023-06-09T04:38:14.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.555+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71f0073fa0 con 0x7f71f015fcb0 2023-06-09T04:38:14.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.556+0000 7f71ed7fa700 1 -- 172.21.15.149:0/2349325736 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18467 (secure 0 0 0) 0x7f71e8057c40 con 0x7f71f015fcb0 2023-06-09T04:38:14.558 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:14.558 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":40,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:38:14.197680+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:12.652912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:13.159242+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f71d406ace0 msgr2=0x7f71d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f71d406ace0 0x7f71d406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71e4000f60 tx=0x7f71e4009040 comp rx=0 tx=0).stop 2023-06-09T04:38:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f015fcb0 msgr2=0x7f71f00b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.560 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f015fcb0 0x7f71f00b01a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f71e800cba0 tx=0x7f71e800cf60 comp rx=0 tx=0).stop 2023-06-09T04:38:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 shutdown_connections 2023-06-09T04:38:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f71d406ace0 0x7f71d406d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f71f00cd680 0x7f71f0153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f71f015fcb0 0x7f71f00b01a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 --2- 172.21.15.149:0/2349325736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f71f015c0b0 0x7f71f00b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 >> 172.21.15.149:0/2349325736 conn(0x7f71f0069db0 msgr2=0x7f71f015c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 shutdown_connections 2023-06-09T04:38:14.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.559+0000 7f71f6fd9700 1 -- 172.21.15.149:0/2349325736 wait complete. 2023-06-09T04:38:14.572 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:14.693 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.692+0000 7fe30fc2d700 1 Processor -- start 2023-06-09T04:38:14.694 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.692+0000 7fe30fc2d700 1 -- start start 2023-06-09T04:38:14.695 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30fc2d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 0x7fe3080af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30fc2d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe3080ccba0 0x7fe3080b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30fc2d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3080af050 con 0x7fe30815c590 2023-06-09T04:38:14.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30fc2d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3080afae0 con 0x7fe3080ccba0 2023-06-09T04:38:14.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30fc2d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080af800 con 0x7fe30806a4c0 2023-06-09T04:38:14.696 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30e1ca700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fe3080ccba0 0x7fe3080b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30d9c9700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fe30815c590 0x7fe308069db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34102/0 (socket says 172.21.15.149:34102) 2023-06-09T04:38:14.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30d9c9700 1 -- 172.21.15.149:0/4093560721 learned_addr learned my addr 172.21.15.149:0/4093560721 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:14.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30d1c8700 1 --2- 172.21.15.149:0/4093560721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 0x7fe3080af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.693+0000 7fe30e1ca700 1 -- 172.21.15.149:0/4093560721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 msgr2=0x7fe3080af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:14.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30e1ca700 1 --2- 172.21.15.149:0/4093560721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 0x7fe3080af220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30e1ca700 1 -- 172.21.15.149:0/4093560721 >> v1:172.21.15.149:6789/0 conn(0x7fe30815c590 legacy=0x7fe308069db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.697 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30e1ca700 1 -- 172.21.15.149:0/4093560721 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080cc0c0 con 0x7fe3080ccba0 2023-06-09T04:38:14.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30c9c7700 1 -- 172.21.15.149:0/4093560721 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052942594 0 0) 0x7fe3080af050 con 0x7fe30815c590 2023-06-09T04:38:14.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30e1ca700 1 --2- 172.21.15.149:0/4093560721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3080ccba0 0x7fe3080b06d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe300009d90 tx=0x7fe30000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd048867751f337e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30c9c7700 1 -- 172.21.15.149:0/4093560721 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000e070 con 0x7fe3080ccba0 2023-06-09T04:38:14.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30c9c7700 1 -- 172.21.15.149:0/4093560721 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000bbd0 con 0x7fe3080ccba0 2023-06-09T04:38:14.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30c9c7700 1 -- 172.21.15.149:0/4093560721 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300012430 con 0x7fe3080ccba0 2023-06-09T04:38:14.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 -- 172.21.15.149:0/4093560721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3080ccba0 msgr2=0x7fe3080b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.698 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/4093560721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3080ccba0 0x7fe3080b06d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe300009d90 tx=0x7fe30000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:14.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 -- 172.21.15.149:0/4093560721 shutdown_connections 2023-06-09T04:38:14.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/4093560721 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3080ccba0 0x7fe3080b06d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/4093560721 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 0x7fe3080af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 -- 172.21.15.149:0/4093560721 >> 172.21.15.149:0/4093560721 conn(0x7fe30806b7e0 msgr2=0x7fe3080cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 -- 172.21.15.149:0/4093560721 shutdown_connections 2023-06-09T04:38:14.699 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.694+0000 7fe30fc2d700 1 -- 172.21.15.149:0/4093560721 wait complete. 2023-06-09T04:38:14.701 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 Processor -- start 2023-06-09T04:38:14.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 -- start start 2023-06-09T04:38:14.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 0x7fe3081e2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3080ccba0 0x7fe3081f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30815c590 0x7fe3080ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3080b36a0 con 0x7fe30815c590 2023-06-09T04:38:14.702 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081e3110 con 0x7fe3080ccba0 2023-06-09T04:38:14.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30fc2d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3081f1ce0 con 0x7fe30806a4c0 2023-06-09T04:38:14.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.696+0000 7fe30e1ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30815c590 0x7fe3080ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30815c590 0x7fe3080ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38480/0 (socket says 172.21.15.149:38480) 2023-06-09T04:38:14.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 -- 172.21.15.149:0/3159581836 learned_addr learned my addr 172.21.15.149:0/3159581836 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:14.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30d1c8700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3080ccba0 0x7fe3081f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 -- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 msgr2=0x7fe3081e2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.703 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 0x7fe3081e2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 -- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3080ccba0 msgr2=0x7fe3081f17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3080ccba0 0x7fe3081f17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 -- 172.21.15.149:0/3159581836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300009a70 con 0x7fe30815c590 2023-06-09T04:38:14.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30d1c8700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3080ccba0 0x7fe3081f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:14.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30e1ca700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30815c590 0x7fe3080ad320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe30000b370 tx=0x7fe300004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe2fe7fc700 1 -- 172.21.15.149:0/3159581836 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300003ea0 con 0x7fe30815c590 2023-06-09T04:38:14.704 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe2fe7fc700 1 -- 172.21.15.149:0/3159581836 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300020070 con 0x7fe30815c590 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3080b2a90 con 0x7fe30815c590 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe2fe7fc700 1 -- 172.21.15.149:0/3159581836 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300004280 con 0x7fe30815c590 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.697+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3080b3050 con 0x7fe30815c590 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.698+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe308073fa0 con 0x7fe30815c590 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.699+0000 7fe2fe7fc700 1 -- 172.21.15.149:0/3159581836 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3000043e0 con 0x7fe30815c590 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.699+0000 7fe2fe7fc700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe2ec06ace0 0x7fe2ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.699+0000 7fe30d9c9700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe2ec06ace0 0x7fe2ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:14.705 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.699+0000 7fe2fe7fc700 1 -- 172.21.15.149:0/3159581836 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe300022070 con 0x7fe30815c590 2023-06-09T04:38:14.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.699+0000 7fe30d9c9700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe2ec06ace0 0x7fe2ec06d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe304007fd0 tx=0x7fe3040079a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:14.706 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.704+0000 7fe2fe7fc700 1 -- 172.21.15.149:0/3159581836 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3000568a0 con 0x7fe30815c590 2023-06-09T04:38:14.895 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.894+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe308071dc0 con 0x7fe30815c590 2023-06-09T04:38:14.896 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.895+0000 7fe2fe7fc700 1 -- 172.21.15.149:0/3159581836 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18467 (secure 0 0 0) 0x7fe300059ec0 con 0x7fe30815c590 2023-06-09T04:38:14.896 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:14.897 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":40,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:38:14.197680+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:12.652912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:13.159242+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe2ec06ace0 msgr2=0x7fe2ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.898 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe2ec06ace0 0x7fe2ec06d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe304007fd0 tx=0x7fe3040079a0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30815c590 msgr2=0x7fe3080ad320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30815c590 0x7fe3080ad320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe30000b370 tx=0x7fe300004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 shutdown_connections 2023-06-09T04:38:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fe2ec06ace0 0x7fe2ec06d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fe30806a4c0 0x7fe3081e2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe30815c590 0x7fe3080ad320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.899 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 --2- 172.21.15.149:0/3159581836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3080ccba0 0x7fe3081f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:14.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 >> 172.21.15.149:0/3159581836 conn(0x7fe30806b7e0 msgr2=0x7fe3080ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:14.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 shutdown_connections 2023-06-09T04:38:14.900 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:14.897+0000 7fe30fc2d700 1 -- 172.21.15.149:0/3159581836 wait complete. 2023-06-09T04:38:14.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.034+0000 7f2afdafc700 1 Processor -- start 2023-06-09T04:38:15.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.034+0000 7f2afdafc700 1 -- start start 2023-06-09T04:38:15.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.034+0000 7f2afdafc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2af80cad90 0x7f2af815e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.034+0000 7f2afdafc700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af80cda20 con 0x7f2af80cf5b0 2023-06-09T04:38:15.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.034+0000 7f2afdafc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af815a520 con 0x7f2af80b60a0 2023-06-09T04:38:15.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.034+0000 7f2afdafc700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af80b6470 con 0x7f2af80cad90 2023-06-09T04:38:15.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af7fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f2af80cad90 0x7f2af815e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af6ffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f2af80cf5b0 0x7f2af80cfb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34118/0 (socket says 172.21.15.149:34118) 2023-06-09T04:38:15.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af6ffd700 1 -- 172.21.15.149:0/4277962298 learned_addr learned my addr 172.21.15.149:0/4277962298 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:15.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af7fff700 1 -- 172.21.15.149:0/4277962298 >> v1:172.21.15.184:6789/0 conn(0x7f2af80b60a0 legacy=0x7f2af815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af7fff700 1 -- 172.21.15.149:0/4277962298 >> v1:172.21.15.149:6789/0 conn(0x7f2af80cf5b0 legacy=0x7f2af80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af7fff700 1 -- 172.21.15.149:0/4277962298 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af815ea40 con 0x7f2af80cad90 2023-06-09T04:38:15.038 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af67fc700 1 -- 172.21.15.149:0/4277962298 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745240479 0 0) 0x7f2af80cda20 con 0x7f2af80cf5b0 2023-06-09T04:38:15.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af7fff700 1 --2- 172.21.15.149:0/4277962298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cad90 0x7f2af815e340 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009d90 tx=0x7f2af000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f7ad51414ae266 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af67fc700 1 -- 172.21.15.149:0/4277962298 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af000e070 con 0x7f2af80cad90 2023-06-09T04:38:15.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af67fc700 1 -- 172.21.15.149:0/4277962298 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af000bbd0 con 0x7f2af80cad90 2023-06-09T04:38:15.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.035+0000 7f2af67fc700 1 -- 172.21.15.149:0/4277962298 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0012430 con 0x7f2af80cad90 2023-06-09T04:38:15.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.036+0000 7f2afdafc700 1 -- 172.21.15.149:0/4277962298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cad90 msgr2=0x7f2af815e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.036+0000 7f2afdafc700 1 --2- 172.21.15.149:0/4277962298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cad90 0x7f2af815e340 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009d90 tx=0x7f2af000b330 comp rx=0 tx=0).stop 2023-06-09T04:38:15.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.036+0000 7f2afdafc700 1 -- 172.21.15.149:0/4277962298 shutdown_connections 2023-06-09T04:38:15.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.036+0000 7f2afdafc700 1 --2- 172.21.15.149:0/4277962298 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cad90 0x7f2af815e340 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.036+0000 7f2afdafc700 1 -- 172.21.15.149:0/4277962298 >> 172.21.15.149:0/4277962298 conn(0x7f2af8069db0 msgr2=0x7f2af806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:15.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.036+0000 7f2afdafc700 1 -- 172.21.15.149:0/4277962298 shutdown_connections 2023-06-09T04:38:15.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.036+0000 7f2afdafc700 1 -- 172.21.15.149:0/4277962298 wait complete. 2023-06-09T04:38:15.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.037+0000 7f2afdafc700 1 Processor -- start 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.037+0000 7f2afdafc700 1 -- start start 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2afdafc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2af80b60a0 0x7f2af80c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2afdafc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af80cad90 0x7f2af815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2afdafc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cf5b0 0x7f2af80b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2afdafc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af806bd30 con 0x7f2af80cf5b0 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2afdafc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af815c190 con 0x7f2af80cad90 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2afdafc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af80ca3f0 con 0x7f2af80b60a0 2023-06-09T04:38:15.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cf5b0 0x7f2af80b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cf5b0 0x7f2af80b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38494/0 (socket says 172.21.15.149:38494) 2023-06-09T04:38:15.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 -- 172.21.15.149:0/3003117157 learned_addr learned my addr 172.21.15.149:0/3003117157 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:15.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af77fe700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2af80b60a0 0x7f2af80c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af6ffd700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af80cad90 0x7f2af815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 -- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2af80b60a0 msgr2=0x7f2af80c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2af80b60a0 0x7f2af80c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 -- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af80cad90 msgr2=0x7f2af815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af80cad90 0x7f2af815bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af7fff700 1 -- 172.21.15.149:0/3003117157 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0009a70 con 0x7f2af80cf5b0 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.038+0000 7f2af6ffd700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af80cad90 0x7f2af815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.039+0000 7f2af7fff700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cf5b0 0x7f2af80b3c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2af0014040 tx=0x7f2af0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.039+0000 7f2adffff700 1 -- 172.21.15.149:0/3003117157 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0012430 con 0x7f2af80cf5b0 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.039+0000 7f2adffff700 1 -- 172.21.15.149:0/3003117157 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0020070 con 0x7f2af80cf5b0 2023-06-09T04:38:15.045 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.039+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af80ca6d0 con 0x7f2af80cf5b0 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.039+0000 7f2adffff700 1 -- 172.21.15.149:0/3003117157 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0004280 con 0x7f2af80cf5b0 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.039+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af806b950 con 0x7f2af80cf5b0 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.040+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af80cd3b0 con 0x7f2af80cf5b0 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.040+0000 7f2adffff700 1 -- 172.21.15.149:0/3003117157 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2af00043e0 con 0x7f2af80cf5b0 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.041+0000 7f2adffff700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ae406ace0 0x7f2ae406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.041+0000 7f2adffff700 1 -- 172.21.15.149:0/3003117157 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2af0022070 con 0x7f2af80cf5b0 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.041+0000 7f2af77fe700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ae406ace0 0x7f2ae406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:15.046 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.041+0000 7f2af77fe700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ae406ace0 0x7f2ae406d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2aec007fd0 tx=0x7f2aec009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:15.047 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.045+0000 7f2adffff700 1 -- 172.21.15.149:0/3003117157 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2af00568a0 con 0x7f2af80cf5b0 2023-06-09T04:38:15.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:15.279+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2af80cd3b0 con 0x7f2af80cf5b0 2023-06-09T04:38:16.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.208+0000 7f2adffff700 1 -- 172.21.15.149:0/3003117157 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2af80cd3b0 con 0x7f2af80cf5b0 2023-06-09T04:38:16.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.210+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ae406ace0 msgr2=0x7f2ae406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.210+0000 7f2afdafc700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ae406ace0 0x7f2ae406d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2aec007fd0 tx=0x7f2aec009040 comp rx=0 tx=0).stop 2023-06-09T04:38:16.212 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.210+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cf5b0 msgr2=0x7f2af80b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.210+0000 7f2afdafc700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cf5b0 0x7f2af80b3c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2af0014040 tx=0x7f2af0004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 shutdown_connections 2023-06-09T04:38:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f2ae406ace0 0x7f2ae406d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f2af80b60a0 0x7f2af80c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2af80cf5b0 0x7f2af80b3c10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 --2- 172.21.15.149:0/3003117157 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2af80cad90 0x7f2af815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 >> 172.21.15.149:0/3003117157 conn(0x7f2af8069db0 msgr2=0x7f2af8159740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 shutdown_connections 2023-06-09T04:38:16.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.211+0000 7f2afdafc700 1 -- 172.21.15.149:0/3003117157 wait complete. 2023-06-09T04:38:16.227 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T04:38:16.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:38:16.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.355+0000 7fcd0565c700 1 Processor -- start 2023-06-09T04:38:16.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.355+0000 7fcd0565c700 1 -- start start 2023-06-09T04:38:16.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.355+0000 7fcd0565c700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd00069db0 0x7fcd000cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fcd0565c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd000c9500 0x7fcd0006a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fcd0565c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0006a6c0 con 0x7fcd0006c100 2023-06-09T04:38:16.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fcd0565c700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000cd990 con 0x7fcd00069db0 2023-06-09T04:38:16.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fcd0565c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000cdc70 con 0x7fcd000c9500 2023-06-09T04:38:16.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd00069db0 0x7fcd000cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fcd00069db0 0x7fcd000cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38498/0 (socket says 172.21.15.149:38498) 2023-06-09T04:38:16.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 -- 172.21.15.149:0/2506534738 learned_addr learned my addr 172.21.15.149:0/2506534738 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:16.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 -- 172.21.15.149:0/2506534738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd000c9500 msgr2=0x7fcd0006a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 --2- 172.21.15.149:0/2506534738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd000c9500 0x7fcd0006a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 -- 172.21.15.149:0/2506534738 >> v1:172.21.15.184:6789/0 conn(0x7fcd0006c100 legacy=0x7fcd0006c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:16.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 -- 172.21.15.149:0/2506534738 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00070550 con 0x7fcd00069db0 2023-06-09T04:38:16.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfeffd700 1 --2- 172.21.15.149:0/2506534738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd00069db0 0x7fcd000cd3b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fccf000bb90 tx=0x7fccf000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1106c8eae4c6a80c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfdffb700 1 -- 172.21.15.149:0/2506534738 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000dc00 con 0x7fcd00069db0 2023-06-09T04:38:16.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfdffb700 1 -- 172.21.15.149:0/2506534738 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000dd60 con 0x7fcd00069db0 2023-06-09T04:38:16.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.356+0000 7fccfdffb700 1 -- 172.21.15.149:0/2506534738 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0004270 con 0x7fcd00069db0 2023-06-09T04:38:16.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 -- 172.21.15.149:0/2506534738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd00069db0 msgr2=0x7fcd000cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2506534738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd00069db0 0x7fcd000cd3b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fccf000bb90 tx=0x7fccf000bea0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 -- 172.21.15.149:0/2506534738 shutdown_connections 2023-06-09T04:38:16.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2506534738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd00069db0 0x7fcd000cd3b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2506534738 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd000c9500 0x7fcd0006a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 -- 172.21.15.149:0/2506534738 >> 172.21.15.149:0/2506534738 conn(0x7fcd000cf220 msgr2=0x7fcd000cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:16.361 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 -- 172.21.15.149:0/2506534738 shutdown_connections 2023-06-09T04:38:16.362 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.357+0000 7fcd0565c700 1 -- 172.21.15.149:0/2506534738 wait complete. 2023-06-09T04:38:16.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.358+0000 7fcd0565c700 1 Processor -- start 2023-06-09T04:38:16.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.358+0000 7fcd0565c700 1 -- start start 2023-06-09T04:38:16.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fcd0565c700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd00069db0 0x7fcd000ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fcd0565c700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd0006c100 0x7fcd00150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fcd0565c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000c9500 0x7fcd000c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fcd0565c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000ad230 con 0x7fcd000c9500 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fcd0565c700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00156330 con 0x7fcd00069db0 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fcd0565c700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd000ac990 con 0x7fcd0006c100 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000c9500 0x7fcd000c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000c9500 0x7fcd000c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38508/0 (socket says 172.21.15.149:38508) 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 -- 172.21.15.149:0/2107660206 learned_addr learned my addr 172.21.15.149:0/2107660206 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccfeffd700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd00069db0 0x7fcd000ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccfe7fc700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd0006c100 0x7fcd00150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 -- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd0006c100 msgr2=0x7fcd00150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd0006c100 0x7fcd00150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 -- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd00069db0 msgr2=0x7fcd000ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:16.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd00069db0 0x7fcd000ac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:16.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 -- 172.21.15.149:0/2107660206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf000b7f0 con 0x7fcd000c9500 2023-06-09T04:38:16.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccfe7fc700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd0006c100 0x7fcd00150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:16.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.359+0000 7fccff7fe700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000c9500 0x7fcd000c6f40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fccf800cc10 tx=0x7fccf800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.360+0000 7fcce77fe700 1 -- 172.21.15.149:0/2107660206 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf800ab10 con 0x7fcd000c9500 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.360+0000 7fcce77fe700 1 -- 172.21.15.149:0/2107660206 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf800ac70 con 0x7fcd000c9500 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.360+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd000acc70 con 0x7fcd000c9500 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.360+0000 7fcce77fe700 1 -- 172.21.15.149:0/2107660206 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8012420 con 0x7fcd000c9500 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.360+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd00158a70 con 0x7fcd000c9500 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.361+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd000c9c10 con 0x7fcd000c9500 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.361+0000 7fcce77fe700 1 -- 172.21.15.149:0/2107660206 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fccf8012580 con 0x7fcd000c9500 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.361+0000 7fcce77fe700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fccec06ace0 0x7fccec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:16.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.361+0000 7fcce77fe700 1 -- 172.21.15.149:0/2107660206 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fccf8089870 con 0x7fcd000c9500 2023-06-09T04:38:16.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.361+0000 7fccfeffd700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fccec06ace0 0x7fccec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:16.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.362+0000 7fccfeffd700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fccec06ace0 0x7fccec06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fccf0019040 tx=0x7fccf0014000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:16.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.366+0000 7fcce77fe700 1 -- 172.21.15.149:0/2107660206 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fccf8054870 con 0x7fcd000c9500 2023-06-09T04:38:16.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:16.598+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcd00073fa0 con 0x7fcd000c9500 2023-06-09T04:38:17.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.213+0000 7fcce77fe700 1 -- 172.21.15.149:0/2107660206 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fccf8057e90 con 0x7fcd000c9500 2023-06-09T04:38:17.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fccec06ace0 msgr2=0x7fccec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fccec06ace0 0x7fccec06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fccf0019040 tx=0x7fccf0014000 comp rx=0 tx=0).stop 2023-06-09T04:38:17.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000c9500 msgr2=0x7fcd000c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000c9500 0x7fcd000c6f40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fccf800cc10 tx=0x7fccf800cf20 comp rx=0 tx=0).stop 2023-06-09T04:38:17.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 shutdown_connections 2023-06-09T04:38:17.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fccec06ace0 0x7fccec06d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcd000c9500 0x7fcd000c6f40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcd00069db0 0x7fcd000ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 --2- 172.21.15.149:0/2107660206 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fcd0006c100 0x7fcd00150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 >> 172.21.15.149:0/2107660206 conn(0x7fcd000cf220 msgr2=0x7fcd000b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 shutdown_connections 2023-06-09T04:38:17.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.216+0000 7fcd0565c700 1 -- 172.21.15.149:0/2107660206 wait complete. 2023-06-09T04:38:17.232 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:38:17.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:17.356 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.355+0000 7f4b33db7700 1 Processor -- start 2023-06-09T04:38:17.357 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.356+0000 7f4b33db7700 1 -- start start 2023-06-09T04:38:17.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.356+0000 7f4b33db7700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4b2c0afa30 0x7f4b2c0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.358 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.356+0000 7f4b33db7700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0b01a0 con 0x7f4b2c0b0c40 2023-06-09T04:38:17.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.356+0000 7f4b33db7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0b0900 con 0x7f4b2c0cd980 2023-06-09T04:38:17.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.356+0000 7f4b33db7700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0b06f0 con 0x7f4b2c0afa30 2023-06-09T04:38:17.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b31b53700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f4b2c0afa30 0x7f4b2c0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b31352700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f4b2c0b0c40 0x7f4b2c0cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34144/0 (socket says 172.21.15.149:34144) 2023-06-09T04:38:17.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b31352700 1 -- 172.21.15.149:0/4096175833 learned_addr learned my addr 172.21.15.149:0/4096175833 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:17.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b31b53700 1 -- 172.21.15.149:0/4096175833 >> v1:172.21.15.184:6789/0 conn(0x7f4b2c0cd980 legacy=0x7f4b2c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.359 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b31b53700 1 -- 172.21.15.149:0/4096175833 >> v1:172.21.15.149:6789/0 conn(0x7f4b2c0b0c40 legacy=0x7f4b2c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b30b51700 1 -- 172.21.15.149:0/4096175833 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50609535 0 0) 0x7f4b2c0b01a0 con 0x7f4b2c0b0c40 2023-06-09T04:38:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b31b53700 1 -- 172.21.15.149:0/4096175833 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0ca7a0 con 0x7f4b2c0afa30 2023-06-09T04:38:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b31b53700 1 --2- 172.21.15.149:0/4096175833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0afa30 0x7f4b2c0b24f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009820 tx=0x7f4b1c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89f845c5eda5265 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b30b51700 1 -- 172.21.15.149:0/4096175833 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c005e30 con 0x7f4b2c0afa30 2023-06-09T04:38:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b30b51700 1 -- 172.21.15.149:0/4096175833 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c004030 con 0x7f4b2c0afa30 2023-06-09T04:38:17.360 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.357+0000 7f4b30b51700 1 -- 172.21.15.149:0/4096175833 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0043c0 con 0x7f4b2c0afa30 2023-06-09T04:38:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.358+0000 7f4b33db7700 1 -- 172.21.15.149:0/4096175833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0afa30 msgr2=0x7f4b2c0b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.358+0000 7f4b33db7700 1 --2- 172.21.15.149:0/4096175833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0afa30 0x7f4b2c0b24f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009820 tx=0x7f4b1c009b30 comp rx=0 tx=0).stop 2023-06-09T04:38:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.358+0000 7f4b33db7700 1 -- 172.21.15.149:0/4096175833 shutdown_connections 2023-06-09T04:38:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.358+0000 7f4b33db7700 1 --2- 172.21.15.149:0/4096175833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0afa30 0x7f4b2c0b24f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.358+0000 7f4b33db7700 1 -- 172.21.15.149:0/4096175833 >> 172.21.15.149:0/4096175833 conn(0x7f4b2c06b7e0 msgr2=0x7f4b2c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.363 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.358+0000 7f4b33db7700 1 -- 172.21.15.149:0/4096175833 shutdown_connections 2023-06-09T04:38:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.358+0000 7f4b33db7700 1 -- 172.21.15.149:0/4096175833 wait complete. 2023-06-09T04:38:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.359+0000 7f4b33db7700 1 Processor -- start 2023-06-09T04:38:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.359+0000 7f4b33db7700 1 -- start start 2023-06-09T04:38:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b33db7700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b2c0afa30 0x7f4b2c0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b33db7700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b2c0b0c40 0x7f4b2c1ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b33db7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0cd980 0x7f4b2c0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.364 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b33db7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c1ef850 con 0x7f4b2c0cd980 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b33db7700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c86e0 con 0x7f4b2c0afa30 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b33db7700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c6770 con 0x7f4b2c0b0c40 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b32354700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0cd980 0x7f4b2c0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b32354700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0cd980 0x7f4b2c0cb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38520/0 (socket says 172.21.15.149:38520) 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.360+0000 7f4b32354700 1 -- 172.21.15.149:0/3805848622 learned_addr learned my addr 172.21.15.149:0/3805848622 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b31b53700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b2c0afa30 0x7f4b2c0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b31352700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b2c0b0c40 0x7f4b2c1ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.365 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b32354700 1 -- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b2c0b0c40 msgr2=0x7f4b2c1ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b32354700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b2c0b0c40 0x7f4b2c1ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b32354700 1 -- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b2c0afa30 msgr2=0x7f4b2c0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b32354700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b2c0afa30 0x7f4b2c0c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b32354700 1 -- 172.21.15.149:0/3805848622 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c009430 con 0x7f4b2c0cd980 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b32354700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0cd980 0x7f4b2c0cb210 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400cc10 tx=0x7f4b2400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b227fc700 1 -- 172.21.15.149:0/3805848622 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400abb0 con 0x7f4b2c0cd980 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b227fc700 1 -- 172.21.15.149:0/3805848622 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2400ad10 con 0x7f4b2c0cd980 2023-06-09T04:38:17.366 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0c6a50 con 0x7f4b2c0cd980 2023-06-09T04:38:17.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b227fc700 1 -- 172.21.15.149:0/3805848622 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24012660 con 0x7f4b2c0cd980 2023-06-09T04:38:17.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.361+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c0c7010 con 0x7f4b2c0cd980 2023-06-09T04:38:17.367 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.362+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c073fa0 con 0x7f4b2c0cd980 2023-06-09T04:38:17.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.362+0000 7f4b227fc700 1 -- 172.21.15.149:0/3805848622 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b240127c0 con 0x7f4b2c0cd980 2023-06-09T04:38:17.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.363+0000 7f4b227fc700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b1006ace0 0x7f4b1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.363+0000 7f4b227fc700 1 -- 172.21.15.149:0/3805848622 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4b24089cb0 con 0x7f4b2c0cd980 2023-06-09T04:38:17.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.363+0000 7f4b31b53700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b1006ace0 0x7f4b1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.368 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.363+0000 7f4b31b53700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b1006ace0 0x7f4b1006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c000c00 tx=0x7f4b1c008070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.369 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.367+0000 7f4b227fc700 1 -- 172.21.15.149:0/3805848622 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b24054cb0 con 0x7f4b2c0cd980 2023-06-09T04:38:17.595 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.594+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b2c0ca560 con 0x7f4b2c0cd980 2023-06-09T04:38:17.596 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.595+0000 7f4b227fc700 1 -- 172.21.15.149:0/3805848622 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f4b24016020 con 0x7f4b2c0cd980 2023-06-09T04:38:17.597 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:17.597 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2625829505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2625829505},{"type":"v1","addr":"172.21.15.149:6837","nonce":2625829505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1728628008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1728628008},{"type":"v1","addr":"172.21.15.184:6835","nonce":1728628008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2662008754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2662008754},{"type":"v1","addr":"172.21.15.149:6836","nonce":2662008754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:14.198008+0000","modified":"2023-06-09T04:38:17.208246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6834/1863694113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1863694113},{"type":"v1","addr":"172.21.15.184:6834","nonce":1863694113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:38:17.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b1006ace0 msgr2=0x7f4b1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b1006ace0 0x7f4b1006d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c000c00 tx=0x7f4b1c008070 comp rx=0 tx=0).stop 2023-06-09T04:38:17.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0cd980 msgr2=0x7f4b2c0cb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0cd980 0x7f4b2c0cb210 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400cc10 tx=0x7f4b2400a060 comp rx=0 tx=0).stop 2023-06-09T04:38:17.599 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 shutdown_connections 2023-06-09T04:38:17.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f4b1006ace0 0x7f4b1006d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b2c0cd980 0x7f4b2c0cb210 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4b2c0afa30 0x7f4b2c0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 --2- 172.21.15.149:0/3805848622 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f4b2c0b0c40 0x7f4b2c1ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.597+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 >> 172.21.15.149:0/3805848622 conn(0x7f4b2c06b7e0 msgr2=0x7f4b2c06e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.598+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 shutdown_connections 2023-06-09T04:38:17.600 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.598+0000 7f4b33db7700 1 -- 172.21.15.149:0/3805848622 wait complete. 2023-06-09T04:38:17.601 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 16 2023-06-09T04:38:17.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:38:17.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.731+0000 7fd0a1f88700 1 Processor -- start 2023-06-09T04:38:17.732 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.731+0000 7fd0a1f88700 1 -- start start 2023-06-09T04:38:17.734 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd0a1f88700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd09c15c520 0x7fd09c071560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd0a1f88700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd09c0cee20 0x7fd09c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd0a1f88700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c0b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd0a1f88700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0cd940 con 0x7fd09c0cee20 2023-06-09T04:38:17.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd0a1f88700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c06a770 con 0x7fd09c15c520 2023-06-09T04:38:17.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd0a1f88700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0b20f0 con 0x7fd09c06a2f0 2023-06-09T04:38:17.735 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd09c0cee20 0x7fd09c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fd09c0cee20 0x7fd09c069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38526/0 (socket says 172.21.15.149:38526) 2023-06-09T04:38:17.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 -- 172.21.15.149:0/3179461208 learned_addr learned my addr 172.21.15.149:0/3179461208 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:17.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09b7fe700 1 --2- 172.21.15.149:0/3179461208 >> v2:172.21.15.184:3300/0 conn(0x7fd09c15c520 0x7fd09c071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09bfff700 1 --2- 172.21.15.149:0/3179461208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c0b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 -- 172.21.15.149:0/3179461208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 msgr2=0x7fd09c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.736 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 --2- 172.21.15.149:0/3179461208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c0b24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 -- 172.21.15.149:0/3179461208 >> v2:172.21.15.184:3300/0 conn(0x7fd09c15c520 msgr2=0x7fd09c071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:17.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 --2- 172.21.15.149:0/3179461208 >> v2:172.21.15.184:3300/0 conn(0x7fd09c15c520 0x7fd09c071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 -- 172.21.15.149:0/3179461208 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c15c8f0 con 0x7fd09c0cee20 2023-06-09T04:38:17.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09b7fe700 1 --2- 172.21.15.149:0/3179461208 >> v2:172.21.15.184:3300/0 conn(0x7fd09c15c520 0x7fd09c071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:17.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09bfff700 1 --2- 172.21.15.149:0/3179461208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:17.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.732+0000 7fd09affd700 1 --2- 172.21.15.149:0/3179461208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c069db0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0cd1a0 tx=0x7fd08c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b216990f0ae1465 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.737 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd09a7fc700 1 -- 172.21.15.149:0/3179461208 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00b870 con 0x7fd09c0cee20 2023-06-09T04:38:17.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd09a7fc700 1 -- 172.21.15.149:0/3179461208 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c00b9d0 con 0x7fd09c0cee20 2023-06-09T04:38:17.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd09a7fc700 1 -- 172.21.15.149:0/3179461208 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00bd60 con 0x7fd09c0cee20 2023-06-09T04:38:17.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 -- 172.21.15.149:0/3179461208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 msgr2=0x7fd09c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/3179461208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c069db0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0cd1a0 tx=0x7fd08c009bd0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 -- 172.21.15.149:0/3179461208 shutdown_connections 2023-06-09T04:38:17.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/3179461208 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c0b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.738 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/3179461208 >> v2:172.21.15.184:3300/0 conn(0x7fd09c15c520 0x7fd09c071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/3179461208 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c069db0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 -- 172.21.15.149:0/3179461208 >> 172.21.15.149:0/3179461208 conn(0x7fd09c06aec0 msgr2=0x7fd09c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 -- 172.21.15.149:0/3179461208 shutdown_connections 2023-06-09T04:38:17.739 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.733+0000 7fd0a1f88700 1 -- 172.21.15.149:0/3179461208 wait complete. 2023-06-09T04:38:17.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.734+0000 7fd0a1f88700 1 Processor -- start 2023-06-09T04:38:17.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.734+0000 7fd0a1f88700 1 -- start start 2023-06-09T04:38:17.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd0a1f88700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd0a1f88700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c1f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.741 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd0a1f88700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd09c15c520 0x7fd09c0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd0a1f88700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c15dbf0 con 0x7fd09c0cee20 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd0a1f88700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c15cfe0 con 0x7fd09c15c520 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd0a1f88700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c15d2c0 con 0x7fd09c06a2f0 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd09affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c1f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd09affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c1f1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38532/0 (socket says 172.21.15.149:38532) 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.735+0000 7fd09affd700 1 -- 172.21.15.149:0/2599815839 learned_addr learned my addr 172.21.15.149:0/2599815839 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd09affd700 1 -- 172.21.15.149:0/2599815839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 msgr2=0x7fd09c150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.742 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd09affd700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd09bfff700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd09c15c520 0x7fd09c0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd09affd700 1 -- 172.21.15.149:0/2599815839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd09c15c520 msgr2=0x7fd09c0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd09affd700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd09c15c520 0x7fd09c0c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd09affd700 1 -- 172.21.15.149:0/2599815839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c009550 con 0x7fd09c0cee20 2023-06-09T04:38:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd09affd700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c1f1f40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0cd1d0 tx=0x7fd08c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd083fff700 1 -- 172.21.15.149:0/2599815839 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c004310 con 0x7fd09c0cee20 2023-06-09T04:38:17.743 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd083fff700 1 -- 172.21.15.149:0/2599815839 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c01f070 con 0x7fd09c0cee20 2023-06-09T04:38:17.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c15d5a0 con 0x7fd09c0cee20 2023-06-09T04:38:17.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd083fff700 1 -- 172.21.15.149:0/2599815839 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c0036a0 con 0x7fd09c0cee20 2023-06-09T04:38:17.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.736+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c150fb0 con 0x7fd09c0cee20 2023-06-09T04:38:17.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.737+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c073fa0 con 0x7fd09c0cee20 2023-06-09T04:38:17.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.737+0000 7fd083fff700 1 -- 172.21.15.149:0/2599815839 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd08c021030 con 0x7fd09c0cee20 2023-06-09T04:38:17.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.738+0000 7fd083fff700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd08806ace0 0x7fd08806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:17.744 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.738+0000 7fd083fff700 1 -- 172.21.15.149:0/2599815839 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd08c08a900 con 0x7fd09c0cee20 2023-06-09T04:38:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.738+0000 7fd09b7fe700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd08806ace0 0x7fd08806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.738+0000 7fd09b7fe700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd08806ace0 0x7fd08806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd090006ba0 tx=0x7fd090008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:17.745 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.742+0000 7fd083fff700 1 -- 172.21.15.149:0/2599815839 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd08c055a30 con 0x7fd09c0cee20 2023-06-09T04:38:17.784 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T04:38:17.784+0000 7f46c604c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:38:17.932 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.931+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd09c15dd30 con 0x7fd09c0cee20 2023-06-09T04:38:17.933 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.932+0000 7fd083fff700 1 -- 172.21.15.149:0/2599815839 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18454 (secure 0 0 0) 0x7fd08c059050 con 0x7fd09c0cee20 2023-06-09T04:38:17.933 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:17.934 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":41,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T04:38:15.199870+0000","last_up_change":"2023-06-09T04:36:45.555880+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:12.652912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:13.159242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists","up"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:38:17.935 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd08806ace0 msgr2=0x7fd08806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd08806ace0 0x7fd08806d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd090006ba0 tx=0x7fd090008040 comp rx=0 tx=0).stop 2023-06-09T04:38:17.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 msgr2=0x7fd09c1f1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:17.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c1f1f40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0cd1d0 tx=0x7fd08c004750 comp rx=0 tx=0).stop 2023-06-09T04:38:17.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 shutdown_connections 2023-06-09T04:38:17.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd08806ace0 0x7fd08806d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd09c06a2f0 0x7fd09c150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.936 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd09c15c520 0x7fd09c0c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 --2- 172.21.15.149:0/2599815839 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd09c0cee20 0x7fd09c1f1f40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:17.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 >> 172.21.15.149:0/2599815839 conn(0x7fd09c06aec0 msgr2=0x7fd09c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:17.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 shutdown_connections 2023-06-09T04:38:17.937 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:17.934+0000 7fd0a1f88700 1 -- 172.21.15.149:0/2599815839 wait complete. 2023-06-09T04:38:17.947 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:38:17.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:18.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.067+0000 7f135862b700 1 Processor -- start 2023-06-09T04:38:18.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.067+0000 7f135862b700 1 -- start start 2023-06-09T04:38:18.071 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f135862b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 0x7f13500af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f135862b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f135015e8c0 con 0x7f135015e1a0 2023-06-09T04:38:18.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f135862b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500afeb0 con 0x7f135015d280 2023-06-09T04:38:18.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f135862b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13500b3fa0 con 0x7f135015d650 2023-06-09T04:38:18.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f1356bc8700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f135015e1a0 0x7f13500cc570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34174/0 (socket says 172.21.15.149:34174) 2023-06-09T04:38:18.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f1356bc8700 1 -- 172.21.15.149:0/2980375784 learned_addr learned my addr 172.21.15.149:0/2980375784 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:18.072 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622518611 0 0) 0x7f135015e8c0 con 0x7f135015e1a0 2023-06-09T04:38:18.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f133c0035b0 con 0x7f135015e1a0 2023-06-09T04:38:18.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.068+0000 7f1355bc6700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 0x7f13500af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 407532167 0 0) 0x7f133c0035b0 con 0x7f135015e1a0 2023-06-09T04:38:18.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 msgr2=0x7f13500af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 0x7f13500af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 >> v1:172.21.15.184:6789/0 conn(0x7f135015d280 legacy=0x7f135015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13500cdb10 con 0x7f135015e1a0 2023-06-09T04:38:18.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f13480019f0 con 0x7f135015e1a0 2023-06-09T04:38:18.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 >> v1:172.21.15.149:6789/0 conn(0x7f135015e1a0 legacy=0x7f13500cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 0x7f133c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133c003fb0 0x7f133c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c004d90 0x7f133c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13500b3fa0 con 0x7f133c003fb0 2023-06-09T04:38:18.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c00bba0 con 0x7f133c004d90 2023-06-09T04:38:18.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c00bd60 con 0x7f135015d650 2023-06-09T04:38:18.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1355bc6700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133c003fb0 0x7f133c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13563c7700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 0x7f133c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1356bc8700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c004d90 0x7f133c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1355bc6700 1 -- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 msgr2=0x7f133c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1355bc6700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f135015d650 0x7f133c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1355bc6700 1 -- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c004d90 msgr2=0x7f133c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1355bc6700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c004d90 0x7f133c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1355bc6700 1 -- 172.21.15.149:0/2980375784 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0035b0 con 0x7f133c003fb0 2023-06-09T04:38:18.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f1355bc6700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133c003fb0 0x7f133c004850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f13500af730 tx=0x7f133c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f993341a78e4b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00e6c0 con 0x7f133c003fb0 2023-06-09T04:38:18.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c00e820 con 0x7f133c003fb0 2023-06-09T04:38:18.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.069+0000 7f13553c5700 1 -- 172.21.15.149:0/2980375784 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00eb90 con 0x7f133c003fb0 2023-06-09T04:38:18.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.070+0000 7f135862b700 1 -- 172.21.15.149:0/2980375784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133c003fb0 msgr2=0x7f133c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.070+0000 7f135862b700 1 --2- 172.21.15.149:0/2980375784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f133c003fb0 0x7f133c004850 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f13500af730 tx=0x7f133c005880 comp rx=0 tx=0).stop 2023-06-09T04:38:18.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.070+0000 7f1356bc8700 1 -- 172.21.15.149:0/2980375784 reap_dead start 2023-06-09T04:38:18.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.070+0000 7f135862b700 1 -- 172.21.15.149:0/2980375784 shutdown_connections 2023-06-09T04:38:18.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.070+0000 7f135862b700 1 -- 172.21.15.149:0/2980375784 >> 172.21.15.149:0/2980375784 conn(0x7f1350069db0 msgr2=0x7f135006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.070+0000 7f135862b700 1 -- 172.21.15.149:0/2980375784 shutdown_connections 2023-06-09T04:38:18.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.070+0000 7f135862b700 1 -- 172.21.15.149:0/2980375784 wait complete. 2023-06-09T04:38:18.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.071+0000 7f135862b700 1 Processor -- start 2023-06-09T04:38:18.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.071+0000 7f135862b700 1 -- start start 2023-06-09T04:38:18.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f135862b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c003fb0 0x7f1350156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f135862b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13500aef90 0x7f135015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f135862b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1350159710 0x7f1350159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f135862b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135015a0c0 con 0x7f13500aef90 2023-06-09T04:38:18.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f135862b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135015bc40 con 0x7f133c003fb0 2023-06-09T04:38:18.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f135862b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135006b0d0 con 0x7f1350159710 2023-06-09T04:38:18.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13500aef90 0x7f135015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13500aef90 0x7f135015b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38552/0 (socket says 172.21.15.149:38552) 2023-06-09T04:38:18.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 -- 172.21.15.149:0/3358955633 learned_addr learned my addr 172.21.15.149:0/3358955633 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:18.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f13563c7700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c003fb0 0x7f1350156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1356bc8700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1350159710 0x7f1350159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 -- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1350159710 msgr2=0x7f1350159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1350159710 0x7f1350159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 -- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c003fb0 msgr2=0x7f1350156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c003fb0 0x7f1350156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 -- 172.21.15.149:0/3358955633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135006c3f0 con 0x7f13500aef90 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.072+0000 7f1355bc6700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13500aef90 0x7f135015b700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f133c005810 tx=0x7f134c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.073+0000 7f1346ffd700 1 -- 172.21.15.149:0/3358955633 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00e6c0 con 0x7f13500aef90 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.073+0000 7f1346ffd700 1 -- 172.21.15.149:0/3358955633 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c0036a0 con 0x7f13500aef90 2023-06-09T04:38:18.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.073+0000 7f1346ffd700 1 -- 172.21.15.149:0/3358955633 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c006e60 con 0x7f13500aef90 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.073+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13500af400 con 0x7f13500aef90 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.073+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135006b600 con 0x7f13500aef90 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.074+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1350073fa0 con 0x7f13500aef90 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.074+0000 7f1346ffd700 1 -- 172.21.15.149:0/3358955633 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f134c003a30 con 0x7f13500aef90 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.075+0000 7f1346ffd700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f133406ad10 0x7f133406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.075+0000 7f1346ffd700 1 -- 172.21.15.149:0/3358955633 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f134c08a450 con 0x7f13500aef90 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.075+0000 7f13563c7700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f133406ad10 0x7f133406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.083 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.075+0000 7f13563c7700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f133406ad10 0x7f133406d1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1340000c00 tx=0x7f1340009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.084 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.079+0000 7f1346ffd700 1 -- 172.21.15.149:0/3358955633 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f134c055650 con 0x7f13500aef90 2023-06-09T04:38:18.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.264+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 --> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13500b44d0 con 0x7f133406ad10 2023-06-09T04:38:18.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.272+0000 7f1346ffd700 1 -- 172.21.15.149:0/3358955633 <== mgr.4101 v2:172.21.15.149:6832/2920572545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304866 (secure 0 0 0) 0x7f13400015e0 con 0x7f133406ad10 2023-06-09T04:38:18.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:18.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f133406ad10 msgr2=0x7f133406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f133406ad10 0x7f133406d1c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1340000c00 tx=0x7f1340009040 comp rx=0 tx=0).stop 2023-06-09T04:38:18.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13500aef90 msgr2=0x7f135015b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13500aef90 0x7f135015b700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f133c005810 tx=0x7f134c0047c0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 shutdown_connections 2023-06-09T04:38:18.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f133406ad10 0x7f133406d1c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.279 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f1350159710 0x7f1350159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f133c003fb0 0x7f1350156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 --2- 172.21.15.149:0/3358955633 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f13500aef90 0x7f135015b700 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 >> 172.21.15.149:0/3358955633 conn(0x7f1350069db0 msgr2=0x7f13501577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 shutdown_connections 2023-06-09T04:38:18.280 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.276+0000 7f135862b700 1 -- 172.21.15.149:0/3358955633 wait complete. 2023-06-09T04:38:18.280 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-06-09T04:38:18.290 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-06-09T04:38:16.409634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590528,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":126,"acting":126,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220216,"kb_used_data":4600,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754504,"statfs":{"total":773094113280,"available":772868612096,"internally_reserved":0,"allocated":4710400,"data_stored":2730842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":160,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000629"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327599+0000","last_change":"2023-06-09T04:38:14.224928+0000","last_active":"2023-06-09T04:38:15.327599+0000","last_peered":"2023-06-09T04:38:15.327599+0000","last_clean":"2023-06-09T04:38:15.327599+0000","last_became_active":"2023-06-09T04:38:14.224657+0000","last_became_peered":"2023-06-09T04:38:14.224657+0000","last_unstale":"2023-06-09T04:38:15.327599+0000","last_undegraded":"2023-06-09T04:38:15.327599+0000","last_fullsized":"2023-06-09T04:38:15.327599+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:55:04.398638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.214111+0000","last_change":"2023-06-09T04:38:14.212010+0000","last_active":"2023-06-09T04:38:15.214111+0000","last_peered":"2023-06-09T04:38:15.214111+0000","last_clean":"2023-06-09T04:38:15.214111+0000","last_became_active":"2023-06-09T04:38:14.211712+0000","last_became_peered":"2023-06-09T04:38:14.211712+0000","last_unstale":"2023-06-09T04:38:15.214111+0000","last_undegraded":"2023-06-09T04:38:15.214111+0000","last_fullsized":"2023-06-09T04:38:15.214111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:13.758285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326600+0000","last_change":"2023-06-09T04:38:14.226048+0000","last_active":"2023-06-09T04:38:15.326600+0000","last_peered":"2023-06-09T04:38:15.326600+0000","last_clean":"2023-06-09T04:38:15.326600+0000","last_became_active":"2023-06-09T04:38:14.225805+0000","last_became_peered":"2023-06-09T04:38:14.225805+0000","last_unstale":"2023-06-09T04:38:15.326600+0000","last_undegraded":"2023-06-09T04:38:15.326600+0000","last_fullsized":"2023-06-09T04:38:15.326600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:15.877773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208147+0000","last_change":"2023-06-09T04:38:14.223980+0000","last_active":"2023-06-09T04:38:15.208147+0000","last_peered":"2023-06-09T04:38:15.208147+0000","last_clean":"2023-06-09T04:38:15.208147+0000","last_became_active":"2023-06-09T04:38:14.222633+0000","last_became_peered":"2023-06-09T04:38:14.222633+0000","last_unstale":"2023-06-09T04:38:15.208147+0000","last_undegraded":"2023-06-09T04:38:15.208147+0000","last_fullsized":"2023-06-09T04:38:15.208147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:28.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213822+0000","last_change":"2023-06-09T04:38:14.212375+0000","last_active":"2023-06-09T04:38:15.213822+0000","last_peered":"2023-06-09T04:38:15.213822+0000","last_clean":"2023-06-09T04:38:15.213822+0000","last_became_active":"2023-06-09T04:38:14.211418+0000","last_became_peered":"2023-06-09T04:38:14.211418+0000","last_unstale":"2023-06-09T04:38:15.213822+0000","last_undegraded":"2023-06-09T04:38:15.213822+0000","last_fullsized":"2023-06-09T04:38:15.213822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:17.969366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327844+0000","last_change":"2023-06-09T04:38:14.230063+0000","last_active":"2023-06-09T04:38:15.327844+0000","last_peered":"2023-06-09T04:38:15.327844+0000","last_clean":"2023-06-09T04:38:15.327844+0000","last_became_active":"2023-06-09T04:38:14.229740+0000","last_became_peered":"2023-06-09T04:38:14.229740+0000","last_unstale":"2023-06-09T04:38:15.327844+0000","last_undegraded":"2023-06-09T04:38:15.327844+0000","last_fullsized":"2023-06-09T04:38:15.327844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:29.872419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207999+0000","last_change":"2023-06-09T04:38:14.225811+0000","last_active":"2023-06-09T04:38:15.207999+0000","last_peered":"2023-06-09T04:38:15.207999+0000","last_clean":"2023-06-09T04:38:15.207999+0000","last_became_active":"2023-06-09T04:38:14.225427+0000","last_became_peered":"2023-06-09T04:38:14.225427+0000","last_unstale":"2023-06-09T04:38:15.207999+0000","last_undegraded":"2023-06-09T04:38:15.207999+0000","last_fullsized":"2023-06-09T04:38:15.207999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:41.022354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208394+0000","last_change":"2023-06-09T04:38:14.217404+0000","last_active":"2023-06-09T04:38:15.208394+0000","last_peered":"2023-06-09T04:38:15.208394+0000","last_clean":"2023-06-09T04:38:15.208394+0000","last_became_active":"2023-06-09T04:38:14.217141+0000","last_became_peered":"2023-06-09T04:38:14.217141+0000","last_unstale":"2023-06-09T04:38:15.208394+0000","last_undegraded":"2023-06-09T04:38:15.208394+0000","last_fullsized":"2023-06-09T04:38:15.208394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:32:32.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208525+0000","last_change":"2023-06-09T04:38:14.223796+0000","last_active":"2023-06-09T04:38:15.208525+0000","last_peered":"2023-06-09T04:38:15.208525+0000","last_clean":"2023-06-09T04:38:15.208525+0000","last_became_active":"2023-06-09T04:38:14.223493+0000","last_became_peered":"2023-06-09T04:38:14.223493+0000","last_unstale":"2023-06-09T04:38:15.208525+0000","last_undegraded":"2023-06-09T04:38:15.208525+0000","last_fullsized":"2023-06-09T04:38:15.208525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:12.180461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208558+0000","last_change":"2023-06-09T04:38:14.217442+0000","last_active":"2023-06-09T04:38:15.208558+0000","last_peered":"2023-06-09T04:38:15.208558+0000","last_clean":"2023-06-09T04:38:15.208558+0000","last_became_active":"2023-06-09T04:38:14.217179+0000","last_became_peered":"2023-06-09T04:38:14.217179+0000","last_unstale":"2023-06-09T04:38:15.208558+0000","last_undegraded":"2023-06-09T04:38:15.208558+0000","last_fullsized":"2023-06-09T04:38:15.208558+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:49:10.428874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213984+0000","last_change":"2023-06-09T04:38:14.218654+0000","last_active":"2023-06-09T04:38:15.213984+0000","last_peered":"2023-06-09T04:38:15.213984+0000","last_clean":"2023-06-09T04:38:15.213984+0000","last_became_active":"2023-06-09T04:38:14.218223+0000","last_became_peered":"2023-06-09T04:38:14.218223+0000","last_unstale":"2023-06-09T04:38:15.213984+0000","last_undegraded":"2023-06-09T04:38:15.213984+0000","last_fullsized":"2023-06-09T04:38:15.213984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:35:40.264006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208229+0000","last_change":"2023-06-09T04:38:14.216608+0000","last_active":"2023-06-09T04:38:15.208229+0000","last_peered":"2023-06-09T04:38:15.208229+0000","last_clean":"2023-06-09T04:38:15.208229+0000","last_became_active":"2023-06-09T04:38:14.216338+0000","last_became_peered":"2023-06-09T04:38:14.216338+0000","last_unstale":"2023-06-09T04:38:15.208229+0000","last_undegraded":"2023-06-09T04:38:15.208229+0000","last_fullsized":"2023-06-09T04:38:15.208229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:58.075119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326950+0000","last_change":"2023-06-09T04:38:14.227304+0000","last_active":"2023-06-09T04:38:15.326950+0000","last_peered":"2023-06-09T04:38:15.326950+0000","last_clean":"2023-06-09T04:38:15.326950+0000","last_became_active":"2023-06-09T04:38:14.227053+0000","last_became_peered":"2023-06-09T04:38:14.227053+0000","last_unstale":"2023-06-09T04:38:15.326950+0000","last_undegraded":"2023-06-09T04:38:15.326950+0000","last_fullsized":"2023-06-09T04:38:15.326950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:34.050880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327078+0000","last_change":"2023-06-09T04:38:14.226716+0000","last_active":"2023-06-09T04:38:15.327078+0000","last_peered":"2023-06-09T04:38:15.327078+0000","last_clean":"2023-06-09T04:38:15.327078+0000","last_became_active":"2023-06-09T04:38:14.226405+0000","last_became_peered":"2023-06-09T04:38:14.226405+0000","last_unstale":"2023-06-09T04:38:15.327078+0000","last_undegraded":"2023-06-09T04:38:15.327078+0000","last_fullsized":"2023-06-09T04:38:15.327078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:52:57.969585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208394+0000","last_change":"2023-06-09T04:38:14.223351+0000","last_active":"2023-06-09T04:38:15.208394+0000","last_peered":"2023-06-09T04:38:15.208394+0000","last_clean":"2023-06-09T04:38:15.208394+0000","last_became_active":"2023-06-09T04:38:14.222701+0000","last_became_peered":"2023-06-09T04:38:14.222701+0000","last_unstale":"2023-06-09T04:38:15.208394+0000","last_undegraded":"2023-06-09T04:38:15.208394+0000","last_fullsized":"2023-06-09T04:38:15.208394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:55:04.398638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326748+0000","last_change":"2023-06-09T04:38:14.225260+0000","last_active":"2023-06-09T04:38:15.326748+0000","last_peered":"2023-06-09T04:38:15.326748+0000","last_clean":"2023-06-09T04:38:15.326748+0000","last_became_active":"2023-06-09T04:38:14.224956+0000","last_became_peered":"2023-06-09T04:38:14.224956+0000","last_unstale":"2023-06-09T04:38:15.326748+0000","last_undegraded":"2023-06-09T04:38:15.326748+0000","last_fullsized":"2023-06-09T04:38:15.326748+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:34:40.582269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213752+0000","last_change":"2023-06-09T04:38:14.218461+0000","last_active":"2023-06-09T04:38:15.213752+0000","last_peered":"2023-06-09T04:38:15.213752+0000","last_clean":"2023-06-09T04:38:15.213752+0000","last_became_active":"2023-06-09T04:38:14.217889+0000","last_became_peered":"2023-06-09T04:38:14.217889+0000","last_unstale":"2023-06-09T04:38:15.213752+0000","last_undegraded":"2023-06-09T04:38:15.213752+0000","last_fullsized":"2023-06-09T04:38:15.213752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:56.548396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326385+0000","last_change":"2023-06-09T04:38:14.220923+0000","last_active":"2023-06-09T04:38:15.326385+0000","last_peered":"2023-06-09T04:38:15.326385+0000","last_clean":"2023-06-09T04:38:15.326385+0000","last_became_active":"2023-06-09T04:38:14.220656+0000","last_became_peered":"2023-06-09T04:38:14.220656+0000","last_unstale":"2023-06-09T04:38:15.326385+0000","last_undegraded":"2023-06-09T04:38:15.326385+0000","last_fullsized":"2023-06-09T04:38:15.326385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:01:13.944005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327200+0000","last_change":"2023-06-09T04:38:13.822792+0000","last_active":"2023-06-09T04:38:15.327200+0000","last_peered":"2023-06-09T04:38:15.327200+0000","last_clean":"2023-06-09T04:38:15.327200+0000","last_became_active":"2023-06-09T04:38:13.822463+0000","last_became_peered":"2023-06-09T04:38:13.822463+0000","last_unstale":"2023-06-09T04:38:15.327200+0000","last_undegraded":"2023-06-09T04:38:15.327200+0000","last_fullsized":"2023-06-09T04:38:15.327200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:06.703007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213807+0000","last_change":"2023-06-09T04:38:14.220899+0000","last_active":"2023-06-09T04:38:15.213807+0000","last_peered":"2023-06-09T04:38:15.213807+0000","last_clean":"2023-06-09T04:38:15.213807+0000","last_became_active":"2023-06-09T04:38:14.220613+0000","last_became_peered":"2023-06-09T04:38:14.220613+0000","last_unstale":"2023-06-09T04:38:15.213807+0000","last_undegraded":"2023-06-09T04:38:15.213807+0000","last_fullsized":"2023-06-09T04:38:15.213807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:20.487302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327628+0000","last_change":"2023-06-09T04:38:13.816836+0000","last_active":"2023-06-09T04:38:15.327628+0000","last_peered":"2023-06-09T04:38:15.327628+0000","last_clean":"2023-06-09T04:38:15.327628+0000","last_became_active":"2023-06-09T04:38:13.816572+0000","last_became_peered":"2023-06-09T04:38:13.816572+0000","last_unstale":"2023-06-09T04:38:15.327628+0000","last_undegraded":"2023-06-09T04:38:15.327628+0000","last_fullsized":"2023-06-09T04:38:15.327628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:56.907445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326389+0000","last_change":"2023-06-09T04:38:14.233188+0000","last_active":"2023-06-09T04:38:15.326389+0000","last_peered":"2023-06-09T04:38:15.326389+0000","last_clean":"2023-06-09T04:38:15.326389+0000","last_became_active":"2023-06-09T04:38:14.232865+0000","last_became_peered":"2023-06-09T04:38:14.232865+0000","last_unstale":"2023-06-09T04:38:15.326389+0000","last_undegraded":"2023-06-09T04:38:15.326389+0000","last_fullsized":"2023-06-09T04:38:15.326389+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:40:39.277006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208809+0000","last_change":"2023-06-09T04:38:14.215329+0000","last_active":"2023-06-09T04:38:15.208809+0000","last_peered":"2023-06-09T04:38:15.208809+0000","last_clean":"2023-06-09T04:38:15.208809+0000","last_became_active":"2023-06-09T04:38:14.214919+0000","last_became_peered":"2023-06-09T04:38:14.214919+0000","last_unstale":"2023-06-09T04:38:15.208809+0000","last_undegraded":"2023-06-09T04:38:15.208809+0000","last_fullsized":"2023-06-09T04:38:15.208809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:28:10.442370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327319+0000","last_change":"2023-06-09T04:38:13.818828+0000","last_active":"2023-06-09T04:38:15.327319+0000","last_peered":"2023-06-09T04:38:15.327319+0000","last_clean":"2023-06-09T04:38:15.327319+0000","last_became_active":"2023-06-09T04:38:13.818544+0000","last_became_peered":"2023-06-09T04:38:13.818544+0000","last_unstale":"2023-06-09T04:38:15.327319+0000","last_undegraded":"2023-06-09T04:38:15.327319+0000","last_fullsized":"2023-06-09T04:38:15.327319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:00:58.445350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207945+0000","last_change":"2023-06-09T04:38:14.232997+0000","last_active":"2023-06-09T04:38:15.207945+0000","last_peered":"2023-06-09T04:38:15.207945+0000","last_clean":"2023-06-09T04:38:15.207945+0000","last_became_active":"2023-06-09T04:38:14.232787+0000","last_became_peered":"2023-06-09T04:38:14.232787+0000","last_unstale":"2023-06-09T04:38:15.207945+0000","last_undegraded":"2023-06-09T04:38:15.207945+0000","last_fullsized":"2023-06-09T04:38:15.207945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:34.091950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213785+0000","last_change":"2023-06-09T04:38:13.822939+0000","last_active":"2023-06-09T04:38:15.213785+0000","last_peered":"2023-06-09T04:38:15.213785+0000","last_clean":"2023-06-09T04:38:15.213785+0000","last_became_active":"2023-06-09T04:38:13.822620+0000","last_became_peered":"2023-06-09T04:38:13.822620+0000","last_unstale":"2023-06-09T04:38:15.213785+0000","last_undegraded":"2023-06-09T04:38:15.213785+0000","last_fullsized":"2023-06-09T04:38:15.213785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:33:16.582589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208061+0000","last_change":"2023-06-09T04:38:13.822316+0000","last_active":"2023-06-09T04:38:15.208061+0000","last_peered":"2023-06-09T04:38:15.208061+0000","last_clean":"2023-06-09T04:38:15.208061+0000","last_became_active":"2023-06-09T04:38:13.821655+0000","last_became_peered":"2023-06-09T04:38:13.821655+0000","last_unstale":"2023-06-09T04:38:15.208061+0000","last_undegraded":"2023-06-09T04:38:15.208061+0000","last_fullsized":"2023-06-09T04:38:15.208061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:01:51.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327323+0000","last_change":"2023-06-09T04:38:14.227311+0000","last_active":"2023-06-09T04:38:15.327323+0000","last_peered":"2023-06-09T04:38:15.327323+0000","last_clean":"2023-06-09T04:38:15.327323+0000","last_became_active":"2023-06-09T04:38:14.226927+0000","last_became_peered":"2023-06-09T04:38:14.226927+0000","last_unstale":"2023-06-09T04:38:15.327323+0000","last_undegraded":"2023-06-09T04:38:15.327323+0000","last_fullsized":"2023-06-09T04:38:15.327323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:14.509758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327157+0000","last_change":"2023-06-09T04:38:13.827429+0000","last_active":"2023-06-09T04:38:15.327157+0000","last_peered":"2023-06-09T04:38:15.327157+0000","last_clean":"2023-06-09T04:38:15.327157+0000","last_became_active":"2023-06-09T04:38:13.827139+0000","last_became_peered":"2023-06-09T04:38:13.827139+0000","last_unstale":"2023-06-09T04:38:15.327157+0000","last_undegraded":"2023-06-09T04:38:15.327157+0000","last_fullsized":"2023-06-09T04:38:15.327157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:03:35.407358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327707+0000","last_change":"2023-06-09T04:38:14.228460+0000","last_active":"2023-06-09T04:38:15.327707+0000","last_peered":"2023-06-09T04:38:15.327707+0000","last_clean":"2023-06-09T04:38:15.327707+0000","last_became_active":"2023-06-09T04:38:14.228145+0000","last_became_peered":"2023-06-09T04:38:14.228145+0000","last_unstale":"2023-06-09T04:38:15.327707+0000","last_undegraded":"2023-06-09T04:38:15.327707+0000","last_fullsized":"2023-06-09T04:38:15.327707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:12.180461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208692+0000","last_change":"2023-06-09T04:38:13.818534+0000","last_active":"2023-06-09T04:38:15.208692+0000","last_peered":"2023-06-09T04:38:15.208692+0000","last_clean":"2023-06-09T04:38:15.208692+0000","last_became_active":"2023-06-09T04:38:13.818285+0000","last_became_peered":"2023-06-09T04:38:13.818285+0000","last_unstale":"2023-06-09T04:38:15.208692+0000","last_undegraded":"2023-06-09T04:38:15.208692+0000","last_fullsized":"2023-06-09T04:38:15.208692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:28.865895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327902+0000","last_change":"2023-06-09T04:38:13.816346+0000","last_active":"2023-06-09T04:38:15.327902+0000","last_peered":"2023-06-09T04:38:15.327902+0000","last_clean":"2023-06-09T04:38:15.327902+0000","last_became_active":"2023-06-09T04:38:13.816080+0000","last_became_peered":"2023-06-09T04:38:13.816080+0000","last_unstale":"2023-06-09T04:38:15.327902+0000","last_undegraded":"2023-06-09T04:38:15.327902+0000","last_fullsized":"2023-06-09T04:38:15.327902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:28.269365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327802+0000","last_change":"2023-06-09T04:38:14.230223+0000","last_active":"2023-06-09T04:38:15.327802+0000","last_peered":"2023-06-09T04:38:15.327802+0000","last_clean":"2023-06-09T04:38:15.327802+0000","last_became_active":"2023-06-09T04:38:14.229949+0000","last_became_peered":"2023-06-09T04:38:14.229949+0000","last_unstale":"2023-06-09T04:38:15.327802+0000","last_undegraded":"2023-06-09T04:38:15.327802+0000","last_fullsized":"2023-06-09T04:38:15.327802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:30.029706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208492+0000","last_change":"2023-06-09T04:38:14.215150+0000","last_active":"2023-06-09T04:38:15.208492+0000","last_peered":"2023-06-09T04:38:15.208492+0000","last_clean":"2023-06-09T04:38:15.208492+0000","last_became_active":"2023-06-09T04:38:14.214597+0000","last_became_peered":"2023-06-09T04:38:14.214597+0000","last_unstale":"2023-06-09T04:38:15.208492+0000","last_undegraded":"2023-06-09T04:38:15.208492+0000","last_fullsized":"2023-06-09T04:38:15.208492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:57.913970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327477+0000","last_change":"2023-06-09T04:38:13.827254+0000","last_active":"2023-06-09T04:38:15.327477+0000","last_peered":"2023-06-09T04:38:15.327477+0000","last_clean":"2023-06-09T04:38:15.327477+0000","last_became_active":"2023-06-09T04:38:13.826934+0000","last_became_peered":"2023-06-09T04:38:13.826934+0000","last_unstale":"2023-06-09T04:38:15.327477+0000","last_undegraded":"2023-06-09T04:38:15.327477+0000","last_fullsized":"2023-06-09T04:38:15.327477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:55:37.494519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327194+0000","last_change":"2023-06-09T04:38:14.233031+0000","last_active":"2023-06-09T04:38:15.327194+0000","last_peered":"2023-06-09T04:38:15.327194+0000","last_clean":"2023-06-09T04:38:15.327194+0000","last_became_active":"2023-06-09T04:38:14.232765+0000","last_became_peered":"2023-06-09T04:38:14.232765+0000","last_unstale":"2023-06-09T04:38:15.327194+0000","last_undegraded":"2023-06-09T04:38:15.327194+0000","last_fullsized":"2023-06-09T04:38:15.327194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:58.075119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208186+0000","last_change":"2023-06-09T04:38:13.817334+0000","last_active":"2023-06-09T04:38:15.208186+0000","last_peered":"2023-06-09T04:38:15.208186+0000","last_clean":"2023-06-09T04:38:15.208186+0000","last_became_active":"2023-06-09T04:38:13.817054+0000","last_became_peered":"2023-06-09T04:38:13.817054+0000","last_unstale":"2023-06-09T04:38:15.208186+0000","last_undegraded":"2023-06-09T04:38:15.208186+0000","last_fullsized":"2023-06-09T04:38:15.208186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:25.344102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208351+0000","last_change":"2023-06-09T04:38:14.219735+0000","last_active":"2023-06-09T04:38:15.208351+0000","last_peered":"2023-06-09T04:38:15.208351+0000","last_clean":"2023-06-09T04:38:15.208351+0000","last_became_active":"2023-06-09T04:38:14.219461+0000","last_became_peered":"2023-06-09T04:38:14.219461+0000","last_unstale":"2023-06-09T04:38:15.208351+0000","last_undegraded":"2023-06-09T04:38:15.208351+0000","last_fullsized":"2023-06-09T04:38:15.208351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:22:20.054643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327466+0000","last_change":"2023-06-09T04:38:13.822228+0000","last_active":"2023-06-09T04:38:15.327466+0000","last_peered":"2023-06-09T04:38:15.327466+0000","last_clean":"2023-06-09T04:38:15.327466+0000","last_became_active":"2023-06-09T04:38:13.821892+0000","last_became_peered":"2023-06-09T04:38:13.821892+0000","last_unstale":"2023-06-09T04:38:15.327466+0000","last_undegraded":"2023-06-09T04:38:15.327466+0000","last_fullsized":"2023-06-09T04:38:15.327466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:58.650729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213991+0000","last_change":"2023-06-09T04:38:13.823175+0000","last_active":"2023-06-09T04:38:15.213991+0000","last_peered":"2023-06-09T04:38:15.213991+0000","last_clean":"2023-06-09T04:38:15.213991+0000","last_became_active":"2023-06-09T04:38:13.822770+0000","last_became_peered":"2023-06-09T04:38:13.822770+0000","last_unstale":"2023-06-09T04:38:15.213991+0000","last_undegraded":"2023-06-09T04:38:15.213991+0000","last_fullsized":"2023-06-09T04:38:15.213991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:40.015830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213679+0000","last_change":"2023-06-09T04:38:13.823484+0000","last_active":"2023-06-09T04:38:15.213679+0000","last_peered":"2023-06-09T04:38:15.213679+0000","last_clean":"2023-06-09T04:38:15.213679+0000","last_became_active":"2023-06-09T04:38:13.823185+0000","last_became_peered":"2023-06-09T04:38:13.823185+0000","last_unstale":"2023-06-09T04:38:15.213679+0000","last_undegraded":"2023-06-09T04:38:15.213679+0000","last_fullsized":"2023-06-09T04:38:15.213679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:43:38.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207944+0000","last_change":"2023-06-09T04:38:13.815168+0000","last_active":"2023-06-09T04:38:15.207944+0000","last_peered":"2023-06-09T04:38:15.207944+0000","last_clean":"2023-06-09T04:38:15.207944+0000","last_became_active":"2023-06-09T04:38:13.814903+0000","last_became_peered":"2023-06-09T04:38:13.814903+0000","last_unstale":"2023-06-09T04:38:15.207944+0000","last_undegraded":"2023-06-09T04:38:15.207944+0000","last_fullsized":"2023-06-09T04:38:15.207944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:12.751761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207992+0000","last_change":"2023-06-09T04:38:14.225694+0000","last_active":"2023-06-09T04:38:15.207992+0000","last_peered":"2023-06-09T04:38:15.207992+0000","last_clean":"2023-06-09T04:38:15.207992+0000","last_became_active":"2023-06-09T04:38:14.225450+0000","last_became_peered":"2023-06-09T04:38:14.225450+0000","last_unstale":"2023-06-09T04:38:15.207992+0000","last_undegraded":"2023-06-09T04:38:15.207992+0000","last_fullsized":"2023-06-09T04:38:15.207992+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:13.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326646+0000","last_change":"2023-06-09T04:38:13.827178+0000","last_active":"2023-06-09T04:38:15.326646+0000","last_peered":"2023-06-09T04:38:15.326646+0000","last_clean":"2023-06-09T04:38:15.326646+0000","last_became_active":"2023-06-09T04:38:13.826919+0000","last_became_peered":"2023-06-09T04:38:13.826919+0000","last_unstale":"2023-06-09T04:38:15.326646+0000","last_undegraded":"2023-06-09T04:38:15.326646+0000","last_fullsized":"2023-06-09T04:38:15.326646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:27.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326531+0000","last_change":"2023-06-09T04:38:13.823512+0000","last_active":"2023-06-09T04:38:15.326531+0000","last_peered":"2023-06-09T04:38:15.326531+0000","last_clean":"2023-06-09T04:38:15.326531+0000","last_became_active":"2023-06-09T04:38:13.822261+0000","last_became_peered":"2023-06-09T04:38:13.822261+0000","last_unstale":"2023-06-09T04:38:15.326531+0000","last_undegraded":"2023-06-09T04:38:15.326531+0000","last_fullsized":"2023-06-09T04:38:15.326531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:41.528256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326851+0000","last_change":"2023-06-09T04:36:47.621971+0000","last_active":"2023-06-09T04:38:15.326851+0000","last_peered":"2023-06-09T04:38:15.326851+0000","last_clean":"2023-06-09T04:38:15.326851+0000","last_became_active":"2023-06-09T04:36:47.621651+0000","last_became_peered":"2023-06-09T04:36:47.621651+0000","last_unstale":"2023-06-09T04:38:15.326851+0000","last_undegraded":"2023-06-09T04:38:15.326851+0000","last_fullsized":"2023-06-09T04:38:15.326851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:13:43.956926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327483+0000","last_change":"2023-06-09T04:38:13.815542+0000","last_active":"2023-06-09T04:38:15.327483+0000","last_peered":"2023-06-09T04:38:15.327483+0000","last_clean":"2023-06-09T04:38:15.327483+0000","last_became_active":"2023-06-09T04:38:13.815106+0000","last_became_peered":"2023-06-09T04:38:13.815106+0000","last_unstale":"2023-06-09T04:38:15.327483+0000","last_undegraded":"2023-06-09T04:38:15.327483+0000","last_fullsized":"2023-06-09T04:38:15.327483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:22:19.048119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:38:07.982776+0000","last_change":"2023-06-09T04:36:47.613976+0000","last_active":"2023-06-09T04:38:07.982776+0000","last_peered":"2023-06-09T04:38:07.982776+0000","last_clean":"2023-06-09T04:38:07.982776+0000","last_became_active":"2023-06-09T04:36:47.613691+0000","last_became_peered":"2023-06-09T04:36:47.613691+0000","last_unstale":"2023-06-09T04:38:07.982776+0000","last_undegraded":"2023-06-09T04:38:07.982776+0000","last_fullsized":"2023-06-09T04:38:07.982776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:09:48.469607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327879+0000","last_change":"2023-06-09T04:38:14.224268+0000","last_active":"2023-06-09T04:38:15.327879+0000","last_peered":"2023-06-09T04:38:15.327879+0000","last_clean":"2023-06-09T04:38:15.327879+0000","last_became_active":"2023-06-09T04:38:14.223887+0000","last_became_peered":"2023-06-09T04:38:14.223887+0000","last_unstale":"2023-06-09T04:38:15.327879+0000","last_undegraded":"2023-06-09T04:38:15.327879+0000","last_fullsized":"2023-06-09T04:38:15.327879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:28:10.442370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:38:08.490529+0000","last_change":"2023-06-09T04:36:47.626414+0000","last_active":"2023-06-09T04:38:08.490529+0000","last_peered":"2023-06-09T04:38:08.490529+0000","last_clean":"2023-06-09T04:38:08.490529+0000","last_became_active":"2023-06-09T04:36:47.626166+0000","last_became_peered":"2023-06-09T04:36:47.626166+0000","last_unstale":"2023-06-09T04:38:08.490529+0000","last_undegraded":"2023-06-09T04:38:08.490529+0000","last_fullsized":"2023-06-09T04:38:08.490529+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:55:17.350504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":197,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326764+0000","last_change":"2023-06-09T04:36:47.627673+0000","last_active":"2023-06-09T04:38:15.326764+0000","last_peered":"2023-06-09T04:38:15.326764+0000","last_clean":"2023-06-09T04:38:15.326764+0000","last_became_active":"2023-06-09T04:36:47.626658+0000","last_became_peered":"2023-06-09T04:36:47.626658+0000","last_unstale":"2023-06-09T04:38:15.326764+0000","last_undegraded":"2023-06-09T04:38:15.326764+0000","last_fullsized":"2023-06-09T04:38:15.326764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:10:59.159223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208265+0000","last_change":"2023-06-09T04:38:14.221698+0000","last_active":"2023-06-09T04:38:15.208265+0000","last_peered":"2023-06-09T04:38:15.208265+0000","last_clean":"2023-06-09T04:38:15.208265+0000","last_became_active":"2023-06-09T04:38:14.221452+0000","last_became_peered":"2023-06-09T04:38:14.221452+0000","last_unstale":"2023-06-09T04:38:15.208265+0000","last_undegraded":"2023-06-09T04:38:15.208265+0000","last_fullsized":"2023-06-09T04:38:15.208265+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:55:38.501043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.328014+0000","last_change":"2023-06-09T04:38:13.822382+0000","last_active":"2023-06-09T04:38:15.328014+0000","last_peered":"2023-06-09T04:38:15.328014+0000","last_clean":"2023-06-09T04:38:15.328014+0000","last_became_active":"2023-06-09T04:38:13.822065+0000","last_became_peered":"2023-06-09T04:38:13.822065+0000","last_unstale":"2023-06-09T04:38:15.328014+0000","last_undegraded":"2023-06-09T04:38:15.328014+0000","last_fullsized":"2023-06-09T04:38:15.328014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:27:56.878816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327454+0000","last_change":"2023-06-09T04:36:47.618577+0000","last_active":"2023-06-09T04:38:15.327454+0000","last_peered":"2023-06-09T04:38:15.327454+0000","last_clean":"2023-06-09T04:38:15.327454+0000","last_became_active":"2023-06-09T04:36:47.618339+0000","last_became_peered":"2023-06-09T04:36:47.618339+0000","last_unstale":"2023-06-09T04:38:15.327454+0000","last_undegraded":"2023-06-09T04:38:15.327454+0000","last_fullsized":"2023-06-09T04:38:15.327454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:31:05.308029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208603+0000","last_change":"2023-06-09T04:38:14.220810+0000","last_active":"2023-06-09T04:38:15.208603+0000","last_peered":"2023-06-09T04:38:15.208603+0000","last_clean":"2023-06-09T04:38:15.208603+0000","last_became_active":"2023-06-09T04:38:14.220550+0000","last_became_peered":"2023-06-09T04:38:14.220550+0000","last_unstale":"2023-06-09T04:38:15.208603+0000","last_undegraded":"2023-06-09T04:38:15.208603+0000","last_fullsized":"2023-06-09T04:38:15.208603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:30.029706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.214161+0000","last_change":"2023-06-09T04:38:13.822583+0000","last_active":"2023-06-09T04:38:15.214161+0000","last_peered":"2023-06-09T04:38:15.214161+0000","last_clean":"2023-06-09T04:38:15.214161+0000","last_became_active":"2023-06-09T04:38:13.822254+0000","last_became_peered":"2023-06-09T04:38:13.822254+0000","last_unstale":"2023-06-09T04:38:15.214161+0000","last_undegraded":"2023-06-09T04:38:15.214161+0000","last_fullsized":"2023-06-09T04:38:15.214161+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:33.085426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327694+0000","last_change":"2023-06-09T04:36:47.618679+0000","last_active":"2023-06-09T04:38:15.327694+0000","last_peered":"2023-06-09T04:38:15.327694+0000","last_clean":"2023-06-09T04:38:15.327694+0000","last_became_active":"2023-06-09T04:36:47.618391+0000","last_became_peered":"2023-06-09T04:36:47.618391+0000","last_unstale":"2023-06-09T04:38:15.327694+0000","last_undegraded":"2023-06-09T04:38:15.327694+0000","last_fullsized":"2023-06-09T04:38:15.327694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:43.237470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:13.790366+0000","last_change":"2023-06-09T04:38:13.790366+0000","last_active":"2023-06-09T04:38:13.790366+0000","last_peered":"2023-06-09T04:38:13.790366+0000","last_clean":"2023-06-09T04:38:13.790366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:13.790366+0000","last_undegraded":"2023-06-09T04:38:13.790366+0000","last_fullsized":"2023-06-09T04:38:13.790366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213632+0000","last_change":"2023-06-09T04:36:47.616483+0000","last_active":"2023-06-09T04:38:15.213632+0000","last_peered":"2023-06-09T04:38:15.213632+0000","last_clean":"2023-06-09T04:38:15.213632+0000","last_became_active":"2023-06-09T04:36:47.616149+0000","last_became_peered":"2023-06-09T04:36:47.616149+0000","last_unstale":"2023-06-09T04:38:15.213632+0000","last_undegraded":"2023-06-09T04:38:15.213632+0000","last_fullsized":"2023-06-09T04:38:15.213632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:56.417832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213609+0000","last_change":"2023-06-09T04:38:14.220245+0000","last_active":"2023-06-09T04:38:15.213609+0000","last_peered":"2023-06-09T04:38:15.213609+0000","last_clean":"2023-06-09T04:38:15.213609+0000","last_became_active":"2023-06-09T04:38:14.219974+0000","last_became_peered":"2023-06-09T04:38:14.219974+0000","last_unstale":"2023-06-09T04:38:15.213609+0000","last_undegraded":"2023-06-09T04:38:15.213609+0000","last_fullsized":"2023-06-09T04:38:15.213609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:03.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-06-09T04:38:12.783842+0000","last_change":"2023-06-09T04:38:12.783842+0000","last_active":"2023-06-09T04:38:12.783842+0000","last_peered":"2023-06-09T04:38:12.783842+0000","last_clean":"2023-06-09T04:38:12.783842+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-06-09T04:38:12.783842+0000","last_undegraded":"2023-06-09T04:38:12.783842+0000","last_fullsized":"2023-06-09T04:38:12.783842+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:38:07.986503+0000","last_change":"2023-06-09T04:36:47.616467+0000","last_active":"2023-06-09T04:38:07.986503+0000","last_peered":"2023-06-09T04:38:07.986503+0000","last_clean":"2023-06-09T04:38:07.986503+0000","last_became_active":"2023-06-09T04:36:47.616166+0000","last_became_peered":"2023-06-09T04:36:47.616166+0000","last_unstale":"2023-06-09T04:38:07.986503+0000","last_undegraded":"2023-06-09T04:38:07.986503+0000","last_fullsized":"2023-06-09T04:38:07.986503+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:00:10.232195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326323+0000","last_change":"2023-06-09T04:38:14.227672+0000","last_active":"2023-06-09T04:38:15.326323+0000","last_peered":"2023-06-09T04:38:15.326323+0000","last_clean":"2023-06-09T04:38:15.326323+0000","last_became_active":"2023-06-09T04:38:14.227404+0000","last_became_peered":"2023-06-09T04:38:14.227404+0000","last_unstale":"2023-06-09T04:38:15.326323+0000","last_undegraded":"2023-06-09T04:38:15.326323+0000","last_fullsized":"2023-06-09T04:38:15.326323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:10.559738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208152+0000","last_change":"2023-06-09T04:38:13.819212+0000","last_active":"2023-06-09T04:38:15.208152+0000","last_peered":"2023-06-09T04:38:15.208152+0000","last_clean":"2023-06-09T04:38:15.208152+0000","last_became_active":"2023-06-09T04:38:13.819001+0000","last_became_peered":"2023-06-09T04:38:13.819001+0000","last_unstale":"2023-06-09T04:38:15.208152+0000","last_undegraded":"2023-06-09T04:38:15.208152+0000","last_fullsized":"2023-06-09T04:38:15.208152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:04:43.205470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-06-09T04:38:07.986795+0000","last_change":"2023-06-09T04:36:47.613658+0000","last_active":"2023-06-09T04:38:07.986795+0000","last_peered":"2023-06-09T04:38:07.986795+0000","last_clean":"2023-06-09T04:38:07.986795+0000","last_became_active":"2023-06-09T04:36:47.613327+0000","last_became_peered":"2023-06-09T04:36:47.613327+0000","last_unstale":"2023-06-09T04:38:07.986795+0000","last_undegraded":"2023-06-09T04:38:07.986795+0000","last_fullsized":"2023-06-09T04:38:07.986795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:55:04.697659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":40,"acting":40,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":181217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.441},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.504}]},{"osd":4,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.622}]},{"osd":5,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":12.042999999999999,"5min":12.042999999999999,"15min":12.042999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":15.029,"5min":15.029,"15min":15.029},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.66800000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":182378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.25800000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":17.577000000000002,"5min":17.577000000000002,"15min":17.577000000000002},"last":0.23999999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":0.317},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.35599999999999998}]},{"osd":4,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":12.515000000000001,"5min":12.515000000000001,"15min":12.515000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":4.4290000000000003,"5min":4.4290000000000003,"15min":4.4290000000000003},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.54700000000000004},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":12.451000000000001,"5min":12.451000000000001,"15min":12.451000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.4950000000000001,"5min":4.4950000000000001,"15min":4.4950000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.8019999999999996,"5min":4.8019999999999996,"15min":4.8019999999999996},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.548,"5min":12.548,"15min":12.548},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.59299999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":204820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.2279999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.1509999999999998,"5min":5.1509999999999998,"15min":5.1509999999999998},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.2960000000000003,"5min":5.2960000000000003,"15min":5.2960000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.505},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.37}]},{"osd":6,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.47199999999999998}]},{"osd":7,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45100000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":203290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.25},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.378}]},{"osd":3,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68700000000000006}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":1052672,"data_stored":793714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.495}]},{"osd":4,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.40799999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":210299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.63},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.502},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Jun 9 04:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jun 9 04:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.75700000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":1011712,"data_stored":772746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.372},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.71199999999999997}]},{"osd":6,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.753}]},{"osd":7,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67100000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":408,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":417792,"data_stored":182378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.27200000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.31}]},{"osd":4,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.495}]},{"osd":5,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.505},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.434}]},{"osd":6,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.442}]},{"osd":7,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.48499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:18.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:38:18.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.450+0000 7f4186fe6700 1 Processor -- start 2023-06-09T04:38:18.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.450+0000 7f4186fe6700 1 -- start start 2023-06-09T04:38:18.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.450+0000 7f4186fe6700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41800ceab0 0x7f41800cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.450+0000 7f4186fe6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800cd770 con 0x7f418015a6a0 2023-06-09T04:38:18.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.450+0000 7f4186fe6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180158100 con 0x7f4180157d30 2023-06-09T04:38:18.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f4186fe6700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418015b2d0 con 0x7f41800ceab0 2023-06-09T04:38:18.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f4185583700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f418015a6a0 0x7f418015aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34194/0 (socket says 172.21.15.149:34194) 2023-06-09T04:38:18.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417ffff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f41800ceab0 0x7f41800cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f4185583700 1 -- 172.21.15.149:0/1201905857 learned_addr learned my addr 172.21.15.149:0/1201905857 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:18.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417f7fe700 1 -- 172.21.15.149:0/1201905857 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475272145 0 0) 0x7f41800cd770 con 0x7f418015a6a0 2023-06-09T04:38:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417f7fe700 1 -- 172.21.15.149:0/1201905857 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41700035b0 con 0x7f418015a6a0 2023-06-09T04:38:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417ffff700 1 -- 172.21.15.149:0/1201905857 >> v1:172.21.15.184:6789/0 conn(0x7f4180157d30 legacy=0x7f41800ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417ffff700 1 -- 172.21.15.149:0/1201905857 >> v1:172.21.15.149:6789/0 conn(0x7f418015a6a0 legacy=0x7f418015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417ffff700 1 -- 172.21.15.149:0/1201905857 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418015b5b0 con 0x7f41800ceab0 2023-06-09T04:38:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417ffff700 1 --2- 172.21.15.149:0/1201905857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f41800cdc00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f416c009840 tx=0x7f416c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188d56cd6c469abd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417f7fe700 1 -- 172.21.15.149:0/1201905857 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c011830 con 0x7f41800ceab0 2023-06-09T04:38:18.454 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417f7fe700 1 -- 172.21.15.149:0/1201905857 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c011990 con 0x7f41800ceab0 2023-06-09T04:38:18.455 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.451+0000 7f417f7fe700 1 -- 172.21.15.149:0/1201905857 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c011d20 con 0x7f41800ceab0 2023-06-09T04:38:18.457 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.452+0000 7f4186fe6700 1 -- 172.21.15.149:0/1201905857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 msgr2=0x7f41800cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.452+0000 7f4186fe6700 1 --2- 172.21.15.149:0/1201905857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f41800cdc00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f416c009840 tx=0x7f416c009b50 comp rx=0 tx=0).stop 2023-06-09T04:38:18.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.452+0000 7f4186fe6700 1 -- 172.21.15.149:0/1201905857 shutdown_connections 2023-06-09T04:38:18.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.452+0000 7f4186fe6700 1 --2- 172.21.15.149:0/1201905857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f41800cdc00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.452+0000 7f4186fe6700 1 -- 172.21.15.149:0/1201905857 >> 172.21.15.149:0/1201905857 conn(0x7f418006a6d0 msgr2=0x7f4180099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.452+0000 7f4186fe6700 1 -- 172.21.15.149:0/1201905857 shutdown_connections 2023-06-09T04:38:18.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.452+0000 7f4186fe6700 1 -- 172.21.15.149:0/1201905857 wait complete. 2023-06-09T04:38:18.458 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.453+0000 7f4186fe6700 1 Processor -- start 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.453+0000 7f4186fe6700 1 -- start start 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4186fe6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f4180151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4186fe6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4180157d30 0x7f41800c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4186fe6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f418015a6a0 0x7f41800cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4186fe6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180152150 con 0x7f41800ceab0 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4186fe6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c5c80 con 0x7f4180157d30 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4186fe6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c5f60 con 0x7f418015a6a0 2023-06-09T04:38:18.459 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f4180151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f4180151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38564/0 (socket says 172.21.15.149:38564) 2023-06-09T04:38:18.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 -- 172.21.15.149:0/126697928 learned_addr learned my addr 172.21.15.149:0/126697928 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:18.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f417ffff700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4180157d30 0x7f41800c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4185583700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f418015a6a0 0x7f41800cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 -- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f418015a6a0 msgr2=0x7f41800cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f418015a6a0 0x7f41800cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.460 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 -- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4180157d30 msgr2=0x7f41800c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4180157d30 0x7f41800c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 -- 172.21.15.149:0/126697928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c0094a0 con 0x7f41800ceab0 2023-06-09T04:38:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f417ffff700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4180157d30 0x7f41800c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4185583700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f418015a6a0 0x7f41800cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.454+0000 7f4184d82700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f4180151c10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f417400c4d0 tx=0x7f417400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.455+0000 7f417d7fa700 1 -- 172.21.15.149:0/126697928 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740052d0 con 0x7f41800ceab0 2023-06-09T04:38:18.461 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.455+0000 7f417d7fa700 1 -- 172.21.15.149:0/126697928 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174005430 con 0x7f41800ceab0 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.455+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41800c6240 con 0x7f41800ceab0 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.455+0000 7f417d7fa700 1 -- 172.21.15.149:0/126697928 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740038f0 con 0x7f41800ceab0 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.455+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41800c6800 con 0x7f41800ceab0 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.456+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800c6990 con 0x7f41800ceab0 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.456+0000 7f417d7fa700 1 -- 172.21.15.149:0/126697928 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4174003a50 con 0x7f41800ceab0 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.456+0000 7f417d7fa700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f416406ace0 0x7f416406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.456+0000 7f417d7fa700 1 -- 172.21.15.149:0/126697928 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4174088aa0 con 0x7f41800ceab0 2023-06-09T04:38:18.462 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.456+0000 7f417ffff700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f416406ace0 0x7f416406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.457+0000 7f417ffff700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f416406ace0 0x7f416406d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41800cdb00 tx=0x7f416c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.463 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.461+0000 7f417d7fa700 1 -- 172.21.15.149:0/126697928 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4174053aa0 con 0x7f41800ceab0 2023-06-09T04:38:18.645 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.644+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 --> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41800cd400 con 0x7f416406ace0 2023-06-09T04:38:18.653 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.652+0000 7f417d7fa700 1 -- 172.21.15.149:0/126697928 <== mgr.4101 v2:172.21.15.149:6832/2920572545 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311664 (secure 0 0 0) 0x7f416c011b00 con 0x7f416406ace0 2023-06-09T04:38:18.657 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:18.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.655+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f416406ace0 msgr2=0x7f416406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.655+0000 7f4186fe6700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f416406ace0 0x7f416406d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41800cdb00 tx=0x7f416c008030 comp rx=0 tx=0).stop 2023-06-09T04:38:18.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.655+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 msgr2=0x7f4180151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.655+0000 7f4186fe6700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f4180151c10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f417400c4d0 tx=0x7f417400c890 comp rx=0 tx=0).stop 2023-06-09T04:38:18.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 shutdown_connections 2023-06-09T04:38:18.659 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f416406ace0 0x7f416406d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f418015a6a0 0x7f41800cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41800ceab0 0x7f4180151c10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 --2- 172.21.15.149:0/126697928 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4180157d30 0x7f41800c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 >> 172.21.15.149:0/126697928 conn(0x7f418006a6d0 msgr2=0x7f4180099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 shutdown_connections 2023-06-09T04:38:18.660 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.656+0000 7f4186fe6700 1 -- 172.21.15.149:0/126697928 wait complete. 2023-06-09T04:38:18.660 INFO:teuthology.orchestra.run.smithi149.stderr:dumped all 2023-06-09T04:38:18.669 INFO:teuthology.orchestra.run.smithi149.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-06-09T04:38:18.410038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":133,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220448,"kb_used_data":4832,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754272,"statfs":{"total":773094113280,"available":772868374528,"internally_reserved":0,"allocated":4947968,"data_stored":2845212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.617158"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327599+0000","last_change":"2023-06-09T04:38:14.224928+0000","last_active":"2023-06-09T04:38:15.327599+0000","last_peered":"2023-06-09T04:38:15.327599+0000","last_clean":"2023-06-09T04:38:15.327599+0000","last_became_active":"2023-06-09T04:38:14.224657+0000","last_became_peered":"2023-06-09T04:38:14.224657+0000","last_unstale":"2023-06-09T04:38:15.327599+0000","last_undegraded":"2023-06-09T04:38:15.327599+0000","last_fullsized":"2023-06-09T04:38:15.327599+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:55:04.398638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.214111+0000","last_change":"2023-06-09T04:38:14.212010+0000","last_active":"2023-06-09T04:38:15.214111+0000","last_peered":"2023-06-09T04:38:15.214111+0000","last_clean":"2023-06-09T04:38:15.214111+0000","last_became_active":"2023-06-09T04:38:14.211712+0000","last_became_peered":"2023-06-09T04:38:14.211712+0000","last_unstale":"2023-06-09T04:38:15.214111+0000","last_undegraded":"2023-06-09T04:38:15.214111+0000","last_fullsized":"2023-06-09T04:38:15.214111+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:13.758285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326600+0000","last_change":"2023-06-09T04:38:14.226048+0000","last_active":"2023-06-09T04:38:15.326600+0000","last_peered":"2023-06-09T04:38:15.326600+0000","last_clean":"2023-06-09T04:38:15.326600+0000","last_became_active":"2023-06-09T04:38:14.225805+0000","last_became_peered":"2023-06-09T04:38:14.225805+0000","last_unstale":"2023-06-09T04:38:15.326600+0000","last_undegraded":"2023-06-09T04:38:15.326600+0000","last_fullsized":"2023-06-09T04:38:15.326600+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:15.877773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208147+0000","last_change":"2023-06-09T04:38:14.223980+0000","last_active":"2023-06-09T04:38:15.208147+0000","last_peered":"2023-06-09T04:38:15.208147+0000","last_clean":"2023-06-09T04:38:15.208147+0000","last_became_active":"2023-06-09T04:38:14.222633+0000","last_became_peered":"2023-06-09T04:38:14.222633+0000","last_unstale":"2023-06-09T04:38:15.208147+0000","last_undegraded":"2023-06-09T04:38:15.208147+0000","last_fullsized":"2023-06-09T04:38:15.208147+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:28.597417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213822+0000","last_change":"2023-06-09T04:38:14.212375+0000","last_active":"2023-06-09T04:38:15.213822+0000","last_peered":"2023-06-09T04:38:15.213822+0000","last_clean":"2023-06-09T04:38:15.213822+0000","last_became_active":"2023-06-09T04:38:14.211418+0000","last_became_peered":"2023-06-09T04:38:14.211418+0000","last_unstale":"2023-06-09T04:38:15.213822+0000","last_undegraded":"2023-06-09T04:38:15.213822+0000","last_fullsized":"2023-06-09T04:38:15.213822+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:50:17.969366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210874+0000","last_change":"2023-06-09T04:38:14.219442+0000","last_active":"2023-06-09T04:38:15.210874+0000","last_peered":"2023-06-09T04:38:15.210874+0000","last_clean":"2023-06-09T04:38:15.210874+0000","last_became_active":"2023-06-09T04:38:14.219166+0000","last_became_peered":"2023-06-09T04:38:14.219166+0000","last_unstale":"2023-06-09T04:38:15.210874+0000","last_undegraded":"2023-06-09T04:38:15.210874+0000","last_fullsized":"2023-06-09T04:38:15.210874+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:52:13.797917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327844+0000","last_change":"2023-06-09T04:38:14.230063+0000","last_active":"2023-06-09T04:38:15.327844+0000","last_peered":"2023-06-09T04:38:15.327844+0000","last_clean":"2023-06-09T04:38:15.327844+0000","last_became_active":"2023-06-09T04:38:14.229740+0000","last_became_peered":"2023-06-09T04:38:14.229740+0000","last_unstale":"2023-06-09T04:38:15.327844+0000","last_undegraded":"2023-06-09T04:38:15.327844+0000","last_fullsized":"2023-06-09T04:38:15.327844+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:29.872419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207999+0000","last_change":"2023-06-09T04:38:14.225811+0000","last_active":"2023-06-09T04:38:15.207999+0000","last_peered":"2023-06-09T04:38:15.207999+0000","last_clean":"2023-06-09T04:38:15.207999+0000","last_became_active":"2023-06-09T04:38:14.225427+0000","last_became_peered":"2023-06-09T04:38:14.225427+0000","last_unstale":"2023-06-09T04:38:15.207999+0000","last_undegraded":"2023-06-09T04:38:15.207999+0000","last_fullsized":"2023-06-09T04:38:15.207999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:41.022354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208394+0000","last_change":"2023-06-09T04:38:14.217404+0000","last_active":"2023-06-09T04:38:15.208394+0000","last_peered":"2023-06-09T04:38:15.208394+0000","last_clean":"2023-06-09T04:38:15.208394+0000","last_became_active":"2023-06-09T04:38:14.217141+0000","last_became_peered":"2023-06-09T04:38:14.217141+0000","last_unstale":"2023-06-09T04:38:15.208394+0000","last_undegraded":"2023-06-09T04:38:15.208394+0000","last_fullsized":"2023-06-09T04:38:15.208394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:32:32.499432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208525+0000","last_change":"2023-06-09T04:38:14.223796+0000","last_active":"2023-06-09T04:38:15.208525+0000","last_peered":"2023-06-09T04:38:15.208525+0000","last_clean":"2023-06-09T04:38:15.208525+0000","last_became_active":"2023-06-09T04:38:14.223493+0000","last_became_peered":"2023-06-09T04:38:14.223493+0000","last_unstale":"2023-06-09T04:38:15.208525+0000","last_undegraded":"2023-06-09T04:38:15.208525+0000","last_fullsized":"2023-06-09T04:38:15.208525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:12.180461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208558+0000","last_change":"2023-06-09T04:38:14.217442+0000","last_active":"2023-06-09T04:38:15.208558+0000","last_peered":"2023-06-09T04:38:15.208558+0000","last_clean":"2023-06-09T04:38:15.208558+0000","last_became_active":"2023-06-09T04:38:14.217179+0000","last_became_peered":"2023-06-09T04:38:14.217179+0000","last_unstale":"2023-06-09T04:38:15.208558+0000","last_undegraded":"2023-06-09T04:38:15.208558+0000","last_fullsized":"2023-06-09T04:38:15.208558+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:49:10.428874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213984+0000","last_change":"2023-06-09T04:38:14.218654+0000","last_active":"2023-06-09T04:38:15.213984+0000","last_peered":"2023-06-09T04:38:15.213984+0000","last_clean":"2023-06-09T04:38:15.213984+0000","last_became_active":"2023-06-09T04:38:14.218223+0000","last_became_peered":"2023-06-09T04:38:14.218223+0000","last_unstale":"2023-06-09T04:38:15.213984+0000","last_undegraded":"2023-06-09T04:38:15.213984+0000","last_fullsized":"2023-06-09T04:38:15.213984+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:35:40.264006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326116+0000","last_change":"2023-06-09T04:38:14.225843+0000","last_active":"2023-06-09T04:38:15.326116+0000","last_peered":"2023-06-09T04:38:15.326116+0000","last_clean":"2023-06-09T04:38:15.326116+0000","last_became_active":"2023-06-09T04:38:14.225557+0000","last_became_peered":"2023-06-09T04:38:14.225557+0000","last_unstale":"2023-06-09T04:38:15.326116+0000","last_undegraded":"2023-06-09T04:38:15.326116+0000","last_fullsized":"2023-06-09T04:38:15.326116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:48:45.369677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208229+0000","last_change":"2023-06-09T04:38:14.216608+0000","last_active":"2023-06-09T04:38:15.208229+0000","last_peered":"2023-06-09T04:38:15.208229+0000","last_clean":"2023-06-09T04:38:15.208229+0000","last_became_active":"2023-06-09T04:38:14.216338+0000","last_became_peered":"2023-06-09T04:38:14.216338+0000","last_unstale":"2023-06-09T04:38:15.208229+0000","last_undegraded":"2023-06-09T04:38:15.208229+0000","last_fullsized":"2023-06-09T04:38:15.208229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:58.075119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210775+0000","last_change":"2023-06-09T04:38:14.223007+0000","last_active":"2023-06-09T04:38:15.210775+0000","last_peered":"2023-06-09T04:38:15.210775+0000","last_clean":"2023-06-09T04:38:15.210775+0000","last_became_active":"2023-06-09T04:38:14.222011+0000","last_became_peered":"2023-06-09T04:38:14.222011+0000","last_unstale":"2023-06-09T04:38:15.210775+0000","last_undegraded":"2023-06-09T04:38:15.210775+0000","last_fullsized":"2023-06-09T04:38:15.210775+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:16:00.329527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326773+0000","last_change":"2023-06-09T04:38:14.222946+0000","last_active":"2023-06-09T04:38:15.326773+0000","last_peered":"2023-06-09T04:38:15.326773+0000","last_clean":"2023-06-09T04:38:15.326773+0000","last_became_active":"2023-06-09T04:38:14.222680+0000","last_became_peered":"2023-06-09T04:38:14.222680+0000","last_unstale":"2023-06-09T04:38:15.326773+0000","last_undegraded":"2023-06-09T04:38:15.326773+0000","last_fullsized":"2023-06-09T04:38:15.326773+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:56:11.134855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326950+0000","last_change":"2023-06-09T04:38:14.227304+0000","last_active":"2023-06-09T04:38:15.326950+0000","last_peered":"2023-06-09T04:38:15.326950+0000","last_clean":"2023-06-09T04:38:15.326950+0000","last_became_active":"2023-06-09T04:38:14.227053+0000","last_became_peered":"2023-06-09T04:38:14.227053+0000","last_unstale":"2023-06-09T04:38:15.326950+0000","last_undegraded":"2023-06-09T04:38:15.326950+0000","last_fullsized":"2023-06-09T04:38:15.326950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:36:34.050880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327078+0000","last_change":"2023-06-09T04:38:14.226716+0000","last_active":"2023-06-09T04:38:15.327078+0000","last_peered":"2023-06-09T04:38:15.327078+0000","last_clean":"2023-06-09T04:38:15.327078+0000","last_became_active":"2023-06-09T04:38:14.226405+0000","last_became_peered":"2023-06-09T04:38:14.226405+0000","last_unstale":"2023-06-09T04:38:15.327078+0000","last_undegraded":"2023-06-09T04:38:15.327078+0000","last_fullsized":"2023-06-09T04:38:15.327078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:52:57.969585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327533+0000","last_change":"2023-06-09T04:38:14.223712+0000","last_active":"2023-06-09T04:38:15.327533+0000","last_peered":"2023-06-09T04:38:15.327533+0000","last_clean":"2023-06-09T04:38:15.327533+0000","last_became_active":"2023-06-09T04:38:14.223443+0000","last_became_peered":"2023-06-09T04:38:14.223443+0000","last_unstale":"2023-06-09T04:38:15.327533+0000","last_undegraded":"2023-06-09T04:38:15.327533+0000","last_fullsized":"2023-06-09T04:38:15.327533+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:03:37.058836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326290+0000","last_change":"2023-06-09T04:38:14.227927+0000","last_active":"2023-06-09T04:38:15.326290+0000","last_peered":"2023-06-09T04:38:15.326290+0000","last_clean":"2023-06-09T04:38:15.326290+0000","last_became_active":"2023-06-09T04:38:14.227688+0000","last_became_peered":"2023-06-09T04:38:14.227688+0000","last_unstale":"2023-06-09T04:38:15.326290+0000","last_undegraded":"2023-06-09T04:38:15.326290+0000","last_fullsized":"2023-06-09T04:38:15.326290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:12:42.749909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210990+0000","last_change":"2023-06-09T04:38:14.222338+0000","last_active":"2023-06-09T04:38:15.210990+0000","last_peered":"2023-06-09T04:38:15.210990+0000","last_clean":"2023-06-09T04:38:15.210990+0000","last_became_active":"2023-06-09T04:38:14.222104+0000","last_became_peered":"2023-06-09T04:38:14.222104+0000","last_unstale":"2023-06-09T04:38:15.210990+0000","last_undegraded":"2023-06-09T04:38:15.210990+0000","last_fullsized":"2023-06-09T04:38:15.210990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:51:52.765503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208394+0000","last_change":"2023-06-09T04:38:14.223351+0000","last_active":"2023-06-09T04:38:15.208394+0000","last_peered":"2023-06-09T04:38:15.208394+0000","last_clean":"2023-06-09T04:38:15.208394+0000","last_became_active":"2023-06-09T04:38:14.222701+0000","last_became_peered":"2023-06-09T04:38:14.222701+0000","last_unstale":"2023-06-09T04:38:15.208394+0000","last_undegraded":"2023-06-09T04:38:15.208394+0000","last_fullsized":"2023-06-09T04:38:15.208394+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:55:04.398638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326940+0000","last_change":"2023-06-09T04:38:14.224272+0000","last_active":"2023-06-09T04:38:15.326940+0000","last_peered":"2023-06-09T04:38:15.326940+0000","last_clean":"2023-06-09T04:38:15.326940+0000","last_became_active":"2023-06-09T04:38:14.224019+0000","last_became_peered":"2023-06-09T04:38:14.224019+0000","last_unstale":"2023-06-09T04:38:15.326940+0000","last_undegraded":"2023-06-09T04:38:15.326940+0000","last_fullsized":"2023-06-09T04:38:15.326940+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:42:36.178360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326843+0000","last_change":"2023-06-09T04:38:14.220607+0000","last_active":"2023-06-09T04:38:15.326843+0000","last_peered":"2023-06-09T04:38:15.326843+0000","last_clean":"2023-06-09T04:38:15.326843+0000","last_became_active":"2023-06-09T04:38:14.220324+0000","last_became_peered":"2023-06-09T04:38:14.220324+0000","last_unstale":"2023-06-09T04:38:15.326843+0000","last_undegraded":"2023-06-09T04:38:15.326843+0000","last_fullsized":"2023-06-09T04:38:15.326843+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:55:11.760771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327835+0000","last_change":"2023-06-09T04:38:14.227497+0000","last_active":"2023-06-09T04:38:15.327835+0000","last_peered":"2023-06-09T04:38:15.327835+0000","last_clean":"2023-06-09T04:38:15.327835+0000","last_became_active":"2023-06-09T04:38:14.227191+0000","last_became_peered":"2023-06-09T04:38:14.227191+0000","last_unstale":"2023-06-09T04:38:15.327835+0000","last_undegraded":"2023-06-09T04:38:15.327835+0000","last_fullsized":"2023-06-09T04:38:15.327835+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:08:38.715678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326139+0000","last_change":"2023-06-09T04:38:14.225884+0000","last_active":"2023-06-09T04:38:15.326139+0000","last_peered":"2023-06-09T04:38:15.326139+0000","last_clean":"2023-06-09T04:38:15.326139+0000","last_became_active":"2023-06-09T04:38:14.225614+0000","last_became_peered":"2023-06-09T04:38:14.225614+0000","last_unstale":"2023-06-09T04:38:15.326139+0000","last_undegraded":"2023-06-09T04:38:15.326139+0000","last_fullsized":"2023-06-09T04:38:15.326139+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:37:06.136960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326748+0000","last_change":"2023-06-09T04:38:14.225260+0000","last_active":"2023-06-09T04:38:15.326748+0000","last_peered":"2023-06-09T04:38:15.326748+0000","last_clean":"2023-06-09T04:38:15.326748+0000","last_became_active":"2023-06-09T04:38:14.224956+0000","last_became_peered":"2023-06-09T04:38:14.224956+0000","last_unstale":"2023-06-09T04:38:15.326748+0000","last_undegraded":"2023-06-09T04:38:15.326748+0000","last_fullsized":"2023-06-09T04:38:15.326748+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:34:40.582269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213752+0000","last_change":"2023-06-09T04:38:14.218461+0000","last_active":"2023-06-09T04:38:15.213752+0000","last_peered":"2023-06-09T04:38:15.213752+0000","last_clean":"2023-06-09T04:38:15.213752+0000","last_became_active":"2023-06-09T04:38:14.217889+0000","last_became_peered":"2023-06-09T04:38:14.217889+0000","last_unstale":"2023-06-09T04:38:15.213752+0000","last_undegraded":"2023-06-09T04:38:15.213752+0000","last_fullsized":"2023-06-09T04:38:15.213752+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:56.548396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327227+0000","last_change":"2023-06-09T04:38:14.224672+0000","last_active":"2023-06-09T04:38:15.327227+0000","last_peered":"2023-06-09T04:38:15.327227+0000","last_clean":"2023-06-09T04:38:15.327227+0000","last_became_active":"2023-06-09T04:38:14.224386+0000","last_became_peered":"2023-06-09T04:38:14.224386+0000","last_unstale":"2023-06-09T04:38:15.327227+0000","last_undegraded":"2023-06-09T04:38:15.327227+0000","last_fullsized":"2023-06-09T04:38:15.327227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:01:44.180301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326385+0000","last_change":"2023-06-09T04:38:14.220923+0000","last_active":"2023-06-09T04:38:15.326385+0000","last_peered":"2023-06-09T04:38:15.326385+0000","last_clean":"2023-06-09T04:38:15.326385+0000","last_became_active":"2023-06-09T04:38:14.220656+0000","last_became_peered":"2023-06-09T04:38:14.220656+0000","last_unstale":"2023-06-09T04:38:15.326385+0000","last_undegraded":"2023-06-09T04:38:15.326385+0000","last_fullsized":"2023-06-09T04:38:15.326385+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:01:13.944005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210778+0000","last_change":"2023-06-09T04:38:14.219273+0000","last_active":"2023-06-09T04:38:15.210778+0000","last_peered":"2023-06-09T04:38:15.210778+0000","last_clean":"2023-06-09T04:38:15.210778+0000","last_became_active":"2023-06-09T04:38:14.219014+0000","last_became_peered":"2023-06-09T04:38:14.219014+0000","last_unstale":"2023-06-09T04:38:15.210778+0000","last_undegraded":"2023-06-09T04:38:15.210778+0000","last_fullsized":"2023-06-09T04:38:15.210778+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:41:32.837808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.325810+0000","last_change":"2023-06-09T04:38:14.218552+0000","last_active":"2023-06-09T04:38:15.325810+0000","last_peered":"2023-06-09T04:38:15.325810+0000","last_clean":"2023-06-09T04:38:15.325810+0000","last_became_active":"2023-06-09T04:38:14.218276+0000","last_became_peered":"2023-06-09T04:38:14.218276+0000","last_unstale":"2023-06-09T04:38:15.325810+0000","last_undegraded":"2023-06-09T04:38:15.325810+0000","last_fullsized":"2023-06-09T04:38:15.325810+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:42:51.771711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326098+0000","last_change":"2023-06-09T04:38:14.226885+0000","last_active":"2023-06-09T04:38:15.326098+0000","last_peered":"2023-06-09T04:38:15.326098+0000","last_clean":"2023-06-09T04:38:15.326098+0000","last_became_active":"2023-06-09T04:38:14.225965+0000","last_became_peered":"2023-06-09T04:38:14.225965+0000","last_unstale":"2023-06-09T04:38:15.326098+0000","last_undegraded":"2023-06-09T04:38:15.326098+0000","last_fullsized":"2023-06-09T04:38:15.326098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:18:09.560387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211238+0000","last_change":"2023-06-09T04:38:13.818073+0000","last_active":"2023-06-09T04:38:15.211238+0000","last_peered":"2023-06-09T04:38:15.211238+0000","last_clean":"2023-06-09T04:38:15.211238+0000","last_became_active":"2023-06-09T04:38:13.817815+0000","last_became_peered":"2023-06-09T04:38:13.817815+0000","last_unstale":"2023-06-09T04:38:15.211238+0000","last_undegraded":"2023-06-09T04:38:15.211238+0000","last_fullsized":"2023-06-09T04:38:15.211238+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:18:11.134835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327396+0000","last_change":"2023-06-09T04:38:14.226920+0000","last_active":"2023-06-09T04:38:15.327396+0000","last_peered":"2023-06-09T04:38:15.327396+0000","last_clean":"2023-06-09T04:38:15.327396+0000","last_became_active":"2023-06-09T04:38:14.223350+0000","last_became_peered":"2023-06-09T04:38:14.223350+0000","last_unstale":"2023-06-09T04:38:15.327396+0000","last_undegraded":"2023-06-09T04:38:15.327396+0000","last_fullsized":"2023-06-09T04:38:15.327396+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:41:59.363097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327200+0000","last_change":"2023-06-09T04:38:13.822792+0000","last_active":"2023-06-09T04:38:15.327200+0000","last_peered":"2023-06-09T04:38:15.327200+0000","last_clean":"2023-06-09T04:38:15.327200+0000","last_became_active":"2023-06-09T04:38:13.822463+0000","last_became_peered":"2023-06-09T04:38:13.822463+0000","last_unstale":"2023-06-09T04:38:15.327200+0000","last_undegraded":"2023-06-09T04:38:15.327200+0000","last_fullsized":"2023-06-09T04:38:15.327200+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:06.703007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213807+0000","last_change":"2023-06-09T04:38:14.220899+0000","last_active":"2023-06-09T04:38:15.213807+0000","last_peered":"2023-06-09T04:38:15.213807+0000","last_clean":"2023-06-09T04:38:15.213807+0000","last_became_active":"2023-06-09T04:38:14.220613+0000","last_became_peered":"2023-06-09T04:38:14.220613+0000","last_unstale":"2023-06-09T04:38:15.213807+0000","last_undegraded":"2023-06-09T04:38:15.213807+0000","last_fullsized":"2023-06-09T04:38:15.213807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:20.487302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326352+0000","last_change":"2023-06-09T04:38:13.821918+0000","last_active":"2023-06-09T04:38:15.326352+0000","last_peered":"2023-06-09T04:38:15.326352+0000","last_clean":"2023-06-09T04:38:15.326352+0000","last_became_active":"2023-06-09T04:38:13.821594+0000","last_became_peered":"2023-06-09T04:38:13.821594+0000","last_unstale":"2023-06-09T04:38:15.326352+0000","last_undegraded":"2023-06-09T04:38:15.326352+0000","last_fullsized":"2023-06-09T04:38:15.326352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:29:01.921328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326164+0000","last_change":"2023-06-09T04:38:14.225457+0000","last_active":"2023-06-09T04:38:15.326164+0000","last_peered":"2023-06-09T04:38:15.326164+0000","last_clean":"2023-06-09T04:38:15.326164+0000","last_became_active":"2023-06-09T04:38:14.225200+0000","last_became_peered":"2023-06-09T04:38:14.225200+0000","last_unstale":"2023-06-09T04:38:15.326164+0000","last_undegraded":"2023-06-09T04:38:15.326164+0000","last_fullsized":"2023-06-09T04:38:15.326164+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:08:46.669222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327628+0000","last_change":"2023-06-09T04:38:13.816836+0000","last_active":"2023-06-09T04:38:15.327628+0000","last_peered":"2023-06-09T04:38:15.327628+0000","last_clean":"2023-06-09T04:38:15.327628+0000","last_became_active":"2023-06-09T04:38:13.816572+0000","last_became_peered":"2023-06-09T04:38:13.816572+0000","last_unstale":"2023-06-09T04:38:15.327628+0000","last_undegraded":"2023-06-09T04:38:15.327628+0000","last_fullsized":"2023-06-09T04:38:15.327628+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:56.907445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326389+0000","last_change":"2023-06-09T04:38:14.233188+0000","last_active":"2023-06-09T04:38:15.326389+0000","last_peered":"2023-06-09T04:38:15.326389+0000","last_clean":"2023-06-09T04:38:15.326389+0000","last_became_active":"2023-06-09T04:38:14.232865+0000","last_became_peered":"2023-06-09T04:38:14.232865+0000","last_unstale":"2023-06-09T04:38:15.326389+0000","last_undegraded":"2023-06-09T04:38:15.326389+0000","last_fullsized":"2023-06-09T04:38:15.326389+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:40:39.277006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211258+0000","last_change":"2023-06-09T04:38:13.812265+0000","last_active":"2023-06-09T04:38:15.211258+0000","last_peered":"2023-06-09T04:38:15.211258+0000","last_clean":"2023-06-09T04:38:15.211258+0000","last_became_active":"2023-06-09T04:38:13.811989+0000","last_became_peered":"2023-06-09T04:38:13.811989+0000","last_unstale":"2023-06-09T04:38:15.211258+0000","last_undegraded":"2023-06-09T04:38:15.211258+0000","last_fullsized":"2023-06-09T04:38:15.211258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:53:50.115260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208809+0000","last_change":"2023-06-09T04:38:14.215329+0000","last_active":"2023-06-09T04:38:15.208809+0000","last_peered":"2023-06-09T04:38:15.208809+0000","last_clean":"2023-06-09T04:38:15.208809+0000","last_became_active":"2023-06-09T04:38:14.214919+0000","last_became_peered":"2023-06-09T04:38:14.214919+0000","last_unstale":"2023-06-09T04:38:15.208809+0000","last_undegraded":"2023-06-09T04:38:15.208809+0000","last_fullsized":"2023-06-09T04:38:15.208809+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:28:10.442370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327319+0000","last_change":"2023-06-09T04:38:13.818828+0000","last_active":"2023-06-09T04:38:15.327319+0000","last_peered":"2023-06-09T04:38:15.327319+0000","last_clean":"2023-06-09T04:38:15.327319+0000","last_became_active":"2023-06-09T04:38:13.818544+0000","last_became_peered":"2023-06-09T04:38:13.818544+0000","last_unstale":"2023-06-09T04:38:15.327319+0000","last_undegraded":"2023-06-09T04:38:15.327319+0000","last_fullsized":"2023-06-09T04:38:15.327319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:00:58.445350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207945+0000","last_change":"2023-06-09T04:38:14.232997+0000","last_active":"2023-06-09T04:38:15.207945+0000","last_peered":"2023-06-09T04:38:15.207945+0000","last_clean":"2023-06-09T04:38:15.207945+0000","last_became_active":"2023-06-09T04:38:14.232787+0000","last_became_peered":"2023-06-09T04:38:14.232787+0000","last_unstale":"2023-06-09T04:38:15.207945+0000","last_undegraded":"2023-06-09T04:38:15.207945+0000","last_fullsized":"2023-06-09T04:38:15.207945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:34.091950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213785+0000","last_change":"2023-06-09T04:38:13.822939+0000","last_active":"2023-06-09T04:38:15.213785+0000","last_peered":"2023-06-09T04:38:15.213785+0000","last_clean":"2023-06-09T04:38:15.213785+0000","last_became_active":"2023-06-09T04:38:13.822620+0000","last_became_peered":"2023-06-09T04:38:13.822620+0000","last_unstale":"2023-06-09T04:38:15.213785+0000","last_undegraded":"2023-06-09T04:38:15.213785+0000","last_fullsized":"2023-06-09T04:38:15.213785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:33:16.582589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327002+0000","last_change":"2023-06-09T04:38:14.218165+0000","last_active":"2023-06-09T04:38:15.327002+0000","last_peered":"2023-06-09T04:38:15.327002+0000","last_clean":"2023-06-09T04:38:15.327002+0000","last_became_active":"2023-06-09T04:38:14.217874+0000","last_became_peered":"2023-06-09T04:38:14.217874+0000","last_unstale":"2023-06-09T04:38:15.327002+0000","last_undegraded":"2023-06-09T04:38:15.327002+0000","last_fullsized":"2023-06-09T04:38:15.327002+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:14:29.233551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208061+0000","last_change":"2023-06-09T04:38:13.822316+0000","last_active":"2023-06-09T04:38:15.208061+0000","last_peered":"2023-06-09T04:38:15.208061+0000","last_clean":"2023-06-09T04:38:15.208061+0000","last_became_active":"2023-06-09T04:38:13.821655+0000","last_became_peered":"2023-06-09T04:38:13.821655+0000","last_unstale":"2023-06-09T04:38:15.208061+0000","last_undegraded":"2023-06-09T04:38:15.208061+0000","last_fullsized":"2023-06-09T04:38:15.208061+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:01:51.432134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327323+0000","last_change":"2023-06-09T04:38:14.227311+0000","last_active":"2023-06-09T04:38:15.327323+0000","last_peered":"2023-06-09T04:38:15.327323+0000","last_clean":"2023-06-09T04:38:15.327323+0000","last_became_active":"2023-06-09T04:38:14.226927+0000","last_became_peered":"2023-06-09T04:38:14.226927+0000","last_unstale":"2023-06-09T04:38:15.327323+0000","last_undegraded":"2023-06-09T04:38:15.327323+0000","last_fullsized":"2023-06-09T04:38:15.327323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:50:14.509758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327157+0000","last_change":"2023-06-09T04:38:13.827429+0000","last_active":"2023-06-09T04:38:15.327157+0000","last_peered":"2023-06-09T04:38:15.327157+0000","last_clean":"2023-06-09T04:38:15.327157+0000","last_became_active":"2023-06-09T04:38:13.827139+0000","last_became_peered":"2023-06-09T04:38:13.827139+0000","last_unstale":"2023-06-09T04:38:15.327157+0000","last_undegraded":"2023-06-09T04:38:15.327157+0000","last_fullsized":"2023-06-09T04:38:15.327157+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:03:35.407358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327707+0000","last_change":"2023-06-09T04:38:14.228460+0000","last_active":"2023-06-09T04:38:15.327707+0000","last_peered":"2023-06-09T04:38:15.327707+0000","last_clean":"2023-06-09T04:38:15.327707+0000","last_became_active":"2023-06-09T04:38:14.228145+0000","last_became_peered":"2023-06-09T04:38:14.228145+0000","last_unstale":"2023-06-09T04:38:15.327707+0000","last_undegraded":"2023-06-09T04:38:15.327707+0000","last_fullsized":"2023-06-09T04:38:15.327707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:12.180461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208692+0000","last_change":"2023-06-09T04:38:13.818534+0000","last_active":"2023-06-09T04:38:15.208692+0000","last_peered":"2023-06-09T04:38:15.208692+0000","last_clean":"2023-06-09T04:38:15.208692+0000","last_became_active":"2023-06-09T04:38:13.818285+0000","last_became_peered":"2023-06-09T04:38:13.818285+0000","last_unstale":"2023-06-09T04:38:15.208692+0000","last_undegraded":"2023-06-09T04:38:15.208692+0000","last_fullsized":"2023-06-09T04:38:15.208692+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:02:28.865895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211056+0000","last_change":"2023-06-09T04:38:14.215188+0000","last_active":"2023-06-09T04:38:15.211056+0000","last_peered":"2023-06-09T04:38:15.211056+0000","last_clean":"2023-06-09T04:38:15.211056+0000","last_became_active":"2023-06-09T04:38:14.215028+0000","last_became_peered":"2023-06-09T04:38:14.215028+0000","last_unstale":"2023-06-09T04:38:15.211056+0000","last_undegraded":"2023-06-09T04:38:15.211056+0000","last_fullsized":"2023-06-09T04:38:15.211056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:10:18.560424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327902+0000","last_change":"2023-06-09T04:38:13.816346+0000","last_active":"2023-06-09T04:38:15.327902+0000","last_peered":"2023-06-09T04:38:15.327902+0000","last_clean":"2023-06-09T04:38:15.327902+0000","last_became_active":"2023-06-09T04:38:13.816080+0000","last_became_peered":"2023-06-09T04:38:13.816080+0000","last_unstale":"2023-06-09T04:38:15.327902+0000","last_undegraded":"2023-06-09T04:38:15.327902+0000","last_fullsized":"2023-06-09T04:38:15.327902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:34:28.269365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327802+0000","last_change":"2023-06-09T04:38:14.230223+0000","last_active":"2023-06-09T04:38:15.327802+0000","last_peered":"2023-06-09T04:38:15.327802+0000","last_clean":"2023-06-09T04:38:15.327802+0000","last_became_active":"2023-06-09T04:38:14.229949+0000","last_became_peered":"2023-06-09T04:38:14.229949+0000","last_unstale":"2023-06-09T04:38:15.327802+0000","last_undegraded":"2023-06-09T04:38:15.327802+0000","last_fullsized":"2023-06-09T04:38:15.327802+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:30.029706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326464+0000","last_change":"2023-06-09T04:38:13.826971+0000","last_active":"2023-06-09T04:38:15.326464+0000","last_peered":"2023-06-09T04:38:15.326464+0000","last_clean":"2023-06-09T04:38:15.326464+0000","last_became_active":"2023-06-09T04:38:13.826668+0000","last_became_peered":"2023-06-09T04:38:13.826668+0000","last_unstale":"2023-06-09T04:38:15.326464+0000","last_undegraded":"2023-06-09T04:38:15.326464+0000","last_fullsized":"2023-06-09T04:38:15.326464+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:08.155347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327209+0000","last_change":"2023-06-09T04:38:14.229594+0000","last_active":"2023-06-09T04:38:15.327209+0000","last_peered":"2023-06-09T04:38:15.327209+0000","last_clean":"2023-06-09T04:38:15.327209+0000","last_became_active":"2023-06-09T04:38:14.229149+0000","last_became_peered":"2023-06-09T04:38:14.229149+0000","last_unstale":"2023-06-09T04:38:15.327209+0000","last_undegraded":"2023-06-09T04:38:15.327209+0000","last_fullsized":"2023-06-09T04:38:15.327209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:10:53.501199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211132+0000","last_change":"2023-06-09T04:38:13.818747+0000","last_active":"2023-06-09T04:38:15.211132+0000","last_peered":"2023-06-09T04:38:15.211132+0000","last_clean":"2023-06-09T04:38:15.211132+0000","last_became_active":"2023-06-09T04:38:13.818487+0000","last_became_peered":"2023-06-09T04:38:13.818487+0000","last_unstale":"2023-06-09T04:38:15.211132+0000","last_undegraded":"2023-06-09T04:38:15.211132+0000","last_fullsized":"2023-06-09T04:38:15.211132+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:10:53.659392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208492+0000","last_change":"2023-06-09T04:38:14.215150+0000","last_active":"2023-06-09T04:38:15.208492+0000","last_peered":"2023-06-09T04:38:15.208492+0000","last_clean":"2023-06-09T04:38:15.208492+0000","last_became_active":"2023-06-09T04:38:14.214597+0000","last_became_peered":"2023-06-09T04:38:14.214597+0000","last_unstale":"2023-06-09T04:38:15.208492+0000","last_undegraded":"2023-06-09T04:38:15.208492+0000","last_fullsized":"2023-06-09T04:38:15.208492+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:57.913970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327477+0000","last_change":"2023-06-09T04:38:13.827254+0000","last_active":"2023-06-09T04:38:15.327477+0000","last_peered":"2023-06-09T04:38:15.327477+0000","last_clean":"2023-06-09T04:38:15.327477+0000","last_became_active":"2023-06-09T04:38:13.826934+0000","last_became_peered":"2023-06-09T04:38:13.826934+0000","last_unstale":"2023-06-09T04:38:15.327477+0000","last_undegraded":"2023-06-09T04:38:15.327477+0000","last_fullsized":"2023-06-09T04:38:15.327477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:55:37.494519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210778+0000","last_change":"2023-06-09T04:38:14.215230+0000","last_active":"2023-06-09T04:38:15.210778+0000","last_peered":"2023-06-09T04:38:15.210778+0000","last_clean":"2023-06-09T04:38:15.210778+0000","last_became_active":"2023-06-09T04:38:14.215000+0000","last_became_peered":"2023-06-09T04:38:14.215000+0000","last_unstale":"2023-06-09T04:38:15.210778+0000","last_undegraded":"2023-06-09T04:38:15.210778+0000","last_fullsized":"2023-06-09T04:38:15.210778+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:18:58.273779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210900+0000","last_change":"2023-06-09T04:38:13.817934+0000","last_active":"2023-06-09T04:38:15.210900+0000","last_peered":"2023-06-09T04:38:15.210900+0000","last_clean":"2023-06-09T04:38:15.210900+0000","last_became_active":"2023-06-09T04:38:13.817619+0000","last_became_peered":"2023-06-09T04:38:13.817619+0000","last_unstale":"2023-06-09T04:38:15.210900+0000","last_undegraded":"2023-06-09T04:38:15.210900+0000","last_fullsized":"2023-06-09T04:38:15.210900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:08:31.276826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327194+0000","last_change":"2023-06-09T04:38:14.233031+0000","last_active":"2023-06-09T04:38:15.327194+0000","last_peered":"2023-06-09T04:38:15.327194+0000","last_clean":"2023-06-09T04:38:15.327194+0000","last_became_active":"2023-06-09T04:38:14.232765+0000","last_became_peered":"2023-06-09T04:38:14.232765+0000","last_unstale":"2023-06-09T04:38:15.327194+0000","last_undegraded":"2023-06-09T04:38:15.327194+0000","last_fullsized":"2023-06-09T04:38:15.327194+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:58.075119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208186+0000","last_change":"2023-06-09T04:38:13.817334+0000","last_active":"2023-06-09T04:38:15.208186+0000","last_peered":"2023-06-09T04:38:15.208186+0000","last_clean":"2023-06-09T04:38:15.208186+0000","last_became_active":"2023-06-09T04:38:13.817054+0000","last_became_peered":"2023-06-09T04:38:13.817054+0000","last_unstale":"2023-06-09T04:38:15.208186+0000","last_undegraded":"2023-06-09T04:38:15.208186+0000","last_fullsized":"2023-06-09T04:38:15.208186+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:25.344102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326293+0000","last_change":"2023-06-09T04:38:14.217604+0000","last_active":"2023-06-09T04:38:15.326293+0000","last_peered":"2023-06-09T04:38:15.326293+0000","last_clean":"2023-06-09T04:38:15.326293+0000","last_became_active":"2023-06-09T04:38:14.216916+0000","last_became_peered":"2023-06-09T04:38:14.216916+0000","last_unstale":"2023-06-09T04:38:15.326293+0000","last_undegraded":"2023-06-09T04:38:15.326293+0000","last_fullsized":"2023-06-09T04:38:15.326293+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:05:21.232299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326345+0000","last_change":"2023-06-09T04:38:13.827147+0000","last_active":"2023-06-09T04:38:15.326345+0000","last_peered":"2023-06-09T04:38:15.326345+0000","last_clean":"2023-06-09T04:38:15.326345+0000","last_became_active":"2023-06-09T04:38:13.826896+0000","last_became_peered":"2023-06-09T04:38:13.826896+0000","last_unstale":"2023-06-09T04:38:15.326345+0000","last_undegraded":"2023-06-09T04:38:15.326345+0000","last_fullsized":"2023-06-09T04:38:15.326345+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:45:19.305265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208351+0000","last_change":"2023-06-09T04:38:14.219735+0000","last_active":"2023-06-09T04:38:15.208351+0000","last_peered":"2023-06-09T04:38:15.208351+0000","last_clean":"2023-06-09T04:38:15.208351+0000","last_became_active":"2023-06-09T04:38:14.219461+0000","last_became_peered":"2023-06-09T04:38:14.219461+0000","last_unstale":"2023-06-09T04:38:15.208351+0000","last_undegraded":"2023-06-09T04:38:15.208351+0000","last_fullsized":"2023-06-09T04:38:15.208351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:22:20.054643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327466+0000","last_change":"2023-06-09T04:38:13.822228+0000","last_active":"2023-06-09T04:38:15.327466+0000","last_peered":"2023-06-09T04:38:15.327466+0000","last_clean":"2023-06-09T04:38:15.327466+0000","last_became_active":"2023-06-09T04:38:13.821892+0000","last_became_peered":"2023-06-09T04:38:13.821892+0000","last_unstale":"2023-06-09T04:38:15.327466+0000","last_undegraded":"2023-06-09T04:38:15.327466+0000","last_fullsized":"2023-06-09T04:38:15.327466+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:58.650729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327283+0000","last_change":"2023-06-09T04:38:14.225436+0000","last_active":"2023-06-09T04:38:15.327283+0000","last_peered":"2023-06-09T04:38:15.327283+0000","last_clean":"2023-06-09T04:38:15.327283+0000","last_became_active":"2023-06-09T04:38:14.225175+0000","last_became_peered":"2023-06-09T04:38:14.225175+0000","last_unstale":"2023-06-09T04:38:15.327283+0000","last_undegraded":"2023-06-09T04:38:15.327283+0000","last_fullsized":"2023-06-09T04:38:15.327283+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:52.759391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213991+0000","last_change":"2023-06-09T04:38:13.823175+0000","last_active":"2023-06-09T04:38:15.213991+0000","last_peered":"2023-06-09T04:38:15.213991+0000","last_clean":"2023-06-09T04:38:15.213991+0000","last_became_active":"2023-06-09T04:38:13.822770+0000","last_became_peered":"2023-06-09T04:38:13.822770+0000","last_unstale":"2023-06-09T04:38:15.213991+0000","last_undegraded":"2023-06-09T04:38:15.213991+0000","last_fullsized":"2023-06-09T04:38:15.213991+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:40.015830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327677+0000","last_change":"2023-06-09T04:38:14.226135+0000","last_active":"2023-06-09T04:38:15.327677+0000","last_peered":"2023-06-09T04:38:15.327677+0000","last_clean":"2023-06-09T04:38:15.327677+0000","last_became_active":"2023-06-09T04:38:14.225804+0000","last_became_peered":"2023-06-09T04:38:14.225804+0000","last_unstale":"2023-06-09T04:38:15.327677+0000","last_undegraded":"2023-06-09T04:38:15.327677+0000","last_fullsized":"2023-06-09T04:38:15.327677+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:56:44.541908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211307+0000","last_change":"2023-06-09T04:38:13.818000+0000","last_active":"2023-06-09T04:38:15.211307+0000","last_peered":"2023-06-09T04:38:15.211307+0000","last_clean":"2023-06-09T04:38:15.211307+0000","last_became_active":"2023-06-09T04:38:13.817707+0000","last_became_peered":"2023-06-09T04:38:13.817707+0000","last_unstale":"2023-06-09T04:38:15.211307+0000","last_undegraded":"2023-06-09T04:38:15.211307+0000","last_fullsized":"2023-06-09T04:38:15.211307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:06:41.836683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210865+0000","last_change":"2023-06-09T04:38:14.219640+0000","last_active":"2023-06-09T04:38:15.210865+0000","last_peered":"2023-06-09T04:38:15.210865+0000","last_clean":"2023-06-09T04:38:15.210865+0000","last_became_active":"2023-06-09T04:38:14.219322+0000","last_became_peered":"2023-06-09T04:38:14.219322+0000","last_unstale":"2023-06-09T04:38:15.210865+0000","last_undegraded":"2023-06-09T04:38:15.210865+0000","last_fullsized":"2023-06-09T04:38:15.210865+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:37:07.018499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211258+0000","last_change":"2023-06-09T04:38:13.812358+0000","last_active":"2023-06-09T04:38:15.211258+0000","last_peered":"2023-06-09T04:38:15.211258+0000","last_clean":"2023-06-09T04:38:15.211258+0000","last_became_active":"2023-06-09T04:38:13.812089+0000","last_became_peered":"2023-06-09T04:38:13.812089+0000","last_unstale":"2023-06-09T04:38:15.211258+0000","last_undegraded":"2023-06-09T04:38:15.211258+0000","last_fullsized":"2023-06-09T04:38:15.211258+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:58:22.997023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326227+0000","last_change":"2023-06-09T04:38:14.224996+0000","last_active":"2023-06-09T04:38:15.326227+0000","last_peered":"2023-06-09T04:38:15.326227+0000","last_clean":"2023-06-09T04:38:15.326227+0000","last_became_active":"2023-06-09T04:38:14.224721+0000","last_became_peered":"2023-06-09T04:38:14.224721+0000","last_unstale":"2023-06-09T04:38:15.326227+0000","last_undegraded":"2023-06-09T04:38:15.326227+0000","last_fullsized":"2023-06-09T04:38:15.326227+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:35:45.352663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213679+0000","last_change":"2023-06-09T04:38:13.823484+0000","last_active":"2023-06-09T04:38:15.213679+0000","last_peered":"2023-06-09T04:38:15.213679+0000","last_clean":"2023-06-09T04:38:15.213679+0000","last_became_active":"2023-06-09T04:38:13.823185+0000","last_became_peered":"2023-06-09T04:38:13.823185+0000","last_unstale":"2023-06-09T04:38:15.213679+0000","last_undegraded":"2023-06-09T04:38:15.213679+0000","last_fullsized":"2023-06-09T04:38:15.213679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:43:38.879270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.325871+0000","last_change":"2023-06-09T04:38:14.218400+0000","last_active":"2023-06-09T04:38:15.325871+0000","last_peered":"2023-06-09T04:38:15.325871+0000","last_clean":"2023-06-09T04:38:15.325871+0000","last_became_active":"2023-06-09T04:38:14.217935+0000","last_became_peered":"2023-06-09T04:38:14.217935+0000","last_unstale":"2023-06-09T04:38:15.325871+0000","last_undegraded":"2023-06-09T04:38:15.325871+0000","last_fullsized":"2023-06-09T04:38:15.325871+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:26:53.061655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207944+0000","last_change":"2023-06-09T04:38:13.815168+0000","last_active":"2023-06-09T04:38:15.207944+0000","last_peered":"2023-06-09T04:38:15.207944+0000","last_clean":"2023-06-09T04:38:15.207944+0000","last_became_active":"2023-06-09T04:38:13.814903+0000","last_became_peered":"2023-06-09T04:38:13.814903+0000","last_unstale":"2023-06-09T04:38:15.207944+0000","last_undegraded":"2023-06-09T04:38:15.207944+0000","last_fullsized":"2023-06-09T04:38:15.207944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:12.751761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.207992+0000","last_change":"2023-06-09T04:38:14.225694+0000","last_active":"2023-06-09T04:38:15.207992+0000","last_peered":"2023-06-09T04:38:15.207992+0000","last_clean":"2023-06-09T04:38:15.207992+0000","last_became_active":"2023-06-09T04:38:14.225450+0000","last_became_peered":"2023-06-09T04:38:14.225450+0000","last_unstale":"2023-06-09T04:38:15.207992+0000","last_undegraded":"2023-06-09T04:38:15.207992+0000","last_fullsized":"2023-06-09T04:38:15.207992+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:42:13.602544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326646+0000","last_change":"2023-06-09T04:38:13.827178+0000","last_active":"2023-06-09T04:38:15.326646+0000","last_peered":"2023-06-09T04:38:15.326646+0000","last_clean":"2023-06-09T04:38:15.326646+0000","last_became_active":"2023-06-09T04:38:13.826919+0000","last_became_peered":"2023-06-09T04:38:13.826919+0000","last_unstale":"2023-06-09T04:38:15.326646+0000","last_undegraded":"2023-06-09T04:38:15.326646+0000","last_fullsized":"2023-06-09T04:38:15.326646+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:50:27.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210992+0000","last_change":"2023-06-09T04:38:14.219162+0000","last_active":"2023-06-09T04:38:15.210992+0000","last_peered":"2023-06-09T04:38:15.210992+0000","last_clean":"2023-06-09T04:38:15.210992+0000","last_became_active":"2023-06-09T04:38:14.218870+0000","last_became_peered":"2023-06-09T04:38:14.218870+0000","last_unstale":"2023-06-09T04:38:15.210992+0000","last_undegraded":"2023-06-09T04:38:15.210992+0000","last_fullsized":"2023-06-09T04:38:15.210992+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:49:02.844958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326531+0000","last_change":"2023-06-09T04:38:13.823512+0000","last_active":"2023-06-09T04:38:15.326531+0000","last_peered":"2023-06-09T04:38:15.326531+0000","last_clean":"2023-06-09T04:38:15.326531+0000","last_became_active":"2023-06-09T04:38:13.822261+0000","last_became_peered":"2023-06-09T04:38:13.822261+0000","last_unstale":"2023-06-09T04:38:15.326531+0000","last_undegraded":"2023-06-09T04:38:15.326531+0000","last_fullsized":"2023-06-09T04:38:15.326531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:16:41.528256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326851+0000","last_change":"2023-06-09T04:36:47.621971+0000","last_active":"2023-06-09T04:38:15.326851+0000","last_peered":"2023-06-09T04:38:15.326851+0000","last_clean":"2023-06-09T04:38:15.326851+0000","last_became_active":"2023-06-09T04:36:47.621651+0000","last_became_peered":"2023-06-09T04:36:47.621651+0000","last_unstale":"2023-06-09T04:38:15.326851+0000","last_undegraded":"2023-06-09T04:38:15.326851+0000","last_fullsized":"2023-06-09T04:38:15.326851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:13:43.956926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.210995+0000","last_change":"2023-06-09T04:38:14.224640+0000","last_active":"2023-06-09T04:38:15.210995+0000","last_peered":"2023-06-09T04:38:15.210995+0000","last_clean":"2023-06-09T04:38:15.210995+0000","last_became_active":"2023-06-09T04:38:14.224400+0000","last_became_peered":"2023-06-09T04:38:14.224400+0000","last_unstale":"2023-06-09T04:38:15.210995+0000","last_undegraded":"2023-06-09T04:38:15.210995+0000","last_fullsized":"2023-06-09T04:38:15.210995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:53:41.082987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327483+0000","last_change":"2023-06-09T04:38:13.815542+0000","last_active":"2023-06-09T04:38:15.327483+0000","last_peered":"2023-06-09T04:38:15.327483+0000","last_clean":"2023-06-09T04:38:15.327483+0000","last_became_active":"2023-06-09T04:38:13.815106+0000","last_became_peered":"2023-06-09T04:38:13.815106+0000","last_unstale":"2023-06-09T04:38:15.327483+0000","last_undegraded":"2023-06-09T04:38:15.327483+0000","last_fullsized":"2023-06-09T04:38:15.327483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:22:19.048119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211151+0000","last_change":"2023-06-09T04:36:47.613976+0000","last_active":"2023-06-09T04:38:15.211151+0000","last_peered":"2023-06-09T04:38:15.211151+0000","last_clean":"2023-06-09T04:38:15.211151+0000","last_became_active":"2023-06-09T04:36:47.613691+0000","last_became_peered":"2023-06-09T04:36:47.613691+0000","last_unstale":"2023-06-09T04:38:15.211151+0000","last_undegraded":"2023-06-09T04:38:15.211151+0000","last_fullsized":"2023-06-09T04:38:15.211151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:50:24.807423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327879+0000","last_change":"2023-06-09T04:38:14.224268+0000","last_active":"2023-06-09T04:38:15.327879+0000","last_peered":"2023-06-09T04:38:15.327879+0000","last_clean":"2023-06-09T04:38:15.327879+0000","last_became_active":"2023-06-09T04:38:14.223887+0000","last_became_peered":"2023-06-09T04:38:14.223887+0000","last_unstale":"2023-06-09T04:38:15.327879+0000","last_undegraded":"2023-06-09T04:38:15.327879+0000","last_fullsized":"2023-06-09T04:38:15.327879+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:28:10.442370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.325891+0000","last_change":"2023-06-09T04:38:13.821703+0000","last_active":"2023-06-09T04:38:15.325891+0000","last_peered":"2023-06-09T04:38:15.325891+0000","last_clean":"2023-06-09T04:38:15.325891+0000","last_became_active":"2023-06-09T04:38:13.821345+0000","last_became_peered":"2023-06-09T04:38:13.821345+0000","last_unstale":"2023-06-09T04:38:15.325891+0000","last_undegraded":"2023-06-09T04:38:15.325891+0000","last_fullsized":"2023-06-09T04:38:15.325891+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:15.272783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326186+0000","last_change":"2023-06-09T04:36:47.626414+0000","last_active":"2023-06-09T04:38:15.326186+0000","last_peered":"2023-06-09T04:38:15.326186+0000","last_clean":"2023-06-09T04:38:15.326186+0000","last_became_active":"2023-06-09T04:36:47.626166+0000","last_became_peered":"2023-06-09T04:36:47.626166+0000","last_unstale":"2023-06-09T04:38:15.326186+0000","last_undegraded":"2023-06-09T04:38:15.326186+0000","last_fullsized":"2023-06-09T04:38:15.326186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:00:21.338009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"18'117","reported_seq":197,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326764+0000","last_change":"2023-06-09T04:36:47.627673+0000","last_active":"2023-06-09T04:38:15.326764+0000","last_peered":"2023-06-09T04:38:15.326764+0000","last_clean":"2023-06-09T04:38:15.326764+0000","last_became_active":"2023-06-09T04:36:47.626658+0000","last_became_peered":"2023-06-09T04:36:47.626658+0000","last_unstale":"2023-06-09T04:38:15.326764+0000","last_undegraded":"2023-06-09T04:38:15.326764+0000","last_fullsized":"2023-06-09T04:38:15.326764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:10:59.159223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208265+0000","last_change":"2023-06-09T04:38:14.221698+0000","last_active":"2023-06-09T04:38:15.208265+0000","last_peered":"2023-06-09T04:38:15.208265+0000","last_clean":"2023-06-09T04:38:15.208265+0000","last_became_active":"2023-06-09T04:38:14.221452+0000","last_became_peered":"2023-06-09T04:38:14.221452+0000","last_unstale":"2023-06-09T04:38:15.208265+0000","last_undegraded":"2023-06-09T04:38:15.208265+0000","last_fullsized":"2023-06-09T04:38:15.208265+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:55:38.501043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.328014+0000","last_change":"2023-06-09T04:38:13.822382+0000","last_active":"2023-06-09T04:38:15.328014+0000","last_peered":"2023-06-09T04:38:15.328014+0000","last_clean":"2023-06-09T04:38:15.328014+0000","last_became_active":"2023-06-09T04:38:13.822065+0000","last_became_peered":"2023-06-09T04:38:13.822065+0000","last_unstale":"2023-06-09T04:38:15.328014+0000","last_undegraded":"2023-06-09T04:38:15.328014+0000","last_fullsized":"2023-06-09T04:38:15.328014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:27:56.878816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327454+0000","last_change":"2023-06-09T04:36:47.618577+0000","last_active":"2023-06-09T04:38:15.327454+0000","last_peered":"2023-06-09T04:38:15.327454+0000","last_clean":"2023-06-09T04:38:15.327454+0000","last_became_active":"2023-06-09T04:36:47.618339+0000","last_became_peered":"2023-06-09T04:36:47.618339+0000","last_unstale":"2023-06-09T04:38:15.327454+0000","last_undegraded":"2023-06-09T04:38:15.327454+0000","last_fullsized":"2023-06-09T04:38:15.327454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:31:05.308029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208603+0000","last_change":"2023-06-09T04:38:14.220810+0000","last_active":"2023-06-09T04:38:15.208603+0000","last_peered":"2023-06-09T04:38:15.208603+0000","last_clean":"2023-06-09T04:38:15.208603+0000","last_became_active":"2023-06-09T04:38:14.220550+0000","last_became_peered":"2023-06-09T04:38:14.220550+0000","last_unstale":"2023-06-09T04:38:15.208603+0000","last_undegraded":"2023-06-09T04:38:15.208603+0000","last_fullsized":"2023-06-09T04:38:15.208603+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:41:30.029706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.214161+0000","last_change":"2023-06-09T04:38:13.822583+0000","last_active":"2023-06-09T04:38:15.214161+0000","last_peered":"2023-06-09T04:38:15.214161+0000","last_clean":"2023-06-09T04:38:15.214161+0000","last_became_active":"2023-06-09T04:38:13.822254+0000","last_became_peered":"2023-06-09T04:38:13.822254+0000","last_unstale":"2023-06-09T04:38:15.214161+0000","last_undegraded":"2023-06-09T04:38:15.214161+0000","last_fullsized":"2023-06-09T04:38:15.214161+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:33.085426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327694+0000","last_change":"2023-06-09T04:36:47.618679+0000","last_active":"2023-06-09T04:38:15.327694+0000","last_peered":"2023-06-09T04:38:15.327694+0000","last_clean":"2023-06-09T04:38:15.327694+0000","last_became_active":"2023-06-09T04:36:47.618391+0000","last_became_peered":"2023-06-09T04:36:47.618391+0000","last_unstale":"2023-06-09T04:38:15.327694+0000","last_undegraded":"2023-06-09T04:38:15.327694+0000","last_fullsized":"2023-06-09T04:38:15.327694+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:43.237470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327595+0000","last_change":"2023-06-09T04:38:14.222401+0000","last_active":"2023-06-09T04:38:15.327595+0000","last_peered":"2023-06-09T04:38:15.327595+0000","last_clean":"2023-06-09T04:38:15.327595+0000","last_became_active":"2023-06-09T04:38:14.221683+0000","last_became_peered":"2023-06-09T04:38:14.221683+0000","last_unstale":"2023-06-09T04:38:15.327595+0000","last_undegraded":"2023-06-09T04:38:15.327595+0000","last_fullsized":"2023-06-09T04:38:15.327595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:36:17.018135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.211220+0000","last_change":"2023-06-09T04:38:13.815721+0000","last_active":"2023-06-09T04:38:15.211220+0000","last_peered":"2023-06-09T04:38:15.211220+0000","last_clean":"2023-06-09T04:38:15.211220+0000","last_became_active":"2023-06-09T04:38:13.815449+0000","last_became_peered":"2023-06-09T04:38:13.815449+0000","last_unstale":"2023-06-09T04:38:15.211220+0000","last_undegraded":"2023-06-09T04:38:15.211220+0000","last_fullsized":"2023-06-09T04:38:15.211220+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:28:48.829570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213632+0000","last_change":"2023-06-09T04:36:47.616483+0000","last_active":"2023-06-09T04:38:15.213632+0000","last_peered":"2023-06-09T04:38:15.213632+0000","last_clean":"2023-06-09T04:38:15.213632+0000","last_became_active":"2023-06-09T04:36:47.616149+0000","last_became_peered":"2023-06-09T04:36:47.616149+0000","last_unstale":"2023-06-09T04:38:15.213632+0000","last_undegraded":"2023-06-09T04:38:15.213632+0000","last_fullsized":"2023-06-09T04:38:15.213632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:04:56.417832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.213609+0000","last_change":"2023-06-09T04:38:14.220245+0000","last_active":"2023-06-09T04:38:15.213609+0000","last_peered":"2023-06-09T04:38:15.213609+0000","last_clean":"2023-06-09T04:38:15.213609+0000","last_became_active":"2023-06-09T04:38:14.219974+0000","last_became_peered":"2023-06-09T04:38:14.219974+0000","last_unstale":"2023-06-09T04:38:15.213609+0000","last_undegraded":"2023-06-09T04:38:15.213609+0000","last_fullsized":"2023-06-09T04:38:15.213609+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:24:03.127799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326146+0000","last_change":"2023-06-09T04:38:13.823445+0000","last_active":"2023-06-09T04:38:15.326146+0000","last_peered":"2023-06-09T04:38:15.326146+0000","last_clean":"2023-06-09T04:38:15.326146+0000","last_became_active":"2023-06-09T04:38:13.823162+0000","last_became_peered":"2023-06-09T04:38:13.823162+0000","last_unstale":"2023-06-09T04:38:15.326146+0000","last_undegraded":"2023-06-09T04:38:15.326146+0000","last_fullsized":"2023-06-09T04:38:15.326146+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:31:58.773408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327478+0000","last_change":"2023-06-09T04:36:47.616467+0000","last_active":"2023-06-09T04:38:15.327478+0000","last_peered":"2023-06-09T04:38:15.327478+0000","last_clean":"2023-06-09T04:38:15.327478+0000","last_became_active":"2023-06-09T04:36:47.616166+0000","last_became_peered":"2023-06-09T04:36:47.616166+0000","last_unstale":"2023-06-09T04:38:15.327478+0000","last_undegraded":"2023-06-09T04:38:15.327478+0000","last_fullsized":"2023-06-09T04:38:15.327478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:57:02.857593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.326323+0000","last_change":"2023-06-09T04:38:14.227672+0000","last_active":"2023-06-09T04:38:15.326323+0000","last_peered":"2023-06-09T04:38:15.326323+0000","last_clean":"2023-06-09T04:38:15.326323+0000","last_became_active":"2023-06-09T04:38:14.227404+0000","last_became_peered":"2023-06-09T04:38:14.227404+0000","last_unstale":"2023-06-09T04:38:15.326323+0000","last_undegraded":"2023-06-09T04:38:15.326323+0000","last_fullsized":"2023-06-09T04:38:15.326323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:13.790366+0000","last_clean_scrub_stamp":"2023-06-09T04:38:13.790366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:29:10.559738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.208152+0000","last_change":"2023-06-09T04:38:13.819212+0000","last_active":"2023-06-09T04:38:15.208152+0000","last_peered":"2023-06-09T04:38:15.208152+0000","last_clean":"2023-06-09T04:38:15.208152+0000","last_became_active":"2023-06-09T04:38:13.819001+0000","last_became_peered":"2023-06-09T04:38:13.819001+0000","last_unstale":"2023-06-09T04:38:15.208152+0000","last_undegraded":"2023-06-09T04:38:15.208152+0000","last_fullsized":"2023-06-09T04:38:15.208152+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:38:12.783842+0000","last_clean_scrub_stamp":"2023-06-09T04:38:12.783842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:04:43.205470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":45,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-06-09T04:38:15.327917+0000","last_change":"2023-06-09T04:36:47.613658+0000","last_active":"2023-06-09T04:38:15.327917+0000","last_peered":"2023-06-09T04:38:15.327917+0000","last_clean":"2023-06-09T04:38:15.327917+0000","last_became_active":"2023-06-09T04:36:47.613327+0000","last_became_peered":"2023-06-09T04:36:47.613327+0000","last_unstale":"2023-06-09T04:38:15.327917+0000","last_undegraded":"2023-06-09T04:38:15.327917+0000","last_fullsized":"2023-06-09T04:38:15.327917+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:36:46.598962+0000","last_clean_scrub_stamp":"2023-06-09T04:36:46.598962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:54:13.925140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":209740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.728,"5min":1.728,"15min":1.728},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.52000000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.659,"5min":1.659,"15min":1.659},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.501}]},{"osd":4,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.41699999999999998}]},{"osd":5,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":12.042999999999999,"5min":12.042999999999999,"15min":12.042999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.44400000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":15.029,"5min":15.029,"15min":15.029},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.59499999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":210867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":17.577000000000002,"5min":17.577000000000002,"15min":17.577000000000002},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":4.5599999999999996,"5min":4.5599999999999996,"15min":4.5599999999999996},"last":0.379},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":4.532,"5min":4.532,"15min":4.532},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":12.515000000000001,"5min":12.515000000000001,"15min":12.515000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":4.4290000000000003,"5min":4.4290000000000003,"15min":4.4290000000000003},"last":0.51700000000000002}]},{"osd":5,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":12.451000000000001,"5min":12.451000000000001,"15min":12.451000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.4950000000000001,"5min":4.4950000000000001,"15min":4.4950000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.8019999999999996,"5min":4.8019999999999996,"15min":4.8019999999999996},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Jun 9 04:37:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.548,"5min":12.548,"15min":12.548},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":4.4669999999999996},"last":0.498}]}]},{"osd":4,"up_from":14,"seq":60129542167,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":466944,"data_stored":204820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.2279999999999998,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.1509999999999998,"5min":5.1509999999999998,"15min":5.1509999999999998},"last":0.61599999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":5.2960000000000003,"5min":5.2960000000000003,"15min":5.2960000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.505},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.37}]},{"osd":6,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.47199999999999998}]},{"osd":7,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45100000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542166,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":458752,"data_stored":203290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.25},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.378}]},{"osd":3,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68700000000000006}]}]},{"osd":7,"up_from":14,"seq":60129542167,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":1052672,"data_stored":793714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39200000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.495}]},{"osd":4,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.40799999999999997}]},{"osd":5,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Jun 9 04:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.63800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":471040,"data_stored":210299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.63},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.502},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Fri Jun 9 04:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jun 9 04:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.75700000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":1040,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":1064960,"data_stored":800667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.26300000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.32600000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.33600000000000002}]},{"osd":4,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55900000000000005}]},{"osd":5,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.67700000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":483328,"data_stored":211815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.29599999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.38300000000000001}]},{"osd":3,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jun 9 04:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:38:18.675 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:38:18.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-09T04:38:18.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.835+0000 7f21ac53d700 1 Processor -- start 2023-06-09T04:38:18.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.835+0000 7f21ac53d700 1 -- start start 2023-06-09T04:38:18.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21ac53d700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f21a40cded0 0x7f21a415d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21ac53d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a40ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21ac53d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40716e0 con 0x7f21a41591d0 2023-06-09T04:38:18.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21ac53d700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a4072280 con 0x7f21a40cded0 2023-06-09T04:38:18.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21ac53d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a406f4a0 con 0x7f21a40cd300 2023-06-09T04:38:18.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21aa2d9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f21a40cded0 0x7f21a415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21aa2d9700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f21a40cded0 0x7f21a415d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38572/0 (socket says 172.21.15.149:38572) 2023-06-09T04:38:18.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.836+0000 7f21aa2d9700 1 -- 172.21.15.149:0/1870910486 learned_addr learned my addr 172.21.15.149:0/1870910486 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:18.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21a9ad8700 1 --2- 172.21.15.149:0/1870910486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a40ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21aa2d9700 1 -- 172.21.15.149:0/1870910486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 msgr2=0x7f21a40ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:18.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21aa2d9700 1 --2- 172.21.15.149:0/1870910486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a40ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21aa2d9700 1 -- 172.21.15.149:0/1870910486 >> v1:172.21.15.184:6789/0 conn(0x7f21a41591d0 legacy=0x7f21a4071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21aa2d9700 1 -- 172.21.15.149:0/1870910486 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a415dad0 con 0x7f21a40cded0 2023-06-09T04:38:18.840 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21aa2d9700 1 --2- 172.21.15.149:0/1870910486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a415d590 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f21940098f0 tx=0x7f2194009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59753cf9da18f0a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21a92d7700 1 -- 172.21.15.149:0/1870910486 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219400b8a0 con 0x7f21a40cded0 2023-06-09T04:38:18.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21a92d7700 1 -- 172.21.15.149:0/1870910486 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219400ba00 con 0x7f21a40cded0 2023-06-09T04:38:18.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.837+0000 7f21a92d7700 1 -- 172.21.15.149:0/1870910486 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219400bd90 con 0x7f21a40cded0 2023-06-09T04:38:18.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 -- 172.21.15.149:0/1870910486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 msgr2=0x7f21a415d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 --2- 172.21.15.149:0/1870910486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a415d590 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f21940098f0 tx=0x7f2194009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:18.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 -- 172.21.15.149:0/1870910486 shutdown_connections 2023-06-09T04:38:18.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 --2- 172.21.15.149:0/1870910486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a415d590 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 --2- 172.21.15.149:0/1870910486 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a40ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 -- 172.21.15.149:0/1870910486 >> 172.21.15.149:0/1870910486 conn(0x7f21a406aec0 msgr2=0x7f21a406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:18.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 -- 172.21.15.149:0/1870910486 shutdown_connections 2023-06-09T04:38:18.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.838+0000 7f21ac53d700 1 -- 172.21.15.149:0/1870910486 wait complete. 2023-06-09T04:38:18.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.839+0000 7f21ac53d700 1 Processor -- start 2023-06-09T04:38:18.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.839+0000 7f21ac53d700 1 -- start start 2023-06-09T04:38:18.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a4158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a4150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21a41591d0 0x7f21a40c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c6d10 con 0x7f21a40cded0 2023-06-09T04:38:18.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c8f70 con 0x7f21a41591d0 2023-06-09T04:38:18.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40c6720 con 0x7f21a40cd300 2023-06-09T04:38:18.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a4150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a4150720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38580/0 (socket says 172.21.15.149:38580) 2023-06-09T04:38:18.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 -- 172.21.15.149:0/607434963 learned_addr learned my addr 172.21.15.149:0/607434963 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:18.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21aa2d9700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a4158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21aaada700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21a41591d0 0x7f21a40c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 -- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 msgr2=0x7f21a4158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a4158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 -- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21a41591d0 msgr2=0x7f21a40c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:18.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21a41591d0 0x7f21a40c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:18.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 -- 172.21.15.149:0/607434963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194009550 con 0x7f21a40cded0 2023-06-09T04:38:18.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21a9ad8700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a4150720 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f21a000d830 tx=0x7f21a000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f219affd700 1 -- 172.21.15.149:0/607434963 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00125f0 con 0x7f21a40cded0 2023-06-09T04:38:18.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f219affd700 1 -- 172.21.15.149:0/607434963 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a0012750 con 0x7f21a40cded0 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a4150c60 con 0x7f21a40cded0 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f219affd700 1 -- 172.21.15.149:0/607434963 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0012ae0 con 0x7f21a40cded0 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.840+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40c8c90 con 0x7f21a40cded0 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.841+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a40c6e50 con 0x7f21a40cded0 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.842+0000 7f219affd700 1 -- 172.21.15.149:0/607434963 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21a0012c40 con 0x7f21a40cded0 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.842+0000 7f219affd700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f218806ace0 0x7f218806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.842+0000 7f219affd700 1 -- 172.21.15.149:0/607434963 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f21a0089650 con 0x7f21a40cded0 2023-06-09T04:38:18.848 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.842+0000 7f21aa2d9700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f218806ace0 0x7f218806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:18.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.843+0000 7f21aa2d9700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f218806ace0 0x7f218806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2194009c40 tx=0x7f2194008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:18.849 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:18.847+0000 7f219affd700 1 -- 172.21.15.149:0/607434963 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21a40c6e50 con 0x7f21a40cded0 2023-06-09T04:38:19.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.113+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f21a40c6e50 con 0x7f21a40cded0 2023-06-09T04:38:19.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.116+0000 7f219affd700 1 -- 172.21.15.149:0/607434963 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f21a40c6e50 con 0x7f21a40cded0 2023-06-09T04:38:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.118+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f218806ace0 msgr2=0x7f218806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.118+0000 7f21ac53d700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f218806ace0 0x7f218806d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2194009c40 tx=0x7f2194008030 comp rx=0 tx=0).stop 2023-06-09T04:38:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.118+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 msgr2=0x7f21a4150720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.118+0000 7f21ac53d700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a4150720 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f21a000d830 tx=0x7f21a000db40 comp rx=0 tx=0).stop 2023-06-09T04:38:19.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.118+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 shutdown_connections 2023-06-09T04:38:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.118+0000 7f21ac53d700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f218806ace0 0x7f218806d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.119+0000 7f21ac53d700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f21a40cd300 0x7f21a4158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.119+0000 7f21ac53d700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21a41591d0 0x7f21a40c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.119+0000 7f21ac53d700 1 --2- 172.21.15.149:0/607434963 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f21a40cded0 0x7f21a4150720 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.119+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 >> 172.21.15.149:0/607434963 conn(0x7f21a406aec0 msgr2=0x7f21a40b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.119+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 shutdown_connections 2023-06-09T04:38:19.121 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.119+0000 7f21ac53d700 1 -- 172.21.15.149:0/607434963 wait complete. 2023-06-09T04:38:19.122 INFO:teuthology.orchestra.run.smithi149.stderr:updated caps for client.0 2023-06-09T04:38:19.132 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:38:19.253 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.252+0000 7f84c841d700 1 Processor -- start 2023-06-09T04:38:19.323 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.252+0000 7f84c841d700 1 -- start start 2023-06-09T04:38:19.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.253+0000 7f84c841d700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f84c00b43f0 0x7f84c00b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.327 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.253+0000 7f84c841d700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c00cf1d0 con 0x7f84c00b80d0 2023-06-09T04:38:19.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.253+0000 7f84c841d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c00cd790 con 0x7f84c00b5000 2023-06-09T04:38:19.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.253+0000 7f84c841d700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c00ccfc0 con 0x7f84c00b43f0 2023-06-09T04:38:19.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.253+0000 7f84c61b9700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f84c00b80d0 0x7f84c01606f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34218/0 (socket says 172.21.15.149:34218) 2023-06-09T04:38:19.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.253+0000 7f84c61b9700 1 -- 172.21.15.149:0/2897521134 learned_addr learned my addr 172.21.15.149:0/2897521134 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:19.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c69ba700 1 --2- 172.21.15.149:0/2897521134 >> v2:172.21.15.184:3300/0 conn(0x7f84c00b43f0 0x7f84c00b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301336109 0 0) 0x7f84c00cf1d0 con 0x7f84c00b80d0 2023-06-09T04:38:19.328 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ac0035b0 con 0x7f84c00b80d0 2023-06-09T04:38:19.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287672999 0 0) 0x7f84ac0035b0 con 0x7f84c00b80d0 2023-06-09T04:38:19.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 >> v2:172.21.15.184:3300/0 conn(0x7f84c00b43f0 msgr2=0x7f84c00b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:19.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 --2- 172.21.15.149:0/2897521134 >> v2:172.21.15.184:3300/0 conn(0x7f84c00b43f0 0x7f84c00b4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 >> v1:172.21.15.184:6789/0 conn(0x7f84c00b5000 legacy=0x7f84c00cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00b4d50 con 0x7f84c00b80d0 2023-06-09T04:38:19.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f84b0001670 con 0x7f84c00b80d0 2023-06-09T04:38:19.329 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 >> v1:172.21.15.149:6789/0 conn(0x7f84c00b80d0 legacy=0x7f84c01606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84ac003a00 0x7f84ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84ac005200 0x7f84ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c00ccfc0 con 0x7f84ac004850 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac00c080 con 0x7f84ac005200 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac00c240 con 0x7f84ac003a00 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c59b8700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.330 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c69ba700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84ac005200 0x7f84ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c61b9700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84ac003a00 0x7f84ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c59b8700 1 -- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84ac003a00 msgr2=0x7f84ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:19.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c59b8700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84ac003a00 0x7f84ac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c59b8700 1 -- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84ac005200 msgr2=0x7f84ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:19.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c59b8700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84ac005200 0x7f84ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c69ba700 1 -- 172.21.15.149:0/2897521134 reap_dead start 2023-06-09T04:38:19.331 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c59b8700 1 -- 172.21.15.149:0/2897521134 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0035b0 con 0x7f84ac004850 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.254+0000 7f84c61b9700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84ac003a00 0x7f84ac003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c59b8700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84ac004cc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f84bc001800 tx=0x7f84ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fde302c8913eb9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0012f0 con 0x7f84ac004850 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc005310 con 0x7f84ac004850 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c51b7700 1 -- 172.21.15.149:0/2897521134 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc006860 con 0x7f84ac004850 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c841d700 1 -- 172.21.15.149:0/2897521134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 msgr2=0x7f84ac004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c841d700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84ac004cc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f84bc001800 tx=0x7f84ac005880 comp rx=0 tx=0).stop 2023-06-09T04:38:19.332 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c841d700 1 -- 172.21.15.149:0/2897521134 shutdown_connections 2023-06-09T04:38:19.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c841d700 1 --2- 172.21.15.149:0/2897521134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84ac004cc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c841d700 1 -- 172.21.15.149:0/2897521134 >> 172.21.15.149:0/2897521134 conn(0x7f84c0072120 msgr2=0x7f84c006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:19.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c841d700 1 -- 172.21.15.149:0/2897521134 shutdown_connections 2023-06-09T04:38:19.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.255+0000 7f84c841d700 1 -- 172.21.15.149:0/2897521134 wait complete. 2023-06-09T04:38:19.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.256+0000 7f84c841d700 1 Processor -- start 2023-06-09T04:38:19.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c841d700 1 -- start start 2023-06-09T04:38:19.333 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c841d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84c015bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c841d700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84c00ad4e0 0x7f84c00d1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c841d700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84c00d1660 0x7f84c01f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c841d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c00d1ae0 con 0x7f84ac004850 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c841d700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c015c450 con 0x7f84c00d1660 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c841d700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c00ac720 con 0x7f84c00ad4e0 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c61b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84c015bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c61b9700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84c015bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38596/0 (socket says 172.21.15.149:38596) 2023-06-09T04:38:19.334 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c61b9700 1 -- 172.21.15.149:0/2004252709 learned_addr learned my addr 172.21.15.149:0/2004252709 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:19.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.257+0000 7f84c69ba700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84c00d1660 0x7f84c01f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c59b8700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84c00ad4e0 0x7f84c00d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c61b9700 1 -- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84c00ad4e0 msgr2=0x7f84c00d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c61b9700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84c00ad4e0 0x7f84c00d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c61b9700 1 -- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84c00d1660 msgr2=0x7f84c01f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c61b9700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84c00d1660 0x7f84c01f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.335 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c61b9700 1 -- 172.21.15.149:0/2004252709 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00aca00 con 0x7f84ac004850 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c69ba700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84c00d1660 0x7f84c01f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c61b9700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84c015bf10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f84b0000fb0 tx=0x7f84b000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84b6ffd700 1 -- 172.21.15.149:0/2004252709 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000c570 con 0x7f84ac004850 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84b6ffd700 1 -- 172.21.15.149:0/2004252709 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000c6d0 con 0x7f84ac004850 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c00acce0 con 0x7f84ac004850 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84b6ffd700 1 -- 172.21.15.149:0/2004252709 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000ca60 con 0x7f84ac004850 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.258+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c01f2f70 con 0x7f84ac004850 2023-06-09T04:38:19.336 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.259+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c00ad200 con 0x7f84ac004850 2023-06-09T04:38:19.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.259+0000 7f84b6ffd700 1 -- 172.21.15.149:0/2004252709 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f84b000cbc0 con 0x7f84ac004850 2023-06-09T04:38:19.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.260+0000 7f84b6ffd700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a406ace0 0x7f84a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:19.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.260+0000 7f84b6ffd700 1 -- 172.21.15.149:0/2004252709 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f84b00893b0 con 0x7f84ac004850 2023-06-09T04:38:19.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.260+0000 7f84c59b8700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a406ace0 0x7f84a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:19.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.260+0000 7f84c59b8700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a406ace0 0x7f84a406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f84bc001800 tx=0x7f84bc009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:19.337 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.264+0000 7f84b6ffd700 1 -- 172.21.15.149:0/2004252709 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84c00ad200 con 0x7f84ac004850 2023-06-09T04:38:19.492 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.491+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84c00ad200 con 0x7f84ac004850 2023-06-09T04:38:19.493 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.492+0000 7f84b6ffd700 1 -- 172.21.15.149:0/2004252709 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4683 (secure 0 0 0) 0x7f84c00ad200 con 0x7f84ac004850 2023-06-09T04:38:19.493 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:19.493 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4850,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/2625829505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6835","nonce":2625829505},{"type":"v1","addr":"172.21.15.149:6837","nonce":2625829505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4862,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/1728628008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6833","nonce":1728628008},{"type":"v1","addr":"172.21.15.184:6835","nonce":1728628008}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6836/2662008754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":2662008754},{"type":"v1","addr":"172.21.15.149:6836","nonce":2662008754}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:38:14.198008+0000","modified":"2023-06-09T04:38:17.208246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5370},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5370":{"gid":5370,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.184:6834/1863694113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":1863694113},{"type":"v1","addr":"172.21.15.184:6834","nonce":1863694113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:38:19.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a406ace0 msgr2=0x7f84a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a406ace0 0x7f84a406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f84bc001800 tx=0x7f84bc009030 comp rx=0 tx=0).stop 2023-06-09T04:38:19.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 msgr2=0x7f84c015bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:19.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84c015bf10 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f84b0000fb0 tx=0x7f84b000ee80 comp rx=0 tx=0).stop 2023-06-09T04:38:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 shutdown_connections 2023-06-09T04:38:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f84a406ace0 0x7f84a406d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84c00d1660 0x7f84c01f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f84ac004850 0x7f84c015bf10 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 --2- 172.21.15.149:0/2004252709 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f84c00ad4e0 0x7f84c00d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 >> 172.21.15.149:0/2004252709 conn(0x7f84c0072120 msgr2=0x7f84c015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:19.496 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 shutdown_connections 2023-06-09T04:38:19.497 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:19.494+0000 7f84c841d700 1 -- 172.21.15.149:0/2004252709 wait complete. 2023-06-09T04:38:19.497 INFO:teuthology.orchestra.run.smithi149.stderr:dumped fsmap epoch 16 2023-06-09T04:38:19.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:38:14.198008+0000', 'modified': '2023-06-09T04:38:17.208246+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5370}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5370': {'gid': 5370, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.184:6834/1863694113', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 1863694113}, {'type': 'v1', 'addr': '172.21.15.184:6834', 'nonce': 1863694113}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:38:19.909 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:38:19.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-09T04:38:20.031 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.030+0000 7f7b8e4a8700 1 Processor -- start 2023-06-09T04:38:20.032 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b8e4a8700 1 -- start start 2023-06-09T04:38:20.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b8e4a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b88071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b8e4a8700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b880cd220 0x7f7b8806a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b8e4a8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8806a6c0 con 0x7f7b880b19a0 2023-06-09T04:38:20.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b8e4a8700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b88071320 con 0x7f7b880cd220 2023-06-09T04:38:20.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b8e4a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88071600 con 0x7f7b88069db0 2023-06-09T04:38:20.034 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b877fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b880cd220 0x7f7b8806a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b877fe700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7b880cd220 0x7f7b8806a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38604/0 (socket says 172.21.15.149:38604) 2023-06-09T04:38:20.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.031+0000 7f7b877fe700 1 -- 172.21.15.149:0/3266420742 learned_addr learned my addr 172.21.15.149:0/3266420742 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:20.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b87fff700 1 --2- 172.21.15.149:0/3266420742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b88071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b877fe700 1 -- 172.21.15.149:0/3266420742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 msgr2=0x7f7b88071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b877fe700 1 --2- 172.21.15.149:0/3266420742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b88071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.035 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b877fe700 1 -- 172.21.15.149:0/3266420742 >> v1:172.21.15.184:6789/0 conn(0x7f7b880b19a0 legacy=0x7f7b880ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b877fe700 1 -- 172.21.15.149:0/3266420742 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880ced70 con 0x7f7b880cd220 2023-06-09T04:38:20.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b87fff700 1 --2- 172.21.15.149:0/3266420742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b88071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:20.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b877fe700 1 --2- 172.21.15.149:0/3266420742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880cd220 0x7f7b8806a180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7b780098f0 tx=0x7f7b78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f0aa7160cc1e0c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b86ffd700 1 -- 172.21.15.149:0/3266420742 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78004230 con 0x7f7b880cd220 2023-06-09T04:38:20.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b86ffd700 1 -- 172.21.15.149:0/3266420742 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78004390 con 0x7f7b880cd220 2023-06-09T04:38:20.036 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.032+0000 7f7b86ffd700 1 -- 172.21.15.149:0/3266420742 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b780036a0 con 0x7f7b880cd220 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/3266420742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880cd220 msgr2=0x7f7b8806a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/3266420742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880cd220 0x7f7b8806a180 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f7b780098f0 tx=0x7f7b78009c00 comp rx=0 tx=0).stop 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/3266420742 shutdown_connections 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/3266420742 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b88071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/3266420742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880cd220 0x7f7b8806a180 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/3266420742 >> 172.21.15.149:0/3266420742 conn(0x7f7b8806aec0 msgr2=0x7f7b8806b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/3266420742 shutdown_connections 2023-06-09T04:38:20.037 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.033+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/3266420742 wait complete. 2023-06-09T04:38:20.039 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.034+0000 7f7b8e4a8700 1 Processor -- start 2023-06-09T04:38:20.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.034+0000 7f7b8e4a8700 1 -- start start 2023-06-09T04:38:20.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b8e4a8700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b881fa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b8e4a8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880b19a0 0x7f7b88155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b8e4a8700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b880cd220 0x7f7b880b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b8e4a8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b881fa8d0 con 0x7f7b880b19a0 2023-06-09T04:38:20.040 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b8e4a8700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88156120 con 0x7f7b880cd220 2023-06-09T04:38:20.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b8e4a8700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880c3180 con 0x7f7b88069db0 2023-06-09T04:38:20.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880b19a0 0x7f7b88155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880b19a0 0x7f7b88155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38612/0 (socket says 172.21.15.149:38612) 2023-06-09T04:38:20.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 -- 172.21.15.149:0/1920306188 learned_addr learned my addr 172.21.15.149:0/1920306188 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:20.041 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b881fa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b880cd220 0x7f7b880b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 -- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 msgr2=0x7f7b881fa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b881fa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 -- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b880cd220 msgr2=0x7f7b880b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b880cd220 0x7f7b880b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.042 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 -- 172.21.15.149:0/1920306188 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009550 con 0x7f7b880b19a0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880b19a0 0x7f7b88155be0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009130 tx=0x7f7b78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.035+0000 7f7b84ff9700 1 -- 172.21.15.149:0/1920306188 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78003cd0 con 0x7f7b880b19a0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.036+0000 7f7b84ff9700 1 -- 172.21.15.149:0/1920306188 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7801f070 con 0x7f7b880b19a0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.036+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b880c3a20 con 0x7f7b880b19a0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.036+0000 7f7b84ff9700 1 -- 172.21.15.149:0/1920306188 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800b8a0 con 0x7f7b880b19a0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.036+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880cc1d0 con 0x7f7b880b19a0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.037+0000 7f7b84ff9700 1 -- 172.21.15.149:0/1920306188 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b78021030 con 0x7f7b880b19a0 2023-06-09T04:38:20.043 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.037+0000 7f7b84ff9700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7406ace0 0x7f7b7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.037+0000 7f7b84ff9700 1 -- 172.21.15.149:0/1920306188 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b7808aaf0 con 0x7f7b880b19a0 2023-06-09T04:38:20.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.037+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7406ace0 0x7f7b7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.044 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.038+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7406ace0 0x7f7b7406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c006fd0 tx=0x7f7b7c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.039+0000 7f7b9a62db80 1 Processor -- start 2023-06-09T04:38:20.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.039+0000 7f7b9a62db80 1 -- start start 2023-06-09T04:38:20.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e42f0 0x561d103e0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.049 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e46c0 0x561d103e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d1042e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d102ea3b0 con 0x561d1042dc70 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d102ebc60 con 0x561d103e42f0 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d1033e570 con 0x561d103e46c0 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b8ca45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d1042e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b8ca45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d1042e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38622/0 (socket says 172.21.15.149:38622) 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b8ca45700 1 -- 172.21.15.149:0/1371815261 learned_addr learned my addr 172.21.15.149:0/1371815261 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:20.050 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e42f0 0x561d103e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e46c0 0x561d103e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b8ca45700 1 -- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e46c0 msgr2=0x561d103e4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e46c0 0x561d103e4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b8ca45700 1 -- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e42f0 msgr2=0x561d103e0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.040+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e42f0 0x561d103e0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b8ca45700 1 -- 172.21.15.149:0/1371815261 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d10165d90 con 0x561d1042dc70 2023-06-09T04:38:20.051 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e42f0 0x561d103e0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d1042e0e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000f380 tx=0x7f7b800049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0049bc9bd26fae server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b6dffb700 1 -- 172.21.15.149:0/1371815261 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80014470 con 0x561d1042dc70 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b6dffb700 1 -- 172.21.15.149:0/1371815261 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800145d0 con 0x561d1042dc70 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b6dffb700 1 -- 172.21.15.149:0/1371815261 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80014980 con 0x561d1042dc70 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1371815261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 msgr2=0x561d1042e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d1042e0e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000f380 tx=0x7f7b800049c0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1371815261 shutdown_connections 2023-06-09T04:38:20.052 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d1042e0e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e42f0 0x561d103e0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1371815261 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e46c0 0x561d103e4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1371815261 >> 172.21.15.149:0/1371815261 conn(0x561d103e2ce0 msgr2=0x561d1042b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1371815261 shutdown_connections 2023-06-09T04:38:20.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.041+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1371815261 wait complete. 2023-06-09T04:38:20.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.042+0000 7f7b9a62db80 1 -- start start 2023-06-09T04:38:20.053 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.042+0000 7f7b9a62db80 1 Processor -- start 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d1043aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d1040fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d10427280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d10337a00 con 0x561d1042dc70 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d102d7a70 con 0x561d103e46c0 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d102d7770 con 0x561d103e42f0 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b9a62db80 10 client.0 _ll_register_callbacks cb 0x561d102d5630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:20.054 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d10427280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d10427280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38628/0 (socket says 172.21.15.149:38628) 2023-06-09T04:38:20.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 -- 172.21.15.149:0/981613513 learned_addr learned my addr 172.21.15.149:0/981613513 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:20.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b87fff700 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d1043aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b877fe700 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d1040fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 -- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 msgr2=0x561d1043aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d1043aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.055 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 -- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 msgr2=0x561d1040fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d1040fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.043+0000 7f7b8ca45700 1 -- 172.21.15.149:0/981613513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b800047a0 con 0x561d1042dc70 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d10427280 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7b80004fc0 tx=0x7f7b80003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273a11fc0dfdd261 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b66ffd700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b66ffd700 1 -- 172.21.15.149:0/981613513 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b80014b50 con 0x561d1042dc70 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b66ffd700 1 -- 172.21.15.149:0/981613513 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b80014cb0 con 0x561d1042dc70 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d103d8850 con 0x561d1042dc70 2023-06-09T04:38:20.056 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b66ffd700 1 -- 172.21.15.149:0/981613513 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b80003c70 con 0x561d1042dc70 2023-06-09T04:38:20.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 10 client.5550 fetch_fsmap learned FSMap version 16 2023-06-09T04:38:20.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561d1014ec10 con 0x561d1042dc70 2023-06-09T04:38:20.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b66ffd700 1 -- 172.21.15.149:0/981613513 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d103d8850 con 0x561d1042dc70 2023-06-09T04:38:20.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b66ffd700 1 -- 172.21.15.149:0/981613513 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7b80012070 con 0x561d1042dc70 2023-06-09T04:38:20.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 10 client.5550 fetch_fsmap finished waiting for FSMap version 16 2023-06-09T04:38:20.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 10 client.5550 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:38:20.057 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 20 client.5550 populate_metadata read hostname 'smithi149' 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104277c0 0x561d1043e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 4 client.5550 mds_command: new command op to 5370 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 --> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d103309e0 con 0x561d104277c0 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.044+0000 7f7b87fff700 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104277c0 0x561d1043e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.045+0000 7f7b66ffd700 10 client.5550 ms_handle_connect on v2:172.21.15.184:6832/1863694113 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.045+0000 7f7b87fff700 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104277c0 0x561d1043e6b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9e12a9ab3e711c9 server_cookie=d84fc2a7d7adaaef in_seq=0 out_seq=0 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b66ffd700 1 -- 172.21.15.149:0/981613513 <== mds.0 v2:172.21.15.184:6832/1863694113 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561d103309e0 con 0x561d104277c0 2023-06-09T04:38:20.058 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b66ffd700 10 client.5550 handle_command_reply: tid=0 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 client.5550 shutdown 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 msgr2=0x561d10427280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d10427280 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7b80004fc0 tx=0x7f7b80003b00 comp rx=0 tx=0).stop 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 shutdown_connections 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104277c0 0x561d1043e6b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d1043aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d1042dc70 0x561d10427280 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.059 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b66ffd700 0 client.5550 ms_handle_reset on v2:172.21.15.184:6832/1863694113 2023-06-09T04:38:20.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/981613513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d1040fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 >> 172.21.15.149:0/981613513 conn(0x561d103e2ce0 msgr2=0x561d1042c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 shutdown_connections 2023-06-09T04:38:20.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 1 -- 172.21.15.149:0/981613513 wait complete. 2023-06-09T04:38:20.060 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.046+0000 7f7b9a62db80 20 client.5550 trim_cache size 0 max 16384 2023-06-09T04:38:20.064 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 Processor -- start 2023-06-09T04:38:20.065 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 -- start start 2023-06-09T04:38:20.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d103e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e46c0 0x561d103e2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.066 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d1042dc70 0x561d103e73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d101bb8d0 con 0x561d103e46c0 2023-06-09T04:38:20.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d103e4e80 con 0x561d1042dc70 2023-06-09T04:38:20.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d1042ade0 con 0x561d103e42f0 2023-06-09T04:38:20.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e46c0 0x561d103e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b877fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e46c0 0x561d103e2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38636/0 (socket says 172.21.15.149:38636) 2023-06-09T04:38:20.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.064+0000 7f7b877fe700 1 -- 172.21.15.149:0/4142845460 learned_addr learned my addr 172.21.15.149:0/4142845460 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:20.067 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b87fff700 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d103e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d1042dc70 0x561d103e73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b877fe700 1 -- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 msgr2=0x561d103e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b877fe700 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d103e3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.068 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b877fe700 1 -- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d1042dc70 msgr2=0x561d103e73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b877fe700 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d1042dc70 0x561d103e73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b877fe700 1 -- 172.21.15.149:0/4142845460 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d1018c200 con 0x561d103e46c0 2023-06-09T04:38:20.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b877fe700 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e46c0 0x561d103e2680 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000c00 tx=0x7f7b7805f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7e865351528d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b6e7fc700 1 -- 172.21.15.149:0/4142845460 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78061b00 con 0x561d103e46c0 2023-06-09T04:38:20.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b6e7fc700 1 -- 172.21.15.149:0/4142845460 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b780578f0 con 0x561d103e46c0 2023-06-09T04:38:20.069 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b6e7fc700 1 -- 172.21.15.149:0/4142845460 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78055ec0 con 0x561d103e46c0 2023-06-09T04:38:20.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b9a62db80 1 -- 172.21.15.149:0/4142845460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e46c0 msgr2=0x561d103e2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.065+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e46c0 0x561d103e2680 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7b78000c00 tx=0x7f7b7805f040 comp rx=0 tx=0).stop 2023-06-09T04:38:20.073 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 -- 172.21.15.149:0/4142845460 shutdown_connections 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d103e42f0 0x561d103e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d1042dc70 0x561d103e73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/4142845460 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e46c0 0x561d103e2680 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 -- 172.21.15.149:0/4142845460 >> 172.21.15.149:0/4142845460 conn(0x561d103e2ce0 msgr2=0x561d103d9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 -- 172.21.15.149:0/4142845460 shutdown_connections 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 -- 172.21.15.149:0/4142845460 wait complete. 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 -- start start 2023-06-09T04:38:20.074 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.066+0000 7f7b9a62db80 1 Processor -- start 2023-06-09T04:38:20.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e42f0 0x561d10491810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d10424400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b9a62db80 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d1042dc70 0x561d10424940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d1043aec0 con 0x561d103e42f0 2023-06-09T04:38:20.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d10491d50 con 0x561d103e46c0 2023-06-09T04:38:20.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b9a62db80 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d103e2aa0 con 0x561d1042dc70 2023-06-09T04:38:20.075 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b9a62db80 10 client.0 _ll_register_callbacks cb 0x561d102d5630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b87fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e42f0 0x561d10491810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b87fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e42f0 0x561d10491810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38638/0 (socket says 172.21.15.149:38638) 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b87fff700 1 -- 172.21.15.149:0/1160214062 learned_addr learned my addr 172.21.15.149:0/1160214062 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d10424400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b8ca45700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d1042dc70 0x561d10424940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b87fff700 1 -- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d1042dc70 msgr2=0x561d10424940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d1042dc70 0x561d10424940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.076 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b87fff700 1 -- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 msgr2=0x561d10424400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.067+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d10424400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b87fff700 1 -- 172.21.15.149:0/1160214062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880cc1d0 con 0x561d103e42f0 2023-06-09T04:38:20.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d10424400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:20.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b87fff700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e42f0 0x561d10491810 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00ff70 tx=0x7f7b7c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf1113899813ff2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b66ffd700 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2023-06-09T04:38:20.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b66ffd700 1 -- 172.21.15.149:0/1160214062 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c026040 con 0x561d103e42f0 2023-06-09T04:38:20.077 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b66ffd700 1 -- 172.21.15.149:0/1160214062 <== mon.0 v2:172.21.15.149:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7b7c01a040 con 0x561d103e42f0 2023-06-09T04:38:20.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b800145d0 con 0x561d103e42f0 2023-06-09T04:38:20.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b66ffd700 1 -- 172.21.15.149:0/1160214062 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b7c0159c0 con 0x561d103e42f0 2023-06-09T04:38:20.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 10 client.5556 fetch_fsmap learned FSMap version 16 2023-06-09T04:38:20.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561d10164260 con 0x561d103e42f0 2023-06-09T04:38:20.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b66ffd700 1 -- 172.21.15.149:0/1160214062 <== mon.0 v2:172.21.15.149:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b800145d0 con 0x561d103e42f0 2023-06-09T04:38:20.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b66ffd700 1 -- 172.21.15.149:0/1160214062 <== mon.0 v2:172.21.15.149:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7b7c015b20 con 0x561d103e42f0 2023-06-09T04:38:20.078 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 10 client.5556 fetch_fsmap finished waiting for FSMap version 16 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 10 client.5556 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 20 client.5556 populate_metadata read hostname 'smithi149' 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104210a0 0x561d10421470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 4 client.5556 mds_command: new command op to 5370 tid=0[{"prefix": "status"}] 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 --> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d102f3000 con 0x561d104210a0 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.068+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104210a0 0x561d10421470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b66ffd700 10 client.5556 ms_handle_connect on v2:172.21.15.184:6832/1863694113 2023-06-09T04:38:20.079 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b877fe700 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104210a0 0x561d10421470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eafffb86ebdc326 server_cookie=9f8578c5696468c3 in_seq=0 out_seq=0 2023-06-09T04:38:20.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b66ffd700 1 -- 172.21.15.149:0/1160214062 <== mds.0 v2:172.21.15.184:6832/1863694113 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561d102f3000 con 0x561d104210a0 2023-06-09T04:38:20.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b66ffd700 10 client.5556 handle_command_reply: tid=0 2023-06-09T04:38:20.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 client.5556 shutdown 2023-06-09T04:38:20.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e42f0 msgr2=0x561d10491810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e42f0 0x561d10491810 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c00ff70 tx=0x7f7b7c012000 comp rx=0 tx=0).stop 2023-06-09T04:38:20.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 shutdown_connections 2023-06-09T04:38:20.080 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:6832/1863694113,v1:172.21.15.184:6834/1863694113] conn(0x561d104210a0 0x561d10421470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x561d1042dc70 0x561d10424940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561d103e42f0 0x561d10491810 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 --2- 172.21.15.149:0/1160214062 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561d103e46c0 0x561d10424400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 >> 172.21.15.149:0/1160214062 conn(0x561d103e2ce0 msgr2=0x561d104107a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b66ffd700 0 client.5556 ms_handle_reset on v2:172.21.15.184:6832/1863694113 2023-06-09T04:38:20.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 shutdown_connections 2023-06-09T04:38:20.081 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 1 -- 172.21.15.149:0/1160214062 wait complete. 2023-06-09T04:38:20.082 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.069+0000 7f7b9a62db80 20 client.5556 trim_cache size 0 max 16384 2023-06-09T04:38:20.082 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2023-06-09T04:38:20.082 INFO:teuthology.orchestra.run.smithi149.stdout: "cluster_fsid": "8958df92-450c-4c1c-8166-a5a3573afffd", 2023-06-09T04:38:20.082 INFO:teuthology.orchestra.run.smithi149.stdout: "whoami": 0, 2023-06-09T04:38:20.082 INFO:teuthology.orchestra.run.smithi149.stdout: "id": 5370, 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "want_state": "up:active", 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "state": "up:active", 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "fs_name": "cephfs", 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "rank_uptime": 5.8706059860000002, 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "mdsmap_epoch": 16, 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch": 41, 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_epoch_barrier": 41, 2023-06-09T04:38:20.083 INFO:teuthology.orchestra.run.smithi149.stdout: "uptime": 13.117799441000001 2023-06-09T04:38:20.084 INFO:teuthology.orchestra.run.smithi149.stdout:} 2023-06-09T04:38:20.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7406ace0 msgr2=0x7f7b7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7406ace0 0x7f7b7406d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c006fd0 tx=0x7f7b7c008040 comp rx=0 tx=0).stop 2023-06-09T04:38:20.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880b19a0 msgr2=0x7f7b88155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880b19a0 0x7f7b88155be0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009130 tx=0x7f7b78004750 comp rx=0 tx=0).stop 2023-06-09T04:38:20.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 shutdown_connections 2023-06-09T04:38:20.085 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7b7406ace0 0x7f7b7406d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7b88069db0 0x7f7b881fa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b880cd220 0x7f7b880b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 --2- 172.21.15.149:0/1920306188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7b880b19a0 0x7f7b88155be0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 >> 172.21.15.149:0/1920306188 conn(0x7f7b8806aec0 msgr2=0x7f7b8815b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 shutdown_connections 2023-06-09T04:38:20.086 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.070+0000 7f7b8e4a8700 1 -- 172.21.15.149:0/1920306188 wait complete. 2023-06-09T04:38:20.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.205+0000 7fde6b03f700 1 Processor -- start 2023-06-09T04:38:20.206 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.205+0000 7fde6b03f700 1 -- start start 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde6b03f700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fde6415d650 0x7fde640af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde6b03f700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde6415e1a0 0x7fde640cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde6b03f700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6415e8c0 con 0x7fde6415d280 2023-06-09T04:38:20.208 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde6b03f700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640afeb0 con 0x7fde6415e1a0 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde6b03f700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640b3fa0 con 0x7fde6415d650 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde695dc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fde6415e1a0 0x7fde640cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde68ddb700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fde6415d280 0x7fde6415da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34278/0 (socket says 172.21.15.149:34278) 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde68ddb700 1 -- 172.21.15.149:0/2958051859 learned_addr learned my addr 172.21.15.149:0/2958051859 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde63fff700 1 --2- 172.21.15.149:0/2958051859 >> v2:172.21.15.184:3300/0 conn(0x7fde6415d650 0x7fde640af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde695dc700 1 -- 172.21.15.149:0/2958051859 >> v2:172.21.15.184:3300/0 conn(0x7fde6415d650 msgr2=0x7fde640af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:38:20.209 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.206+0000 7fde695dc700 1 --2- 172.21.15.149:0/2958051859 >> v2:172.21.15.184:3300/0 conn(0x7fde6415d650 0x7fde640af970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde695dc700 1 -- 172.21.15.149:0/2958051859 >> v1:172.21.15.149:6789/0 conn(0x7fde6415d280 legacy=0x7fde6415da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde695dc700 1 -- 172.21.15.149:0/2958051859 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640cdb10 con 0x7fde6415e1a0 2023-06-09T04:38:20.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde637fe700 1 -- 172.21.15.149:0/2958051859 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566826294 0 0) 0x7fde6415e8c0 con 0x7fde6415d280 2023-06-09T04:38:20.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde63fff700 1 --2- 172.21.15.149:0/2958051859 >> v2:172.21.15.184:3300/0 conn(0x7fde6415d650 0x7fde640af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:38:20.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde695dc700 1 --2- 172.21.15.149:0/2958051859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640cc570 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fde640cc0b0 tx=0x7fde5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3eceecbc0b33750 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.210 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde637fe700 1 -- 172.21.15.149:0/2958051859 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c00e070 con 0x7fde6415e1a0 2023-06-09T04:38:20.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde637fe700 1 -- 172.21.15.149:0/2958051859 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c00bbd0 con 0x7fde6415e1a0 2023-06-09T04:38:20.211 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde637fe700 1 -- 172.21.15.149:0/2958051859 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c012430 con 0x7fde6415e1a0 2023-06-09T04:38:20.213 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 -- 172.21.15.149:0/2958051859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 msgr2=0x7fde640cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2958051859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640cc570 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fde640cc0b0 tx=0x7fde5c00b330 comp rx=0 tx=0).stop 2023-06-09T04:38:20.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 -- 172.21.15.149:0/2958051859 shutdown_connections 2023-06-09T04:38:20.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2958051859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640cc570 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2958051859 >> v2:172.21.15.184:3300/0 conn(0x7fde6415d650 0x7fde640af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 -- 172.21.15.149:0/2958051859 >> 172.21.15.149:0/2958051859 conn(0x7fde64069db0 msgr2=0x7fde6406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 -- 172.21.15.149:0/2958051859 shutdown_connections 2023-06-09T04:38:20.214 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.207+0000 7fde6b03f700 1 -- 172.21.15.149:0/2958051859 wait complete. 2023-06-09T04:38:20.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.209+0000 7fde6b03f700 1 Processor -- start 2023-06-09T04:38:20.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.209+0000 7fde6b03f700 1 -- start start 2023-06-09T04:38:20.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.209+0000 7fde6b03f700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6415d280 0x7fde641f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.209+0000 7fde6b03f700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde6415d650 0x7fde641f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.209+0000 7fde6b03f700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.209+0000 7fde6b03f700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde641f2a60 con 0x7fde6415e1a0 2023-06-09T04:38:20.215 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde6b03f700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c5490 con 0x7fde6415d650 2023-06-09T04:38:20.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde6b03f700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640ce390 con 0x7fde6415d280 2023-06-09T04:38:20.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38656/0 (socket says 172.21.15.149:38656) 2023-06-09T04:38:20.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 -- 172.21.15.149:0/2404945288 learned_addr learned my addr 172.21.15.149:0/2404945288 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:38:20.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde63fff700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde6415d650 0x7fde641f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.216 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde68ddb700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6415d280 0x7fde641f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 -- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6415d280 msgr2=0x7fde641f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6415d280 0x7fde641f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 -- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde6415d650 msgr2=0x7fde641f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde6415d650 0x7fde641f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 -- 172.21.15.149:0/2404945288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009a70 con 0x7fde6415e1a0 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde63fff700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde6415d650 0x7fde641f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde68ddb700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6415d280 0x7fde641f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:38:20.217 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde695dc700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640c4c10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fde6406f750 tx=0x7fde5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde617fa700 1 -- 172.21.15.149:0/2404945288 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c012430 con 0x7fde6415e1a0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde617fa700 1 -- 172.21.15.149:0/2404945288 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c020070 con 0x7fde6415e1a0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde640ce670 con 0x7fde6415e1a0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde617fa700 1 -- 172.21.15.149:0/2404945288 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c004280 con 0x7fde6415e1a0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.210+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde640cec30 con 0x7fde6415e1a0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.211+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde64073fa0 con 0x7fde6415e1a0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.212+0000 7fde617fa700 1 -- 172.21.15.149:0/2404945288 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde5c0043e0 con 0x7fde6415e1a0 2023-06-09T04:38:20.218 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.212+0000 7fde617fa700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fde4806ace0 0x7fde4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:38:20.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.212+0000 7fde617fa700 1 -- 172.21.15.149:0/2404945288 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fde5c022070 con 0x7fde6415e1a0 2023-06-09T04:38:20.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.212+0000 7fde68ddb700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fde4806ace0 0x7fde4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:38:20.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.212+0000 7fde68ddb700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fde4806ace0 0x7fde4806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde58007fd0 tx=0x7fde58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:38:20.219 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.216+0000 7fde617fa700 1 -- 172.21.15.149:0/2404945288 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde5c056780 con 0x7fde6415e1a0 2023-06-09T04:38:20.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.447+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fde640b2720 con 0x7fde6415e1a0 2023-06-09T04:38:20.448 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.447+0000 7fde617fa700 1 -- 172.21.15.149:0/2404945288 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fde5c059da0 con 0x7fde6415e1a0 2023-06-09T04:38:20.449 INFO:teuthology.orchestra.run.smithi149.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:38:20.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fde4806ace0 msgr2=0x7fde4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fde4806ace0 0x7fde4806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fde58007fd0 tx=0x7fde58009040 comp rx=0 tx=0).stop 2023-06-09T04:38:20.451 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 msgr2=0x7fde640c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:38:20.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640c4c10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fde6406f750 tx=0x7fde5c004ad0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 shutdown_connections 2023-06-09T04:38:20.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fde4806ace0 0x7fde4806d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fde6415d280 0x7fde641f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fde6415e1a0 0x7fde640c4c10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 --2- 172.21.15.149:0/2404945288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde6415d650 0x7fde641f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:38:20.452 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 >> 172.21.15.149:0/2404945288 conn(0x7fde64069db0 msgr2=0x7fde64158d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:38:20.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 shutdown_connections 2023-06-09T04:38:20.453 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:38:20.450+0000 7fde6b03f700 1 -- 172.21.15.149:0/2404945288 wait complete. 2023-06-09T04:38:20.463 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-09T04:38:20.463 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:38:20.464 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi149.front.sepia.ceph.com 2023-06-09T04:38:20.464 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:38:20.464 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:20.465 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-09T04:38:20.465 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-09T04:38:20.465 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:38:20.465 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:38:20.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.466 DEBUG:teuthology.orchestra.run.smithi149:> ip addr 2023-06-09T04:38:20.483 INFO:teuthology.orchestra.run.smithi149.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:38:20.483 INFO:teuthology.orchestra.run.smithi149.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:38:20.483 INFO:teuthology.orchestra.run.smithi149.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:38:20.483 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:20.483 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 ::1/128 scope host 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a4 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:da:6b:a5 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:56 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:20.484 INFO:teuthology.orchestra.run.smithi149.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:38:20.485 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether 0c:c4:7a:88:7d:57 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:20.485 INFO:teuthology.orchestra.run.smithi149.stdout: inet 172.21.15.149/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-09T04:38:20.485 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft 42213sec preferred_lft 42213sec 2023-06-09T04:38:20.485 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::c1e6:9d48:acd9:41ca/64 scope link noprefixroute 2023-06-09T04:38:20.485 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:20.485 INFO:teuthology.orchestra.run.smithi149.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:38:20.485 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether ba:2c:d7:e8:ce:37 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b0b5:d8ff:febd:c80d/64 scope link 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether ee:ab:30:7e:cf:fd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::ecab:30ff:fe7e:cffd/64 scope link 2023-06-09T04:38:20.486 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:20.487 INFO:teuthology.orchestra.run.smithi149.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:38:20.487 INFO:teuthology.orchestra.run.smithi149.stdout: link/ether ba:2c:d7:e8:ce:37 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:38:20.487 INFO:teuthology.orchestra.run.smithi149.stdout: inet6 fe80::b82c:d7ff:fee8:ce37/64 scope link 2023-06-09T04:38:20.487 INFO:teuthology.orchestra.run.smithi149.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:38:20.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.488 DEBUG:teuthology.orchestra.run.smithi149:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:38:20.547 INFO:teuthology.orchestra.run.smithi149.stdout:1 2023-06-09T04:38:20.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.549 DEBUG:teuthology.orchestra.run.smithi149:> route 2023-06-09T04:38:20.607 INFO:teuthology.orchestra.run.smithi149.stdout:Kernel IP routing table 2023-06-09T04:38:20.608 INFO:teuthology.orchestra.run.smithi149.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:38:20.608 INFO:teuthology.orchestra.run.smithi149.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:38:20.608 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-09T04:38:20.608 INFO:teuthology.orchestra.run.smithi149.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:38:20.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.610 DEBUG:teuthology.orchestra.run.smithi149:> (cd / && exec bash -c ' 2023-06-09T04:38:20.610 DEBUG:teuthology.orchestra.run.smithi149:> set -e 2023-06-09T04:38:20.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:38:20.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:38:20.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:38:20.611 DEBUG:teuthology.orchestra.run.smithi149:> ') 2023-06-09T04:38:20.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.713 DEBUG:teuthology.orchestra.run.smithi149:> ip netns list 2023-06-09T04:38:20.729 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-09T04:38:20.730 INFO:teuthology.orchestra.run.smithi149.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:38:20.730 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:38:20.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.731 DEBUG:teuthology.orchestra.run.smithi149:> sudo ip link set brx.0 up 2023-06-09T04:38:20.796 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:20.797 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:20.853 INFO:teuthology.orchestra.run.smithi149.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:38:20.853 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:38:20.854 DEBUG:teuthology.orchestra.run.smithi149:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:20.908 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:38:20.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:20.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:38:20.993 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:38:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:38:20.994 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:38:21.002 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:38:21.002 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:38:21.002 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:38:21.003 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:38:21.003 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:38:21.028 INFO:teuthology.orchestra.run.smithi149.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:38:21.028 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:38:21.029 INFO:teuthology.orchestra.run.smithi149.stdout:invalid new device string format 2023-06-09T04:38:21.029 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:3300,172.21.15.184:3300,172.21.15.184:3301" 2023-06-09T04:38:21.029 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:38:21.029 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: resolved to: "172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790" 2023-06-09T04:38:21.029 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.149:6789,172.21.15.184:6789,172.21.15.184:6790:/ 2023-06-09T04:38:21.029 INFO:teuthology.orchestra.run.smithi149.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8958df92-450c-4c1c-8166-a5a3573afffd" will pass to kernel 2023-06-09T04:38:21.031 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:38:21.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.032 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:38:21.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.062 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:38:21.149 INFO:teuthology.orchestra.run.smithi149.stdout:client5568 2023-06-09T04:38:21.149 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:38:21.150 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:38:21.166 DEBUG:teuthology.orchestra.run.smithi149:> mktemp -d --suffix=xfstests-dev 2023-06-09T04:38:21.221 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.cJJFcf5ijVxfstests-dev 2023-06-09T04:38:21.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.222 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.cJJFcf5ijVxfstests-dev) 2023-06-09T04:38:21.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:21.290 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.cJJFcf5ijVxfstests-dev) 2023-06-09T04:38:21.349 INFO:teuthology.orchestra.run.smithi149.stderr:Cloning into '/tmp/tmp.cJJFcf5ijVxfstests-dev'... 2023-06-09T04:38:22.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:22.017 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-09T04:38:22.079 DEBUG:teuthology.orchestra.run.smithi149:> mktemp -d --suffix=test 2023-06-09T04:38:22.135 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.p05IS5EmxFtest 2023-06-09T04:38:22.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:38:22.136 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-09T04:38:22.193 DEBUG:teuthology.orchestra.run.smithi149:> mktemp -d --suffix=scratch 2023-06-09T04:38:22.248 INFO:teuthology.orchestra.run.smithi149.stdout:/tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:38:22.249 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-06-09T04:38:22.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-06-09T04:38:22.649 INFO:teuthology.orchestra.run.smithi149.stdout:Updating Subscription Management repositories. 2023-06-09T04:38:23.454 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:06:27 ago on Fri 09 Jun 2023 04:31:56 AM UTC. 2023-06-09T04:38:24.739 INFO:teuthology.orchestra.run.smithi149.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:38:24.740 INFO:teuthology.orchestra.run.smithi149.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:38:24.741 INFO:teuthology.orchestra.run.smithi149.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-09T04:38:24.743 INFO:teuthology.orchestra.run.smithi149.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-09T04:38:24.744 INFO:teuthology.orchestra.run.smithi149.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-09T04:38:24.746 INFO:teuthology.orchestra.run.smithi149.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-06-09T04:38:24.748 INFO:teuthology.orchestra.run.smithi149.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-09T04:38:24.749 INFO:teuthology.orchestra.run.smithi149.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-06-09T04:38:24.751 INFO:teuthology.orchestra.run.smithi149.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-09T04:38:24.752 INFO:teuthology.orchestra.run.smithi149.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-06-09T04:38:24.753 INFO:teuthology.orchestra.run.smithi149.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-09T04:38:24.755 INFO:teuthology.orchestra.run.smithi149.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-09T04:38:24.756 INFO:teuthology.orchestra.run.smithi149.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-09T04:38:24.757 INFO:teuthology.orchestra.run.smithi149.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-09T04:38:24.758 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-09T04:38:24.759 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:38:24.760 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-09T04:38:24.761 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-09T04:38:24.763 INFO:teuthology.orchestra.run.smithi149.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-09T04:38:24.764 INFO:teuthology.orchestra.run.smithi149.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-06-09T04:38:24.765 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:38:24.767 INFO:teuthology.orchestra.run.smithi149.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-06-09T04:38:24.771 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-09T04:38:24.886 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2023-06-09T04:38:24.888 INFO:teuthology.orchestra.run.smithi149.stdout:==================================================================================================================== 2023-06-09T04:38:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2023-06-09T04:38:24.889 INFO:teuthology.orchestra.run.smithi149.stdout:==================================================================================================================== 2023-06-09T04:38:24.889 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2023-06-09T04:38:24.889 INFO:teuthology.orchestra.run.smithi149.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-06-09T04:38:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-06-09T04:38:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-09T04:38:24.890 INFO:teuthology.orchestra.run.smithi149.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-06-09T04:38:24.891 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2023-06-09T04:38:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-06-09T04:38:24.891 INFO:teuthology.orchestra.run.smithi149.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-06-09T04:38:24.891 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2023-06-09T04:38:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-06-09T04:38:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-06-09T04:38:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-06-09T04:38:24.892 INFO:teuthology.orchestra.run.smithi149.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-06-09T04:38:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-06-09T04:38:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-06-09T04:38:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-06-09T04:38:24.893 INFO:teuthology.orchestra.run.smithi149.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-06-09T04:38:24.894 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2023-06-09T04:38:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-06-09T04:38:24.894 INFO:teuthology.orchestra.run.smithi149.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-06-09T04:38:24.894 INFO:teuthology.orchestra.run.smithi149.stdout:Enabling module streams: 2023-06-09T04:38:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: python27 2.7 2023-06-09T04:38:24.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:24.895 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2023-06-09T04:38:24.895 INFO:teuthology.orchestra.run.smithi149.stdout:==================================================================================================================== 2023-06-09T04:38:24.896 INFO:teuthology.orchestra.run.smithi149.stdout:Install 14 Packages 2023-06-09T04:38:24.896 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 2 Packages 2023-06-09T04:38:24.896 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:38:24.897 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 12 M 2023-06-09T04:38:24.897 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2023-06-09T04:38:25.006 INFO:teuthology.orchestra.run.smithi149.stdout:(1/16): dump-0.4-0.36.b46.el8.x86_64.rpm 2.2 MB/s | 164 kB 00:00 2023-06-09T04:38:25.023 INFO:teuthology.orchestra.run.smithi149.stdout:(2/16): rmt-1.5.3-13.el8.x86_64.rpm 571 kB/s | 51 kB 00:00 2023-06-09T04:38:25.040 INFO:teuthology.orchestra.run.smithi149.stdout:(3/16): daxctl-libs-71.1-3.el8.x86_64.rpm 1.2 MB/s | 42 kB 00:00 2023-06-09T04:38:25.065 INFO:teuthology.orchestra.run.smithi149.stdout:(4/16): ndctl-libs-71.1-3.el8.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2023-06-09T04:38:25.091 INFO:teuthology.orchestra.run.smithi149.stdout:(5/16): python2-setuptools-wheel-39.0.1-13.modu 5.6 MB/s | 287 kB 00:00 2023-06-09T04:38:25.124 INFO:teuthology.orchestra.run.smithi149.stdout:(6/16): python2-setuptools-39.0.1-13.module+el8 11 MB/s | 642 kB 00:00 2023-06-09T04:38:25.176 INFO:teuthology.orchestra.run.smithi149.stdout:(7/16): python2-wheel-wheel-0.31.1-3.module+el8 523 kB/s | 45 kB 00:00 2023-06-09T04:38:25.217 INFO:teuthology.orchestra.run.smithi149.stdout:(8/16): fio-3.19-3.el8.x86_64.rpm 5.7 MB/s | 538 kB 00:00 2023-06-09T04:38:25.242 INFO:teuthology.orchestra.run.smithi149.stdout:(9/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.4 MB/s | 92 kB 00:00 2023-06-09T04:38:25.267 INFO:teuthology.orchestra.run.smithi149.stdout:(10/16): python2-2.7.18-10.module+el8.6.0+14191 2.1 MB/s | 110 kB 00:00 2023-06-09T04:38:25.334 INFO:teuthology.orchestra.run.smithi149.stdout:(11/16): python2-pip-9.0.3-19.module+el8.6.0+13 25 MB/s | 1.6 MB 00:00 2023-06-09T04:38:25.384 INFO:teuthology.orchestra.run.smithi149.stdout:(12/16): python2-pip-wheel-9.0.3-19.module+el8. 18 MB/s | 892 kB 00:00 2023-06-09T04:38:25.468 INFO:teuthology.orchestra.run.smithi149.stdout:(13/16): python2-libs-2.7.18-10.module+el8.6.0+ 26 MB/s | 6.0 MB 00:00 2023-06-09T04:38:25.510 INFO:teuthology.orchestra.run.smithi149.stdout:(14/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 5.2 MB/s | 668 kB 00:00 2023-06-09T04:38:25.544 INFO:teuthology.orchestra.run.smithi149.stdout:(15/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2023-06-09T04:38:28.585 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:28.588 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:58.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:38:58.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:28.765 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:28.768 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:58.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:58.838 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:28.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:28.901 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:33.457 INFO:teuthology.orchestra.run.smithi149.stdout:[MIRROR] indent-2.2.13-2.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/i/indent-2.2.13-2.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-06-09T04:40:33.703 INFO:teuthology.orchestra.run.smithi149.stdout:(16/16): indent-2.2.13-2.el8.x86_64.rpm 1.4 kB/s | 187 kB 02:08 2023-06-09T04:40:33.704 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2023-06-09T04:40:33.704 INFO:teuthology.orchestra.run.smithi149.stdout:Total 94 kB/s | 12 MB 02:08 2023-06-09T04:40:33.904 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2023-06-09T04:40:33.943 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2023-06-09T04:40:33.944 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2023-06-09T04:40:34.130 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2023-06-09T04:40:34.135 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2023-06-09T04:40:34.851 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2023-06-09T04:40:35.108 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-06-09T04:40:35.236 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-09T04:40:35.289 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-06-09T04:40:35.494 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-09T04:40:35.596 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-06-09T04:40:35.794 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-09T04:40:35.897 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-09T04:40:36.047 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 5/18 2023-06-09T04:40:36.357 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-06-09T04:40:36.975 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-06-09T04:40:37.230 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 8/18 2023-06-09T04:40:37.419 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-06-09T04:40:38.536 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-06-09T04:40:38.842 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 10/18 2023-06-09T04:40:39.019 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 11/18 2023-06-09T04:40:39.361 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-06-09T04:40:39.607 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-06-09T04:40:39.780 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-06-09T04:40:39.987 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-06-09T04:40:40.161 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-06-09T04:40:40.302 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-06-09T04:40:40.458 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-09T04:40:40.785 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-09T04:40:40.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-06-09T04:40:40.785 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/18 2023-06-09T04:40:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/18 2023-06-09T04:40:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 4/18 2023-06-09T04:40:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 5/18 2023-06-09T04:40:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-06-09T04:40:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-06-09T04:40:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 8/18 2023-06-09T04:40:40.786 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fio-3.19-3.el8.x86_64 9/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 10/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 11/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 12/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 13/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 14/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-06-09T04:40:40.787 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-06-09T04:40:42.146 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-06-09T04:40:42.146 INFO:teuthology.orchestra.run.smithi149.stdout:Last metadata expiration check: 0:08:46 ago on Fri 09 Jun 2023 04:31:56 AM UTC. 2023-06-09T04:40:44.616 INFO:teuthology.orchestra.run.smithi149.stdout:Installed products updated. 2023-06-09T04:40:44.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:40:44.813 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2023-06-09T04:40:44.813 INFO:teuthology.orchestra.run.smithi149.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-06-09T04:40:44.813 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2023-06-09T04:40:44.813 INFO:teuthology.orchestra.run.smithi149.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-06-09T04:40:44.813 INFO:teuthology.orchestra.run.smithi149.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-09T04:40:44.813 INFO:teuthology.orchestra.run.smithi149.stdout: fio-3.19-3.el8.x86_64 2023-06-09T04:40:44.813 INFO:teuthology.orchestra.run.smithi149.stdout: indent-2.2.13-2.el8.x86_64 2023-06-09T04:40:44.814 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-09T04:40:44.814 INFO:teuthology.orchestra.run.smithi149.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-06-09T04:40:44.814 INFO:teuthology.orchestra.run.smithi149.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-09T04:40:44.814 INFO:teuthology.orchestra.run.smithi149.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-06-09T04:40:44.814 INFO:teuthology.orchestra.run.smithi149.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-09T04:40:44.814 INFO:teuthology.orchestra.run.smithi149.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-06-09T04:40:44.814 INFO:teuthology.orchestra.run.smithi149.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-09T04:40:44.815 INFO:teuthology.orchestra.run.smithi149.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-06-09T04:40:44.815 INFO:teuthology.orchestra.run.smithi149.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-06-09T04:40:44.815 INFO:teuthology.orchestra.run.smithi149.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-09T04:40:44.815 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:40:44.815 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2023-06-09T04:40:44.984 DEBUG:teuthology.orchestra.run.smithi149:> sudo useradd -m fsgqa 2023-06-09T04:40:45.012 INFO:teuthology.orchestra.run.smithi149.stderr:useradd: user 'fsgqa' already exists 2023-06-09T04:40:45.013 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:40:45.014 DEBUG:teuthology.orchestra.run.smithi149:> sudo groupadd fsgqa 2023-06-09T04:40:45.079 INFO:teuthology.orchestra.run.smithi149.stderr:groupadd: group 'fsgqa' already exists 2023-06-09T04:40:45.080 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:40:45.081 DEBUG:teuthology.orchestra.run.smithi149:> sudo useradd fsgqa2 2023-06-09T04:40:46.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo useradd 123456-fsgqa 2023-06-09T04:40:46.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-09T04:40:47.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.107+0000 7fb1f160b700 1 Processor -- start 2023-06-09T04:40:47.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.107+0000 7fb1f160b700 1 -- start start 2023-06-09T04:40:47.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1f160b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1ec0701b0 0x7fb1ec0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1f160b700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec0c9c80 con 0x7fb1ec0cea20 2023-06-09T04:40:47.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1f160b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ec0c8ba0 con 0x7fb1ec158840 2023-06-09T04:40:47.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1f160b700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec0ceec0 con 0x7fb1ec0701b0 2023-06-09T04:40:47.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1ea7fc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7fb1ec0701b0 0x7fb1ec0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1eb7fe700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7fb1ec0cea20 0x7fb1ec0cd360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:34316/0 (socket says 172.21.15.149:34316) 2023-06-09T04:40:47.110 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1eb7fe700 1 -- 172.21.15.149:0/57532164 learned_addr learned my addr 172.21.15.149:0/57532164 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T04:40:47.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1ea7fc700 1 -- 172.21.15.149:0/57532164 >> v1:172.21.15.184:6789/0 conn(0x7fb1ec158840 legacy=0x7fb1ec0c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1ea7fc700 1 -- 172.21.15.149:0/57532164 >> v1:172.21.15.149:6789/0 conn(0x7fb1ec0cea20 legacy=0x7fb1ec0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.108+0000 7fb1ea7fc700 1 -- 172.21.15.149:0/57532164 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0c8e80 con 0x7fb1ec0701b0 2023-06-09T04:40:47.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1ea7fc700 1 --2- 172.21.15.149:0/57532164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec0701b0 0x7fb1ec0ce4e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009840 tx=0x7fb1dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459d3f5296dcd35a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:47.111 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1e9ffb700 1 -- 172.21.15.149:0/57532164 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc010800 con 0x7fb1ec0701b0 2023-06-09T04:40:47.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1e9ffb700 1 -- 172.21.15.149:0/57532164 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc010960 con 0x7fb1ec0701b0 2023-06-09T04:40:47.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1e9ffb700 1 -- 172.21.15.149:0/57532164 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc010cf0 con 0x7fb1ec0701b0 2023-06-09T04:40:47.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1f160b700 1 -- 172.21.15.149:0/57532164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec0701b0 msgr2=0x7fb1ec0ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1f160b700 1 --2- 172.21.15.149:0/57532164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec0701b0 0x7fb1ec0ce4e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009840 tx=0x7fb1dc009b50 comp rx=0 tx=0).stop 2023-06-09T04:40:47.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1f160b700 1 -- 172.21.15.149:0/57532164 shutdown_connections 2023-06-09T04:40:47.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1f160b700 1 --2- 172.21.15.149:0/57532164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec0701b0 0x7fb1ec0ce4e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.112 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1f160b700 1 -- 172.21.15.149:0/57532164 >> 172.21.15.149:0/57532164 conn(0x7fb1ec06aa40 msgr2=0x7fb1ec0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:47.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1f160b700 1 -- 172.21.15.149:0/57532164 shutdown_connections 2023-06-09T04:40:47.113 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.109+0000 7fb1f160b700 1 -- 172.21.15.149:0/57532164 wait complete. 2023-06-09T04:40:47.114 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.111+0000 7fb1f160b700 1 Processor -- start 2023-06-09T04:40:47.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.111+0000 7fb1f160b700 1 -- start start 2023-06-09T04:40:47.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1ec0701b0 0x7fb1ec1e1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1ec0cea20 0x7fb1ec153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec158840 0x7fb1ec0ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0ae510 con 0x7fb1ec158840 2023-06-09T04:40:47.115 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0ad0f0 con 0x7fb1ec0cea20 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0adb70 con 0x7fb1ec0701b0 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec158840 0x7fb1ec0ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec158840 0x7fb1ec0ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38694/0 (socket says 172.21.15.149:38694) 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 -- 172.21.15.149:0/1583389047 learned_addr learned my addr 172.21.15.149:0/1583389047 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 -- 172.21.15.149:0/1583389047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1ec0701b0 msgr2=0x7fb1ec1e1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eaffd700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1ec0701b0 0x7fb1ec1e1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1ec0701b0 0x7fb1ec1e1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.116 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 -- 172.21.15.149:0/1583389047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1ec0cea20 msgr2=0x7fb1ec153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1ec0cea20 0x7fb1ec153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 -- 172.21.15.149:0/1583389047 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc0094a0 con 0x7fb1ec158840 2023-06-09T04:40:47.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1eb7fe700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec158840 0x7fb1ec0ac7e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400cbc0 tx=0x7fb1e400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:47.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1d37fe700 1 -- 172.21.15.149:0/1583389047 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e400ab50 con 0x7fb1ec158840 2023-06-09T04:40:47.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1d37fe700 1 -- 172.21.15.149:0/1583389047 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e400acb0 con 0x7fb1ec158840 2023-06-09T04:40:47.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec0ade50 con 0x7fb1ec158840 2023-06-09T04:40:47.117 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1d37fe700 1 -- 172.21.15.149:0/1583389047 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4012600 con 0x7fb1ec158840 2023-06-09T04:40:47.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.112+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec0acd20 con 0x7fb1ec158840 2023-06-09T04:40:47.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.113+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec0ae650 con 0x7fb1ec158840 2023-06-09T04:40:47.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.114+0000 7fb1d37fe700 1 -- 172.21.15.149:0/1583389047 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1e401b3b0 con 0x7fb1ec158840 2023-06-09T04:40:47.118 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.114+0000 7fb1d37fe700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb1d806ace0 0x7fb1d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.114+0000 7fb1d37fe700 1 -- 172.21.15.149:0/1583389047 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb1e40890e0 con 0x7fb1ec158840 2023-06-09T04:40:47.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.114+0000 7fb1eaffd700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb1d806ace0 0x7fb1d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.119 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.115+0000 7fb1eaffd700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb1d806ace0 0x7fb1d806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0000f60 tx=0x7fb1e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:47.120 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.119+0000 7fb1d37fe700 1 -- 172.21.15.149:0/1583389047 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb1ec0ae650 con 0x7fb1ec158840 2023-06-09T04:40:47.389 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.388+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb1ec0c9c80 con 0x7fb1ec158840 2023-06-09T04:40:47.390 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.389+0000 7fb1d37fe700 1 -- 172.21.15.149:0/1583389047 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7fb1ec0c9c80 con 0x7fb1ec158840 2023-06-09T04:40:47.390 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:40:47.390 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":1,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","modified":"2023-06-09T04:36:00.108213Z","created":"2023-06-09T04:36:00.108213Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3301","nonce":0},{"type":"v1","addr":"172.21.15.184:6790","nonce":0}]},"addr":"172.21.15.184:6790/0","public_addr":"172.21.15.184:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-09T04:40:47.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb1d806ace0 msgr2=0x7fb1d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb1d806ace0 0x7fb1d806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0000f60 tx=0x7fb1e0009040 comp rx=0 tx=0).stop 2023-06-09T04:40:47.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec158840 msgr2=0x7fb1ec0ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.392 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec158840 0x7fb1ec0ac7e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400cbc0 tx=0x7fb1e400cf80 comp rx=0 tx=0).stop 2023-06-09T04:40:47.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 shutdown_connections 2023-06-09T04:40:47.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fb1d806ace0 0x7fb1d806d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fb1ec0701b0 0x7fb1ec1e1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb1ec158840 0x7fb1ec0ac7e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 --2- 172.21.15.149:0/1583389047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1ec0cea20 0x7fb1ec153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 >> 172.21.15.149:0/1583389047 conn(0x7fb1ec06aa40 msgr2=0x7fb1ec070710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:47.393 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 shutdown_connections 2023-06-09T04:40:47.394 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.391+0000 7fb1f160b700 1 -- 172.21.15.149:0/1583389047 wait complete. 2023-06-09T04:40:47.394 INFO:teuthology.orchestra.run.smithi149.stderr:dumped monmap epoch 1 2023-06-09T04:40:47.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-09T04:40:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.555+0000 7f7e7dbcc700 1 Processor -- start 2023-06-09T04:40:47.556 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.555+0000 7f7e7dbcc700 1 -- start start 2023-06-09T04:40:47.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.555+0000 7f7e7dbcc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7815e420 0x7f7e780cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e7dbcc700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e780cca40 0x7f7e78163ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e7dbcc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780cdb80 con 0x7f7e7815e050 2023-06-09T04:40:47.557 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e7dbcc700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e780ce310 con 0x7f7e780cca40 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e7dbcc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780ce5f0 con 0x7f7e7815e420 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e780cca40 0x7f7e78163ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7f7e780cca40 0x7f7e78163ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38702/0 (socket says 172.21.15.149:38702) 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 -- 172.21.15.149:0/3474869641 learned_addr learned my addr 172.21.15.149:0/3474869641 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e6ffff700 1 --2- 172.21.15.149:0/3474869641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7815e420 0x7f7e780cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 -- 172.21.15.149:0/3474869641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7815e420 msgr2=0x7f7e780cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 --2- 172.21.15.149:0/3474869641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7815e420 0x7f7e780cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.558 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 -- 172.21.15.149:0/3474869641 >> v1:172.21.15.184:6789/0 conn(0x7f7e7815e050 legacy=0x7f7e780cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 -- 172.21.15.149:0/3474869641 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780ce8d0 con 0x7f7e780cca40 2023-06-09T04:40:47.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e6ffff700 1 --2- 172.21.15.149:0/3474869641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7815e420 0x7f7e780cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:47.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e77fff700 1 --2- 172.21.15.149:0/3474869641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780cca40 0x7f7e78163ba0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009e50 tx=0x7f7e7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619aff0d87534ec4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:47.559 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e76ffd700 1 -- 172.21.15.149:0/3474869641 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7000e070 con 0x7f7e780cca40 2023-06-09T04:40:47.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e76ffd700 1 -- 172.21.15.149:0/3474869641 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7000b9c0 con 0x7f7e780cca40 2023-06-09T04:40:47.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.556+0000 7f7e76ffd700 1 -- 172.21.15.149:0/3474869641 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7000bd70 con 0x7f7e780cca40 2023-06-09T04:40:47.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3474869641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780cca40 msgr2=0x7f7e78163ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3474869641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780cca40 0x7f7e78163ba0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009e50 tx=0x7f7e7000b330 comp rx=0 tx=0).stop 2023-06-09T04:40:47.561 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3474869641 shutdown_connections 2023-06-09T04:40:47.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3474869641 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e780cca40 0x7f7e78163ba0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3474869641 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e7815e420 0x7f7e780cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3474869641 >> 172.21.15.149:0/3474869641 conn(0x7f7e78069db0 msgr2=0x7f7e7806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:47.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3474869641 shutdown_connections 2023-06-09T04:40:47.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.557+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3474869641 wait complete. 2023-06-09T04:40:47.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.558+0000 7f7e7dbcc700 1 Processor -- start 2023-06-09T04:40:47.562 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.558+0000 7f7e7dbcc700 1 -- start start 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e7dbcc700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e780cca40 0x7f7e780c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e7dbcc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e7815e050 0x7f7e781579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e7dbcc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7815e420 0x7f7e7806c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e7dbcc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e781f2910 con 0x7f7e7815e420 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e7dbcc700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e781f2bf0 con 0x7f7e7815e050 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e7dbcc700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e781f2ed0 con 0x7f7e780cca40 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7815e420 0x7f7e7806c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.563 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7815e420 0x7f7e7806c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:38708/0 (socket says 172.21.15.149:38708) 2023-06-09T04:40:47.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 -- 172.21.15.149:0/3545759981 learned_addr learned my addr 172.21.15.149:0/3545759981 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T04:40:47.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 -- 172.21.15.149:0/3545759981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e780cca40 msgr2=0x7f7e780c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e780cca40 0x7f7e780c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e6ffff700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e7815e050 0x7f7e781579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 -- 172.21.15.149:0/3545759981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e7815e050 msgr2=0x7f7e781579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e7815e050 0x7f7e781579b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.564 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.559+0000 7f7e77fff700 1 -- 172.21.15.149:0/3545759981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70009b30 con 0x7f7e7815e420 2023-06-09T04:40:47.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.560+0000 7f7e77fff700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7815e420 0x7f7e7806c710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e7806e130 tx=0x7f7e70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:47.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.560+0000 7f7e74ff9700 1 -- 172.21.15.149:0/3545759981 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70003ea0 con 0x7f7e7815e420 2023-06-09T04:40:47.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.560+0000 7f7e74ff9700 1 -- 172.21.15.149:0/3545759981 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e700092e0 con 0x7f7e7815e420 2023-06-09T04:40:47.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.560+0000 7f7e74ff9700 1 -- 172.21.15.149:0/3545759981 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7001c660 con 0x7f7e7815e420 2023-06-09T04:40:47.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.560+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e781f31b0 con 0x7f7e7815e420 2023-06-09T04:40:47.565 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.560+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e781f25c0 con 0x7f7e7815e420 2023-06-09T04:40:47.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.561+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7815c760 con 0x7f7e7815e420 2023-06-09T04:40:47.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.561+0000 7f7e74ff9700 1 -- 172.21.15.149:0/3545759981 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e7001c7c0 con 0x7f7e7815e420 2023-06-09T04:40:47.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.562+0000 7f7e74ff9700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e5806ace0 0x7f7e5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:47.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.562+0000 7f7e74ff9700 1 -- 172.21.15.149:0/3545759981 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7e7008b2f0 con 0x7f7e7815e420 2023-06-09T04:40:47.566 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.562+0000 7f7e777fe700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e5806ace0 0x7f7e5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:47.567 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.562+0000 7f7e777fe700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e5806ace0 0x7f7e5806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e68000f60 tx=0x7f7e68007a60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:47.571 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.570+0000 7f7e74ff9700 1 -- 172.21.15.149:0/3545759981 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7e700562b0 con 0x7f7e7815e420 2023-06-09T04:40:47.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.842+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f7e780cac90 con 0x7f7e7815e420 2023-06-09T04:40:47.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.843+0000 7f7e74ff9700 1 -- 172.21.15.149:0/3545759981 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f7e700598d0 con 0x7f7e7815e420 2023-06-09T04:40:47.844 INFO:teuthology.orchestra.run.smithi149.stdout:[client.admin] 2023-06-09T04:40:47.844 INFO:teuthology.orchestra.run.smithi149.stdout: key = AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== 2023-06-09T04:40:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e5806ace0 msgr2=0x7f7e5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e5806ace0 0x7f7e5806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7e68000f60 tx=0x7f7e68007a60 comp rx=0 tx=0).stop 2023-06-09T04:40:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7815e420 msgr2=0x7f7e7806c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7815e420 0x7f7e7806c710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7e7806e130 tx=0x7f7e70004ad0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 shutdown_connections 2023-06-09T04:40:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f7e5806ace0 0x7f7e5806d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f7e780cca40 0x7f7e780c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e7815e420 0x7f7e7806c710 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 --2- 172.21.15.149:0/3545759981 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e7815e050 0x7f7e781579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 >> 172.21.15.149:0/3545759981 conn(0x7f7e78069db0 msgr2=0x7f7e7815c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 shutdown_connections 2023-06-09T04:40:47.847 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T04:40:47.845+0000 7f7e7dbcc700 1 -- 172.21.15.149:0/3545759981 wait complete. 2023-06-09T04:40:47.858 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:40:47.859 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/tmp/tmp.cJJFcf5ijVxfstests-dev/local.config 2023-06-09T04:40:47.896 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.149:6789:/test export TEST_DIR=/tmp/tmp.p05IS5EmxFtest export SCRATCH_DEV=172.21.15.149:6789:/scratch export SCRATCH_MNT=/tmp/tmp.37bCAzag0Bscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw==" 2023-06-09T04:40:47.897 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T04:40:47.897 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/tmp/tmp.cJJFcf5ijVxfstests-dev/ceph.exclude 2023-06-09T04:40:47.962 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo make) 2023-06-09T04:40:48.048 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize -cfi 2023-06-09T04:40:48.364 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-09T04:40:48.365 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './config.guess' 2023-06-09T04:40:48.368 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './config.sub' 2023-06-09T04:40:48.371 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './install-sh' 2023-06-09T04:40:48.375 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file './ltmain.sh' 2023-06-09T04:40:48.395 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-09T04:40:48.395 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-09T04:40:48.400 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-09T04:40:48.404 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-09T04:40:48.408 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-09T04:40:48.413 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-09T04:40:48.418 INFO:teuthology.orchestra.run.smithi149.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-09T04:40:48.420 INFO:teuthology.orchestra.run.smithi149.stdout:cp include/install-sh . 2023-06-09T04:40:48.421 INFO:teuthology.orchestra.run.smithi149.stdout:aclocal -I m4 2023-06-09T04:40:49.583 INFO:teuthology.orchestra.run.smithi149.stdout:autoheader 2023-06-09T04:40:49.888 INFO:teuthology.orchestra.run.smithi149.stdout:autoconf 2023-06-09T04:40:50.046 INFO:teuthology.orchestra.run.smithi149.stdout:./configure \ 2023-06-09T04:40:50.046 INFO:teuthology.orchestra.run.smithi149.stdout: --libexecdir=/usr/lib \ 2023-06-09T04:40:50.046 INFO:teuthology.orchestra.run.smithi149.stdout: --exec_prefix=/var/lib 2023-06-09T04:40:50.517 INFO:teuthology.orchestra.run.smithi149.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-09T04:40:50.517 INFO:teuthology.orchestra.run.smithi149.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-09T04:40:50.518 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to print strings... printf 2023-06-09T04:40:50.519 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... gcc 2023-06-09T04:40:50.648 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether the C compiler works... yes 2023-06-09T04:40:50.648 INFO:teuthology.orchestra.run.smithi149.stdout:checking for C compiler default output file name... a.out 2023-06-09T04:40:50.675 INFO:teuthology.orchestra.run.smithi149.stdout:checking for suffix of executables... 2023-06-09T04:40:50.721 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are cross compiling... no 2023-06-09T04:40:50.739 INFO:teuthology.orchestra.run.smithi149.stdout:checking for suffix of object files... o 2023-06-09T04:40:50.755 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... yes 2023-06-09T04:40:50.771 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... yes 2023-06-09T04:40:50.797 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-09T04:40:50.800 INFO:teuthology.orchestra.run.smithi149.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-09T04:40:50.802 INFO:teuthology.orchestra.run.smithi149.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-09T04:40:50.803 INFO:teuthology.orchestra.run.smithi149.stdout:checking for egrep... /bin/grep -E 2023-06-09T04:40:50.804 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fgrep... /bin/grep -F 2023-06-09T04:40:50.807 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ld used by gcc... /bin/ld 2023-06-09T04:40:50.809 INFO:teuthology.orchestra.run.smithi149.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-09T04:40:50.819 INFO:teuthology.orchestra.run.smithi149.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-09T04:40:50.835 INFO:teuthology.orchestra.run.smithi149.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-09T04:40:50.835 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether ln -s works... yes 2023-06-09T04:40:50.844 INFO:teuthology.orchestra.run.smithi149.stdout:checking the maximum length of command line arguments... 1572864 2023-06-09T04:40:50.846 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-09T04:40:50.847 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-09T04:40:50.847 INFO:teuthology.orchestra.run.smithi149.stdout:checking for /bin/ld option to reload object files... -r 2023-06-09T04:40:50.847 INFO:teuthology.orchestra.run.smithi149.stdout:checking for objdump... objdump 2023-06-09T04:40:50.848 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to recognize dependent libraries... pass_all 2023-06-09T04:40:50.848 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dlltool... no 2023-06-09T04:40:50.848 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-09T04:40:50.849 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ar... ar 2023-06-09T04:40:50.876 INFO:teuthology.orchestra.run.smithi149.stdout:checking for archiver @FILE support... @ 2023-06-09T04:40:50.877 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strip... strip 2023-06-09T04:40:50.877 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ranlib... ranlib 2023-06-09T04:40:50.877 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gawk... gawk 2023-06-09T04:40:50.927 INFO:teuthology.orchestra.run.smithi149.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-09T04:40:50.928 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sysroot... no 2023-06-09T04:40:50.931 INFO:teuthology.orchestra.run.smithi149.stdout:checking for a working dd... /bin/dd 2023-06-09T04:40:50.933 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-09T04:40:50.946 INFO:teuthology.orchestra.run.smithi149.stdout:checking for mt... no 2023-06-09T04:40:50.948 INFO:teuthology.orchestra.run.smithi149.stdout:checking if : is a manifest tool... no 2023-06-09T04:40:50.977 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to run the C preprocessor... gcc -E 2023-06-09T04:40:51.095 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ANSI C header files... yes 2023-06-09T04:40:51.115 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/types.h... yes 2023-06-09T04:40:51.146 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/stat.h... yes 2023-06-09T04:40:51.169 INFO:teuthology.orchestra.run.smithi149.stdout:checking for stdlib.h... yes 2023-06-09T04:40:51.193 INFO:teuthology.orchestra.run.smithi149.stdout:checking for string.h... yes 2023-06-09T04:40:51.217 INFO:teuthology.orchestra.run.smithi149.stdout:checking for memory.h... yes 2023-06-09T04:40:51.240 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strings.h... yes 2023-06-09T04:40:51.267 INFO:teuthology.orchestra.run.smithi149.stdout:checking for inttypes.h... yes 2023-06-09T04:40:51.291 INFO:teuthology.orchestra.run.smithi149.stdout:checking for stdint.h... yes 2023-06-09T04:40:51.318 INFO:teuthology.orchestra.run.smithi149.stdout:checking for unistd.h... yes 2023-06-09T04:40:51.343 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dlfcn.h... yes 2023-06-09T04:40:51.346 INFO:teuthology.orchestra.run.smithi149.stdout:checking for objdir... .libs 2023-06-09T04:40:51.412 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-09T04:40:51.412 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-09T04:40:51.431 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-09T04:40:51.553 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc static flag -static works... no 2023-06-09T04:40:51.573 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -c -o file.o... yes 2023-06-09T04:40:51.574 INFO:teuthology.orchestra.run.smithi149.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-09T04:40:51.580 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-09T04:40:51.603 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether -lc should be explicitly linked in... no 2023-06-09T04:40:51.646 INFO:teuthology.orchestra.run.smithi149.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-09T04:40:51.646 INFO:teuthology.orchestra.run.smithi149.stdout:checking how to hardcode library paths into programs... immediate 2023-06-09T04:40:51.649 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether stripping libraries is possible... yes 2023-06-09T04:40:51.649 INFO:teuthology.orchestra.run.smithi149.stdout:checking if libtool supports shared libraries... yes 2023-06-09T04:40:51.649 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether to build shared libraries... yes 2023-06-09T04:40:51.649 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether to build static libraries... yes 2023-06-09T04:40:51.654 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc... (cached) gcc 2023-06-09T04:40:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-09T04:40:51.668 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-09T04:40:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-09T04:40:51.669 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gmake... /usr/bin/gmake 2023-06-09T04:40:51.669 INFO:teuthology.orchestra.run.smithi149.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-09T04:40:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:checking for tar... /bin/tar 2023-06-09T04:40:51.670 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gzip... /bin/gzip 2023-06-09T04:40:51.676 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether gcc -MM is supported... yes 2023-06-09T04:40:51.677 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sort... /bin/sort 2023-06-09T04:40:51.677 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether ln -s works... yes 2023-06-09T04:40:51.677 INFO:teuthology.orchestra.run.smithi149.stdout:checking for rpm... /bin/rpm 2023-06-09T04:40:51.681 INFO:teuthology.orchestra.run.smithi149.stdout:checking for rpmbuild... no 2023-06-09T04:40:51.705 INFO:teuthology.orchestra.run.smithi149.stdout:checking assert.h usability... yes 2023-06-09T04:40:51.712 INFO:teuthology.orchestra.run.smithi149.stdout:checking assert.h presence... yes 2023-06-09T04:40:51.712 INFO:teuthology.orchestra.run.smithi149.stdout:checking for assert.h... yes 2023-06-09T04:40:51.738 INFO:teuthology.orchestra.run.smithi149.stdout:checking bstring.h usability... no 2023-06-09T04:40:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:checking bstring.h presence... no 2023-06-09T04:40:51.747 INFO:teuthology.orchestra.run.smithi149.stdout:checking for bstring.h... no 2023-06-09T04:40:51.771 INFO:teuthology.orchestra.run.smithi149.stdout:checking libgen.h usability... yes 2023-06-09T04:40:51.778 INFO:teuthology.orchestra.run.smithi149.stdout:checking libgen.h presence... yes 2023-06-09T04:40:51.778 INFO:teuthology.orchestra.run.smithi149.stdout:checking for libgen.h... yes 2023-06-09T04:40:51.805 INFO:teuthology.orchestra.run.smithi149.stdout:checking dirent.h usability... yes 2023-06-09T04:40:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:checking dirent.h presence... yes 2023-06-09T04:40:51.813 INFO:teuthology.orchestra.run.smithi149.stdout:checking for dirent.h... yes 2023-06-09T04:40:51.864 INFO:teuthology.orchestra.run.smithi149.stdout:checking errno.h usability... yes 2023-06-09T04:40:51.871 INFO:teuthology.orchestra.run.smithi149.stdout:checking errno.h presence... yes 2023-06-09T04:40:51.871 INFO:teuthology.orchestra.run.smithi149.stdout:checking for errno.h... yes 2023-06-09T04:40:51.898 INFO:teuthology.orchestra.run.smithi149.stdout:checking malloc.h usability... yes 2023-06-09T04:40:51.906 INFO:teuthology.orchestra.run.smithi149.stdout:checking malloc.h presence... yes 2023-06-09T04:40:51.907 INFO:teuthology.orchestra.run.smithi149.stdout:checking for malloc.h... yes 2023-06-09T04:40:51.932 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid.h usability... no 2023-06-09T04:40:51.943 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid.h presence... no 2023-06-09T04:40:51.943 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid.h... no 2023-06-09T04:40:51.984 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid/uuid.h usability... yes 2023-06-09T04:40:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:checking uuid/uuid.h presence... yes 2023-06-09T04:40:51.993 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid/uuid.h... yes 2023-06-09T04:40:52.018 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/uuid.h usability... no 2023-06-09T04:40:52.027 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/uuid.h presence... no 2023-06-09T04:40:52.028 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/uuid.h... no 2023-06-09T04:40:52.053 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/file.h usability... yes 2023-06-09T04:40:52.060 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/file.h presence... yes 2023-06-09T04:40:52.060 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/file.h... yes 2023-06-09T04:40:52.087 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fcntl.h usability... yes 2023-06-09T04:40:52.094 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fcntl.h presence... yes 2023-06-09T04:40:52.095 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/fcntl.h... yes 2023-06-09T04:40:52.121 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/syssgi.h usability... no 2023-06-09T04:40:52.130 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/syssgi.h presence... no 2023-06-09T04:40:52.130 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/syssgi.h... no 2023-06-09T04:40:52.180 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/param.h usability... yes 2023-06-09T04:40:52.190 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/param.h presence... yes 2023-06-09T04:40:52.190 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/param.h... yes 2023-06-09T04:40:52.195 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/stat.h... (cached) yes 2023-06-09T04:40:52.222 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/statvfs.h usability... yes 2023-06-09T04:40:52.229 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/statvfs.h presence... yes 2023-06-09T04:40:52.229 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/statvfs.h... yes 2023-06-09T04:40:52.255 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/time.h usability... yes 2023-06-09T04:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/time.h presence... yes 2023-06-09T04:40:52.262 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/time.h... yes 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/ioctl.h usability... yes 2023-06-09T04:40:52.303 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/ioctl.h presence... yes 2023-06-09T04:40:52.303 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/ioctl.h... yes 2023-06-09T04:40:52.331 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/wait.h usability... yes 2023-06-09T04:40:52.340 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/wait.h presence... yes 2023-06-09T04:40:52.340 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/wait.h... yes 2023-06-09T04:40:52.345 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/types.h... (cached) yes 2023-06-09T04:40:52.350 INFO:teuthology.orchestra.run.smithi149.stdout:checking for strings.h... (cached) yes 2023-06-09T04:40:52.376 INFO:teuthology.orchestra.run.smithi149.stdout:checking err.h usability... yes 2023-06-09T04:40:52.383 INFO:teuthology.orchestra.run.smithi149.stdout:checking err.h presence... yes 2023-06-09T04:40:52.383 INFO:teuthology.orchestra.run.smithi149.stdout:checking for err.h... yes 2023-06-09T04:40:52.415 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/falloc.h usability... yes 2023-06-09T04:40:52.422 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/falloc.h presence... yes 2023-06-09T04:40:52.422 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/falloc.h... yes 2023-06-09T04:40:52.448 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-09T04:40:52.457 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-09T04:40:52.457 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-09T04:40:52.480 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-09T04:40:52.489 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-09T04:40:52.490 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-09T04:40:52.512 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/platform_defs.h usability... no 2023-06-09T04:40:52.521 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/platform_defs.h presence... no 2023-06-09T04:40:52.522 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/platform_defs.h... no 2023-06-09T04:40:52.544 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfs/ioctl.h usability... no 2023-06-09T04:40:52.553 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfs/ioctl.h presence... no 2023-06-09T04:40:52.553 INFO:teuthology.orchestra.run.smithi149.stdout:checking for btrfs/ioctl.h... no 2023-06-09T04:40:52.576 INFO:teuthology.orchestra.run.smithi149.stdout:checking cifs/ioctl.h usability... no 2023-06-09T04:40:52.585 INFO:teuthology.orchestra.run.smithi149.stdout:checking cifs/ioctl.h presence... no 2023-06-09T04:40:52.585 INFO:teuthology.orchestra.run.smithi149.stdout:checking for cifs/ioctl.h... no 2023-06-09T04:40:52.610 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/mman.h usability... yes 2023-06-09T04:40:52.617 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/mman.h presence... yes 2023-06-09T04:40:52.618 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/mman.h... yes 2023-06-09T04:40:52.632 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/xfs_log_format.h... no 2023-06-09T04:40:52.665 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid_compare... no 2023-06-09T04:40:52.695 INFO:teuthology.orchestra.run.smithi149.stdout:checking for uuid_compare in -luuid... yes 2023-06-09T04:40:52.747 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/xfs.h... yes 2023-06-09T04:40:52.760 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/libxfs.h... no 2023-06-09T04:40:52.775 INFO:teuthology.orchestra.run.smithi149.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-09T04:40:52.801 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/xqm.h... yes 2023-06-09T04:40:52.845 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-09T04:40:52.868 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/handle.h usability... yes 2023-06-09T04:40:52.874 INFO:teuthology.orchestra.run.smithi149.stdout:checking xfs/handle.h presence... yes 2023-06-09T04:40:52.874 INFO:teuthology.orchestra.run.smithi149.stdout:checking for xfs/handle.h... yes 2023-06-09T04:40:52.911 INFO:teuthology.orchestra.run.smithi149.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-09T04:40:52.946 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/acl.h usability... yes 2023-06-09T04:40:52.954 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/acl.h presence... yes 2023-06-09T04:40:52.954 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/acl.h... yes 2023-06-09T04:40:52.991 INFO:teuthology.orchestra.run.smithi149.stdout:checking acl/libacl.h usability... yes 2023-06-09T04:40:52.998 INFO:teuthology.orchestra.run.smithi149.stdout:checking acl/libacl.h presence... yes 2023-06-09T04:40:52.998 INFO:teuthology.orchestra.run.smithi149.stdout:checking for acl/libacl.h... yes 2023-06-09T04:40:53.030 INFO:teuthology.orchestra.run.smithi149.stdout:checking for acl_init in -lacl... yes 2023-06-09T04:40:53.051 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm-ndbm.h usability... no 2023-06-09T04:40:53.061 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm-ndbm.h presence... no 2023-06-09T04:40:53.061 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gdbm-ndbm.h... no 2023-06-09T04:40:53.081 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm/ndbm.h usability... no 2023-06-09T04:40:53.091 INFO:teuthology.orchestra.run.smithi149.stdout:checking gdbm/ndbm.h presence... no 2023-06-09T04:40:53.091 INFO:teuthology.orchestra.run.smithi149.stdout:checking for gdbm/ndbm.h... no 2023-06-09T04:40:53.112 INFO:teuthology.orchestra.run.smithi149.stdout:checking ndbm.h usability... no 2023-06-09T04:40:53.121 INFO:teuthology.orchestra.run.smithi149.stdout:checking ndbm.h presence... no 2023-06-09T04:40:53.121 INFO:teuthology.orchestra.run.smithi149.stdout:checking for ndbm.h... no 2023-06-09T04:40:53.145 INFO:teuthology.orchestra.run.smithi149.stdout:checking libaio.h usability... yes 2023-06-09T04:40:53.155 INFO:teuthology.orchestra.run.smithi149.stdout:checking libaio.h presence... yes 2023-06-09T04:40:53.156 INFO:teuthology.orchestra.run.smithi149.stdout:checking for libaio.h... yes 2023-06-09T04:40:53.178 INFO:teuthology.orchestra.run.smithi149.stdout:checking liburing.h usability... no 2023-06-09T04:40:53.187 INFO:teuthology.orchestra.run.smithi149.stdout:checking liburing.h presence... no 2023-06-09T04:40:53.187 INFO:teuthology.orchestra.run.smithi149.stdout:checking for liburing.h... no 2023-06-09T04:40:53.207 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/capability.h usability... no 2023-06-09T04:40:53.217 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/capability.h presence... no 2023-06-09T04:40:53.217 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/capability.h... no 2023-06-09T04:40:53.239 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fiemap.h usability... yes 2023-06-09T04:40:53.246 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fiemap.h presence... yes 2023-06-09T04:40:53.246 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/fiemap.h... yes 2023-06-09T04:40:53.277 INFO:teuthology.orchestra.run.smithi149.stdout:checking for fallocate... yes 2023-06-09T04:40:53.309 INFO:teuthology.orchestra.run.smithi149.stdout:checking for open_by_handle_at... yes 2023-06-09T04:40:53.356 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/prctl.h usability... yes 2023-06-09T04:40:53.363 INFO:teuthology.orchestra.run.smithi149.stdout:checking sys/prctl.h presence... yes 2023-06-09T04:40:53.363 INFO:teuthology.orchestra.run.smithi149.stdout:checking for sys/prctl.h... yes 2023-06-09T04:40:53.386 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fs.h usability... yes 2023-06-09T04:40:53.393 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/fs.h presence... yes 2023-06-09T04:40:53.393 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/fs.h... yes 2023-06-09T04:40:53.414 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfsutil.h usability... no 2023-06-09T04:40:53.424 INFO:teuthology.orchestra.run.smithi149.stdout:checking btrfsutil.h presence... no 2023-06-09T04:40:53.424 INFO:teuthology.orchestra.run.smithi149.stdout:checking for btrfsutil.h... no 2023-06-09T04:40:53.458 INFO:teuthology.orchestra.run.smithi149.stdout:checking for copy_file_range... yes 2023-06-09T04:40:53.492 INFO:teuthology.orchestra.run.smithi149.stdout:checking for SEEK_DATA... yes 2023-06-09T04:40:53.536 INFO:teuthology.orchestra.run.smithi149.stdout:checking for BMV_OF_SHARED... yes 2023-06-09T04:40:53.577 INFO:teuthology.orchestra.run.smithi149.stdout:checking for nftw... yes 2023-06-09T04:40:53.610 INFO:teuthology.orchestra.run.smithi149.stdout:checking for RLIMIT_NOFILE... yes 2023-06-09T04:40:53.626 INFO:teuthology.orchestra.run.smithi149.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-09T04:40:53.658 INFO:teuthology.orchestra.run.smithi149.stdout:checking for renameat2... yes 2023-06-09T04:40:53.690 INFO:teuthology.orchestra.run.smithi149.stdout:checking for reallocarray... yes 2023-06-09T04:40:53.703 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct mount_attr... no 2023-06-09T04:40:53.736 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-09T04:40:53.770 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-09T04:40:53.804 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-09T04:40:53.838 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-09T04:40:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-09T04:40:53.905 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-09T04:40:53.938 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-09T04:40:53.964 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs.h usability... yes 2023-06-09T04:40:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs.h presence... yes 2023-06-09T04:40:53.971 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/btrfs.h... yes 2023-06-09T04:40:54.000 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-09T04:40:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-09T04:40:54.007 INFO:teuthology.orchestra.run.smithi149.stdout:checking for linux/btrfs_tree.h... yes 2023-06-09T04:40:54.037 INFO:teuthology.orchestra.run.smithi149.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-09T04:40:54.053 INFO:teuthology.orchestra.run.smithi149.stdout:configure: creating ./config.status 2023-06-09T04:40:54.342 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: creating include/builddefs 2023-06-09T04:40:54.352 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: creating include/config.h 2023-06-09T04:40:54.360 INFO:teuthology.orchestra.run.smithi149.stdout:config.status: executing libtool commands 2023-06-09T04:40:54.397 INFO:teuthology.orchestra.run.smithi149.stdout:Building include 2023-06-09T04:40:54.400 INFO:teuthology.orchestra.run.smithi149.stdout:Building lib 2023-06-09T04:40:54.403 INFO:teuthology.orchestra.run.smithi149.stdout: [LTDEP] 2023-06-09T04:40:54.502 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dataascii.lo 2023-06-09T04:40:54.614 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] databin.lo 2023-06-09T04:40:54.750 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] datapid.lo 2023-06-09T04:40:54.847 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] file_lock.lo 2023-06-09T04:40:54.983 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] forker.lo 2023-06-09T04:40:55.106 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] pattern.lo 2023-06-09T04:40:55.220 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] open_flags.lo 2023-06-09T04:40:55.351 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] random_range.lo 2023-06-09T04:40:55.558 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] string_to_tokens.lo 2023-06-09T04:40:55.655 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] str_to_bytes.lo 2023-06-09T04:40:55.778 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] tlibio.lo 2023-06-09T04:40:55.989 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] write_log.lo 2023-06-09T04:40:56.207 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] random.lo 2023-06-09T04:40:56.331 INFO:teuthology.orchestra.run.smithi149.stdout: [LD] 2023-06-09T04:40:56.400 INFO:teuthology.orchestra.run.smithi149.stdout:Building ltp 2023-06-09T04:40:56.403 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-06-09T04:40:56.520 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] doio 2023-06-09T04:40:57.112 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsstress 2023-06-09T04:40:58.295 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsx 2023-06-09T04:40:58.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:58.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:59.079 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] growfiles 2023-06-09T04:40:59.538 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] iogen 2023-06-09T04:40:59.857 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-stress 2023-06-09T04:41:00.232 INFO:teuthology.orchestra.run.smithi149.stdout:Building src 2023-06-09T04:41:00.237 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-06-09T04:41:01.547 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-06-09T04:41:01.572 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-06-09T04:41:01.579 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-06-09T04:41:01.757 INFO:teuthology.orchestra.run.smithi149.stdout: [DEP] 2023-06-09T04:41:01.778 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dirstress 2023-06-09T04:41:01.992 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fill 2023-06-09T04:41:02.133 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fill2 2023-06-09T04:41:02.339 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] getpagesize 2023-06-09T04:41:02.465 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] holes 2023-06-09T04:41:02.639 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] lstat64 2023-06-09T04:41:02.805 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] nametest 2023-06-09T04:41:03.021 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] permname 2023-06-09T04:41:03.200 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] randholes 2023-06-09T04:41:03.423 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] runas 2023-06-09T04:41:03.583 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] truncfile 2023-06-09T04:41:03.745 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] usemem 2023-06-09T04:41:03.882 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mmapcat 2023-06-09T04:41:04.018 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] append_reader 2023-06-09T04:41:04.155 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] append_writer 2023-06-09T04:41:04.293 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dirperf 2023-06-09T04:41:04.490 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] metaperf 2023-06-09T04:41:04.721 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] devzero 2023-06-09T04:41:04.879 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] feature 2023-06-09T04:41:05.071 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] alloc 2023-06-09T04:41:05.261 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fault 2023-06-09T04:41:05.409 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fstest 2023-06-09T04:41:05.623 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_access_root 2023-06-09T04:41:05.764 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] godown 2023-06-09T04:41:05.917 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] resvtest 2023-06-09T04:41:06.085 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] writemod 2023-06-09T04:41:06.218 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] writev_on_pagefault 2023-06-09T04:41:06.363 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] makeextents 2023-06-09T04:41:06.524 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] itrash 2023-06-09T04:41:06.666 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] rename 2023-06-09T04:41:06.795 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] multi_open_unlink 2023-06-09T04:41:06.944 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] unwritten_sync 2023-06-09T04:41:07.107 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] genhashnames 2023-06-09T04:41:07.285 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_holes 2023-06-09T04:41:07.421 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_writev 2023-06-09T04:41:07.557 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_truncate_cmtime 2023-06-09T04:41:07.702 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dirhash_collide 2023-06-09T04:41:07.866 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_rename_overwrite 2023-06-09T04:41:07.996 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] holetest 2023-06-09T04:41:08.193 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_truncate_self 2023-06-09T04:41:08.322 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] af_unix 2023-06-09T04:41:08.461 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_stale_pmd 2023-06-09T04:41:08.601 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_cow_race 2023-06-09T04:41:08.752 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_fallocate 2023-06-09T04:41:08.889 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsync-err 2023-06-09T04:41:09.059 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_write_ro 2023-06-09T04:41:09.197 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-09T04:41:09.342 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-09T04:41:09.484 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_ofd_locks 2023-06-09T04:41:09.667 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_collision 2023-06-09T04:41:09.847 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mmap-write-concurrent 2023-06-09T04:41:10.001 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_get_file_time 2023-06-09T04:41:10.136 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_create_short_dirs 2023-06-09T04:41:10.289 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_create_long_dirs 2023-06-09T04:41:10.438 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_enospc 2023-06-09T04:41:10.608 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_writev_overlap 2023-06-09T04:41:10.763 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] checkpoint_journal 2023-06-09T04:41:10.903 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mmap-rw-fault 2023-06-09T04:41:11.067 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] allocstale 2023-06-09T04:41:11.220 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_cow_memory_failure 2023-06-09T04:41:11.376 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fake-dump-rootino 2023-06-09T04:41:11.513 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dio-buf-fault 2023-06-09T04:41:11.655 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfsctl 2023-06-09T04:41:11.825 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bstat 2023-06-09T04:41:12.008 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mtab 2023-06-09T04:41:12.175 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] getdevicesize 2023-06-09T04:41:12.305 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] preallo_rw_pattern_reader 2023-06-09T04:41:12.453 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] preallo_rw_pattern_writer 2023-06-09T04:41:12.599 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] ftrunc 2023-06-09T04:41:12.734 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] trunc 2023-06-09T04:41:12.883 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fs_perms 2023-06-09T04:41:13.032 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] testx 2023-06-09T04:41:13.154 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] looptest 2023-06-09T04:41:13.328 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] locktest 2023-06-09T04:41:13.604 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] unwritten_mmap 2023-06-09T04:41:13.755 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat_unlink_test 2023-06-09T04:41:13.935 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] deduperace 2023-06-09T04:41:14.111 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat_unlink_test_modified 2023-06-09T04:41:14.290 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_dir_offset 2023-06-09T04:41:14.426 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_futimens 2023-06-09T04:41:14.556 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_immutable 2023-06-09T04:41:15.098 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] stale_handle 2023-06-09T04:41:15.252 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] pwrite_mmap_blocked 2023-06-09T04:41:15.391 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_dir_offset2 2023-06-09T04:41:15.566 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] seek_sanity_test 2023-06-09T04:41:15.937 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] seek_copy_test 2023-06-09T04:41:16.097 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_readdir_1 2023-06-09T04:41:16.233 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_readdir_2 2023-06-09T04:41:16.372 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fsync-tester 2023-06-09T04:41:16.598 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] nsexec 2023-06-09T04:41:16.759 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] cloner 2023-06-09T04:41:16.920 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] renameat2 2023-06-09T04:41:17.070 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_getcwd 2023-06-09T04:41:17.216 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] e4compact 2023-06-09T04:41:17.400 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] test-nextquota 2023-06-09T04:41:17.555 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] punch-alternating 2023-06-09T04:41:17.710 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-09T04:41:17.863 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] listxattr 2023-06-09T04:41:18.000 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dio-interleaved 2023-06-09T04:41:18.211 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_dir_type 2023-06-09T04:41:18.357 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] dio-invalidate-cache 2023-06-09T04:41:18.541 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] stat_test 2023-06-09T04:41:18.810 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_encrypted_d_revalidate 2023-06-09T04:41:18.960 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] attr_replace_test 2023-06-09T04:41:19.108 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] swapon 2023-06-09T04:41:19.260 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mkswap 2023-06-09T04:41:19.401 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_attr_corruption 2023-06-09T04:41:19.539 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_open_tmpfiles 2023-06-09T04:41:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fscrypt-crypt-util 2023-06-09T04:41:20.273 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] bulkstat_null_ocount 2023-06-09T04:41:20.418 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] splice-test 2023-06-09T04:41:20.582 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] chprojid_fail 2023-06-09T04:41:20.730 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] detached_mounts_propagation 2023-06-09T04:41:20.897 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] ext4_resize 2023-06-09T04:41:21.036 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_readdir_3 2023-06-09T04:41:21.212 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] splice2pipe 2023-06-09T04:41:21.362 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] uuid_ioctl 2023-06-09T04:41:21.504 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fiemap-tester 2023-06-09T04:41:21.745 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_stripealign 2023-06-09T04:41:21.886 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] open_by_handle 2023-06-09T04:41:22.118 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] t_mmap_dio 2023-06-09T04:41:22.266 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] xfsfind 2023-06-09T04:41:22.440 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] fssum 2023-06-09T04:41:22.829 INFO:teuthology.orchestra.run.smithi149.stdout:Building log-writes 2023-06-09T04:41:22.834 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] replay-log 2023-06-09T04:41:23.113 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-06-09T04:41:23.116 INFO:teuthology.orchestra.run.smithi149.stdout:Building aio-dio-regress 2023-06-09T04:41:23.122 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-09T04:41:23.281 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-fcntl-race 2023-06-09T04:41:23.432 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-subblock-eof-read 2023-06-09T04:41:23.567 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-append-write-read-race 2023-06-09T04:41:23.730 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-invalidate-readahead 2023-06-09T04:41:23.883 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-write-verify 2023-06-09T04:41:24.059 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-09T04:41:24.187 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-last-ref-held-by-io 2023-06-09T04:41:24.348 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-cycle-write 2023-06-09T04:41:24.519 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-extend-stat 2023-06-09T04:41:24.673 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-09T04:41:24.799 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-hole-filling-race 2023-06-09T04:41:24.940 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-invalidate-failure 2023-06-09T04:41:25.088 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aiodio_sparse2 2023-06-09T04:41:25.286 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aiocp 2023-06-09T04:41:25.492 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-cow-race 2023-06-09T04:41:25.637 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] aio-dio-eof-race 2023-06-09T04:41:25.807 INFO:teuthology.orchestra.run.smithi149.stdout:Building vfs 2023-06-09T04:41:25.812 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] vfstest 2023-06-09T04:41:27.496 INFO:teuthology.orchestra.run.smithi149.stdout: [CC] mount-idmapped 2023-06-09T04:41:27.825 INFO:teuthology.orchestra.run.smithi149.stdout:Building m4 2023-06-09T04:41:27.828 INFO:teuthology.orchestra.run.smithi149.stdout:Building common 2023-06-09T04:41:27.832 INFO:teuthology.orchestra.run.smithi149.stdout:Building tests 2023-06-09T04:41:27.837 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-06-09T04:41:27.842 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/perf/group.list 2023-06-09T04:41:27.852 INFO:teuthology.orchestra.run.smithi149.stdout:Building ext4 2023-06-09T04:41:27.857 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ext4/group.list 2023-06-09T04:41:27.890 INFO:teuthology.orchestra.run.smithi149.stdout:Building ocfs2 2023-06-09T04:41:27.895 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ocfs2/group.list 2023-06-09T04:41:27.907 INFO:teuthology.orchestra.run.smithi149.stdout:Building overlay 2023-06-09T04:41:27.912 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/overlay/group.list 2023-06-09T04:41:27.945 INFO:teuthology.orchestra.run.smithi149.stdout:Building cifs 2023-06-09T04:41:27.950 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/cifs/group.list 2023-06-09T04:41:27.961 INFO:teuthology.orchestra.run.smithi149.stdout:Building generic 2023-06-09T04:41:27.968 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/generic/group.list 2023-06-09T04:41:28.055 INFO:teuthology.orchestra.run.smithi149.stdout:Building shared 2023-06-09T04:41:28.060 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/shared/group.list 2023-06-09T04:41:28.075 INFO:teuthology.orchestra.run.smithi149.stdout:Building nfs 2023-06-09T04:41:28.080 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/nfs/group.list 2023-06-09T04:41:28.092 INFO:teuthology.orchestra.run.smithi149.stdout:Building f2fs 2023-06-09T04:41:28.097 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/f2fs/group.list 2023-06-09T04:41:28.112 INFO:teuthology.orchestra.run.smithi149.stdout:Building udf 2023-06-09T04:41:28.117 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/udf/group.list 2023-06-09T04:41:28.127 INFO:teuthology.orchestra.run.smithi149.stdout:Building ceph 2023-06-09T04:41:28.132 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ceph/group.list 2023-06-09T04:41:28.144 INFO:teuthology.orchestra.run.smithi149.stdout:Building xfs 2023-06-09T04:41:28.151 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/xfs/group.list 2023-06-09T04:41:28.240 INFO:teuthology.orchestra.run.smithi149.stdout:Building btrfs 2023-06-09T04:41:28.246 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/btrfs/group.list 2023-06-09T04:41:28.298 INFO:teuthology.orchestra.run.smithi149.stdout:Building tmpfs 2023-06-09T04:41:28.302 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/tmpfs/group.list 2023-06-09T04:41:28.314 INFO:teuthology.orchestra.run.smithi149.stdout:Building selftest 2023-06-09T04:41:28.319 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/selftest/group.list 2023-06-09T04:41:28.332 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo make install) 2023-06-09T04:41:28.368 INFO:teuthology.orchestra.run.smithi149.stdout:Building include 2023-06-09T04:41:28.372 INFO:teuthology.orchestra.run.smithi149.stdout:Building lib 2023-06-09T04:41:28.375 INFO:teuthology.orchestra.run.smithi149.stdout:Building ltp 2023-06-09T04:41:28.379 INFO:teuthology.orchestra.run.smithi149.stdout:Building src 2023-06-09T04:41:28.412 INFO:teuthology.orchestra.run.smithi149.stdout:Building log-writes 2023-06-09T04:41:28.415 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-06-09T04:41:28.418 INFO:teuthology.orchestra.run.smithi149.stdout:Building aio-dio-regress 2023-06-09T04:41:28.422 INFO:teuthology.orchestra.run.smithi149.stdout:Building vfs 2023-06-09T04:41:28.426 INFO:teuthology.orchestra.run.smithi149.stdout:Building m4 2023-06-09T04:41:28.429 INFO:teuthology.orchestra.run.smithi149.stdout:Building common 2023-06-09T04:41:28.432 INFO:teuthology.orchestra.run.smithi149.stdout:Building tests 2023-06-09T04:41:28.437 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-06-09T04:41:28.442 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/perf/group.list 2023-06-09T04:41:28.453 INFO:teuthology.orchestra.run.smithi149.stdout:Building ext4 2023-06-09T04:41:28.458 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ext4/group.list 2023-06-09T04:41:28.491 INFO:teuthology.orchestra.run.smithi149.stdout:Building ocfs2 2023-06-09T04:41:28.496 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ocfs2/group.list 2023-06-09T04:41:28.507 INFO:teuthology.orchestra.run.smithi149.stdout:Building overlay 2023-06-09T04:41:28.512 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/overlay/group.list 2023-06-09T04:41:28.546 INFO:teuthology.orchestra.run.smithi149.stdout:Building cifs 2023-06-09T04:41:28.551 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/cifs/group.list 2023-06-09T04:41:28.562 INFO:teuthology.orchestra.run.smithi149.stdout:Building generic 2023-06-09T04:41:28.568 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/generic/group.list 2023-06-09T04:41:28.655 INFO:teuthology.orchestra.run.smithi149.stdout:Building shared 2023-06-09T04:41:28.660 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/shared/group.list 2023-06-09T04:41:28.675 INFO:teuthology.orchestra.run.smithi149.stdout:Building nfs 2023-06-09T04:41:28.680 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/nfs/group.list 2023-06-09T04:41:28.692 INFO:teuthology.orchestra.run.smithi149.stdout:Building f2fs 2023-06-09T04:41:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/f2fs/group.list 2023-06-09T04:41:28.712 INFO:teuthology.orchestra.run.smithi149.stdout:Building udf 2023-06-09T04:41:28.717 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/udf/group.list 2023-06-09T04:41:28.727 INFO:teuthology.orchestra.run.smithi149.stdout:Building ceph 2023-06-09T04:41:28.732 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ceph/group.list 2023-06-09T04:41:28.745 INFO:teuthology.orchestra.run.smithi149.stdout:Building xfs 2023-06-09T04:41:28.751 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/xfs/group.list 2023-06-09T04:41:28.839 INFO:teuthology.orchestra.run.smithi149.stdout:Building btrfs 2023-06-09T04:41:28.845 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/btrfs/group.list 2023-06-09T04:41:28.896 INFO:teuthology.orchestra.run.smithi149.stdout:Building tmpfs 2023-06-09T04:41:28.901 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/tmpfs/group.list 2023-06-09T04:41:28.912 INFO:teuthology.orchestra.run.smithi149.stdout:Building selftest 2023-06-09T04:41:28.917 INFO:teuthology.orchestra.run.smithi149.stdout: [GROUP] /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/selftest/group.list 2023-06-09T04:41:28.928 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-09T04:41:28.929 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:41:28.930 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-09T04:41:28.932 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:41:28.932 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-09T04:41:28.934 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-09T04:41:28.942 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-09T04:41:29.017 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-09T04:41:29.026 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-09T04:41:29.042 INFO:teuthology.orchestra.run.smithi149.stdout:Building log-writes 2023-06-09T04:41:29.045 INFO:teuthology.orchestra.run.smithi149.stdout:Building perf 2023-06-09T04:41:29.049 INFO:teuthology.orchestra.run.smithi149.stdout:Building aio-dio-regress 2023-06-09T04:41:29.052 INFO:teuthology.orchestra.run.smithi149.stdout:Building vfs 2023-06-09T04:41:29.055 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C log-writes install 2023-06-09T04:41:29.057 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-09T04:41:29.069 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-09T04:41:29.074 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:29.076 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:29.078 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C perf install 2023-06-09T04:41:29.080 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-09T04:41:29.088 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-09T04:41:29.110 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-09T04:41:29.112 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:41:29.121 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:41:29.172 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake -C vfs install 2023-06-09T04:41:29.174 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-09T04:41:29.183 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-09T04:41:29.194 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-09T04:41:29.203 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-09T04:41:30.385 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-09T04:41:30.478 INFO:teuthology.orchestra.run.smithi149.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-09T04:41:30.509 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-09T04:41:30.510 INFO:teuthology.orchestra.run.smithi149.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-09T04:41:30.510 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-09T04:41:30.512 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-09T04:41:30.520 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-09T04:41:30.651 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-09T04:41:30.652 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/btrfs/ install 2023-06-09T04:41:30.655 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-09T04:41:30.664 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-09T04:41:31.449 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-09T04:41:31.457 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 057.out 175.out 186.out 240.out 069.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 177.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 264.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 209.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 250.out 191.out 281.out 046.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 233.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 275.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 287.out 067.out 010.out 238.out 138.out 095.out 184.out 160.out 190.out 291.out 081.out 024.out 071.out 061.out 047.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 003.out 211.out 158.out 085.out 146.out 188.out 104.out 089.out 086.out 279.out 225.out 174.out 156.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 053.out 164.out 239.out 241.out 002.out 178.out 141.out 214.out 114.out 074.out 056.out 012.out 041.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 091.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 173.out 259.out 210.out 132.out 037.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 076.out 022.out 006.out 284.out 299.out 224.out 154.out 276.out 149.out 064.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 087.out 212.out 112.out 256.out 021.out 247.out 028.out 107.out /var/lib/xfstests/tests/btrfs 2023-06-09T04:41:32.245 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ceph/ install 2023-06-09T04:41:32.246 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-09T04:41:32.255 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-09T04:41:32.274 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-09T04:41:32.282 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-09T04:41:32.302 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/cifs/ install 2023-06-09T04:41:32.303 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-09T04:41:32.312 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-09T04:41:32.321 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-09T04:41:32.329 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-09T04:41:32.338 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ext4/ install 2023-06-09T04:41:32.340 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-09T04:41:32.348 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-09T04:41:32.534 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-09T04:41:32.543 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-09T04:41:32.742 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/f2fs/ install 2023-06-09T04:41:32.743 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-09T04:41:32.752 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-09T04:41:32.763 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-09T04:41:32.772 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-09T04:41:32.783 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/generic/ install 2023-06-09T04:41:32.787 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-09T04:41:32.796 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-09T04:41:34.773 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-09T04:41:34.782 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 555.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 255.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 645.out 673.out 190.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 309.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 342.out 041.out 664.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 599.out 476.out 087.out 199.out 458.out 233.out 639.out 721.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 451.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 382.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 044.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 519.out 567.out 299.out 474.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 443.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 357.out 072.out 068.out 229.out 038.out 084.out 056.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 308.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 097.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out /var/lib/xfstests/tests/generic 2023-06-09T04:41:36.791 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/nfs/ install 2023-06-09T04:41:36.793 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-09T04:41:36.801 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-09T04:41:36.810 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-09T04:41:36.819 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-09T04:41:36.827 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/ocfs2/ install 2023-06-09T04:41:36.829 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:36.837 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:36.846 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:36.855 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-09T04:41:36.863 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/overlay/ install 2023-06-09T04:41:36.865 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-09T04:41:36.874 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-09T04:41:37.138 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-09T04:41:37.146 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-06-09T04:41:37.411 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/perf/ install 2023-06-09T04:41:37.412 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-09T04:41:37.421 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-09T04:41:37.429 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-09T04:41:37.438 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-09T04:41:37.446 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/selftest/ install 2023-06-09T04:41:37.448 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-09T04:41:37.457 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-09T04:41:37.478 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-09T04:41:37.487 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-09T04:41:37.510 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/shared/ install 2023-06-09T04:41:37.511 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-09T04:41:37.520 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-09T04:41:37.533 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-09T04:41:37.542 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-09T04:41:37.556 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/tmpfs/ install 2023-06-09T04:41:37.558 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:37.566 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:37.575 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:37.583 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-09T04:41:37.592 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/udf/ install 2023-06-09T04:41:37.594 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-09T04:41:37.603 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-09T04:41:37.611 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-09T04:41:37.620 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-09T04:41:37.629 INFO:teuthology.orchestra.run.smithi149.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.cJJFcf5ijVxfstests-dev/tests/xfs/ install 2023-06-09T04:41:37.633 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-09T04:41:37.642 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-09T04:41:39.513 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-09T04:41:39.521 INFO:teuthology.orchestra.run.smithi149.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-06-09T04:41:41.416 INFO:teuthology.orchestra.run.smithi149.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-09T04:41:41.424 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-09T04:41:41.433 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-09T04:41:41.441 INFO:teuthology.orchestra.run.smithi149.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-09T04:41:41.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.452 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec ls tests/generic) 2023-06-09T04:41:41.509 INFO:teuthology.orchestra.run.smithi149.stdout:001 2023-06-09T04:41:41.510 INFO:teuthology.orchestra.run.smithi149.stdout:001.out 2023-06-09T04:41:41.510 INFO:teuthology.orchestra.run.smithi149.stdout:002 2023-06-09T04:41:41.510 INFO:teuthology.orchestra.run.smithi149.stdout:002.out 2023-06-09T04:41:41.510 INFO:teuthology.orchestra.run.smithi149.stdout:003 2023-06-09T04:41:41.510 INFO:teuthology.orchestra.run.smithi149.stdout:003.out 2023-06-09T04:41:41.510 INFO:teuthology.orchestra.run.smithi149.stdout:004 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:004.out 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:005 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:005.out 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:006 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:006.out 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:007 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:007.out 2023-06-09T04:41:41.511 INFO:teuthology.orchestra.run.smithi149.stdout:008 2023-06-09T04:41:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:008.out 2023-06-09T04:41:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:009 2023-06-09T04:41:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:009.out 2023-06-09T04:41:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:010 2023-06-09T04:41:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:010.out 2023-06-09T04:41:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:011 2023-06-09T04:41:41.512 INFO:teuthology.orchestra.run.smithi149.stdout:011.out 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:012 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:012.out 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:013 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:013.out 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:014 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:014.out 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:015 2023-06-09T04:41:41.513 INFO:teuthology.orchestra.run.smithi149.stdout:015.out 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:016 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:016.out 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:017 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:017.out 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:018 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:018.out 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:019 2023-06-09T04:41:41.514 INFO:teuthology.orchestra.run.smithi149.stdout:019.out 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:020 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:020.out 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:021 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:021.out 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:022 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:022.out 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:023 2023-06-09T04:41:41.515 INFO:teuthology.orchestra.run.smithi149.stdout:023.out 2023-06-09T04:41:41.516 INFO:teuthology.orchestra.run.smithi149.stdout:024 2023-06-09T04:41:41.516 INFO:teuthology.orchestra.run.smithi149.stdout:024.out 2023-06-09T04:41:41.516 INFO:teuthology.orchestra.run.smithi149.stdout:025 2023-06-09T04:41:41.516 INFO:teuthology.orchestra.run.smithi149.stdout:025.out 2023-06-09T04:41:41.516 INFO:teuthology.orchestra.run.smithi149.stdout:026 2023-06-09T04:41:41.516 INFO:teuthology.orchestra.run.smithi149.stdout:026.out 2023-06-09T04:41:41.516 INFO:teuthology.orchestra.run.smithi149.stdout:027 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:027.out 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:028 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:028.out 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:029 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:029.out 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:030 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:030.out 2023-06-09T04:41:41.517 INFO:teuthology.orchestra.run.smithi149.stdout:031 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:031.out 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:032 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:032.out 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:033 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:033.out 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:034 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:034.out 2023-06-09T04:41:41.518 INFO:teuthology.orchestra.run.smithi149.stdout:035 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:035.cfg 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:035.out.default 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:035.out.nfs 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:036 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:036.out 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:037 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:037.out 2023-06-09T04:41:41.519 INFO:teuthology.orchestra.run.smithi149.stdout:038 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:038.out 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:039 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:039.out 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:040 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:040.out 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:041 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:041.out 2023-06-09T04:41:41.520 INFO:teuthology.orchestra.run.smithi149.stdout:042 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:042.out 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:043 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:043.out 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:044 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:044.out 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:045 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:045.out 2023-06-09T04:41:41.521 INFO:teuthology.orchestra.run.smithi149.stdout:046 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:046.out 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:047 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:047.out 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:048 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:048.out 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:049 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:049.out 2023-06-09T04:41:41.522 INFO:teuthology.orchestra.run.smithi149.stdout:050 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:050.cfg 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:050.out.default 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:050.out.nojournal 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:050.out.xfsquota 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:051 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:051.out 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:052 2023-06-09T04:41:41.523 INFO:teuthology.orchestra.run.smithi149.stdout:052.out 2023-06-09T04:41:41.524 INFO:teuthology.orchestra.run.smithi149.stdout:053 2023-06-09T04:41:41.524 INFO:teuthology.orchestra.run.smithi149.stdout:053.out 2023-06-09T04:41:41.524 INFO:teuthology.orchestra.run.smithi149.stdout:054 2023-06-09T04:41:41.524 INFO:teuthology.orchestra.run.smithi149.stdout:054.out 2023-06-09T04:41:41.524 INFO:teuthology.orchestra.run.smithi149.stdout:055 2023-06-09T04:41:41.524 INFO:teuthology.orchestra.run.smithi149.stdout:055.out 2023-06-09T04:41:41.524 INFO:teuthology.orchestra.run.smithi149.stdout:056 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:056.out 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:057 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:057.out 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:058 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:058.out 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:059 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:059.out 2023-06-09T04:41:41.525 INFO:teuthology.orchestra.run.smithi149.stdout:060 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:060.out 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:061 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:061.out 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:062 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:062.out 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:063 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:063.out 2023-06-09T04:41:41.526 INFO:teuthology.orchestra.run.smithi149.stdout:064 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:064.out 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:065 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:065.out 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:066 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:066.out 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:067 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:067.out 2023-06-09T04:41:41.527 INFO:teuthology.orchestra.run.smithi149.stdout:068 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:068.out 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:069 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:069.out 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:070 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:070.out 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:071 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:071.out 2023-06-09T04:41:41.528 INFO:teuthology.orchestra.run.smithi149.stdout:072 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:072.out 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:073 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:073.out 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:074 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:074.out 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:075 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:075.out 2023-06-09T04:41:41.529 INFO:teuthology.orchestra.run.smithi149.stdout:076 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:076.out 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:077 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:077.out 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:078 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:078.out 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:079 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:079.out 2023-06-09T04:41:41.530 INFO:teuthology.orchestra.run.smithi149.stdout:080 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:080.out 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:081 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:081.out 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:082 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:082.out 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:083 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:083.out 2023-06-09T04:41:41.531 INFO:teuthology.orchestra.run.smithi149.stdout:084 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:084.out 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:085 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:085.out 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:086 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:086.out 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:087 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:087.out 2023-06-09T04:41:41.532 INFO:teuthology.orchestra.run.smithi149.stdout:088 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:088.out 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:089 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:089.out 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:090 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:090.out 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:091 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:091.out 2023-06-09T04:41:41.533 INFO:teuthology.orchestra.run.smithi149.stdout:092 2023-06-09T04:41:41.534 INFO:teuthology.orchestra.run.smithi149.stdout:092.out 2023-06-09T04:41:41.534 INFO:teuthology.orchestra.run.smithi149.stdout:093 2023-06-09T04:41:41.534 INFO:teuthology.orchestra.run.smithi149.stdout:093.out 2023-06-09T04:41:41.534 INFO:teuthology.orchestra.run.smithi149.stdout:094 2023-06-09T04:41:41.534 INFO:teuthology.orchestra.run.smithi149.stdout:094.out 2023-06-09T04:41:41.534 INFO:teuthology.orchestra.run.smithi149.stdout:095 2023-06-09T04:41:41.534 INFO:teuthology.orchestra.run.smithi149.stdout:095.out 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:096 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:096.out 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:097 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:097.out 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:098 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:098.out 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:099 2023-06-09T04:41:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:099.out 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:100 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:100.out 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:101 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:101.out 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:102 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:102.out 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:103 2023-06-09T04:41:41.536 INFO:teuthology.orchestra.run.smithi149.stdout:103.out 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:104 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:104.out 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:105 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:105.out 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:106 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:106.out 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:107 2023-06-09T04:41:41.537 INFO:teuthology.orchestra.run.smithi149.stdout:107.out 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:108 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:108.out 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:109 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:109.out 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:110 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:110.out 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:111 2023-06-09T04:41:41.538 INFO:teuthology.orchestra.run.smithi149.stdout:111.out 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:112 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:112.out 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:113 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:113.out 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:114 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:114.out 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:115 2023-06-09T04:41:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:115.out 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:116 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:116.out 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:117 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:117.out 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:118 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:118.out 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:119 2023-06-09T04:41:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:119.out 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:120 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:120.out 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:121 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:121.out 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:122 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:122.out 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:123 2023-06-09T04:41:41.541 INFO:teuthology.orchestra.run.smithi149.stdout:123.out 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:124 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:124.out 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:125 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:125.out 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:126 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:126.out 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:127 2023-06-09T04:41:41.542 INFO:teuthology.orchestra.run.smithi149.stdout:127.out 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:128 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:128.out 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:129 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:129.out 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:130 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:130.out 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:131 2023-06-09T04:41:41.543 INFO:teuthology.orchestra.run.smithi149.stdout:131.out 2023-06-09T04:41:41.544 INFO:teuthology.orchestra.run.smithi149.stdout:132 2023-06-09T04:41:41.544 INFO:teuthology.orchestra.run.smithi149.stdout:132.out 2023-06-09T04:41:41.544 INFO:teuthology.orchestra.run.smithi149.stdout:133 2023-06-09T04:41:41.544 INFO:teuthology.orchestra.run.smithi149.stdout:133.out 2023-06-09T04:41:41.544 INFO:teuthology.orchestra.run.smithi149.stdout:134 2023-06-09T04:41:41.544 INFO:teuthology.orchestra.run.smithi149.stdout:134.out 2023-06-09T04:41:41.544 INFO:teuthology.orchestra.run.smithi149.stdout:135 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:135.out 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:136 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:136.out 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:137 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:137.out 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:138 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:138.out 2023-06-09T04:41:41.545 INFO:teuthology.orchestra.run.smithi149.stdout:139 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:139.out 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:140 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:140.out 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:141 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:141.out 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:142 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:142.out 2023-06-09T04:41:41.546 INFO:teuthology.orchestra.run.smithi149.stdout:143 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:143.out 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:144 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:144.out 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:145 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:145.out 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:146 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:146.out 2023-06-09T04:41:41.547 INFO:teuthology.orchestra.run.smithi149.stdout:147 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:147.out 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:148 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:148.out 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:149 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:149.out 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:150 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:150.out 2023-06-09T04:41:41.548 INFO:teuthology.orchestra.run.smithi149.stdout:151 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:151.out 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:152 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:152.out 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:153 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:153.out 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:154 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:154.out 2023-06-09T04:41:41.549 INFO:teuthology.orchestra.run.smithi149.stdout:155 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:155.out 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:156 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:156.out 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:157 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:157.out 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:158 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:158.out 2023-06-09T04:41:41.550 INFO:teuthology.orchestra.run.smithi149.stdout:159 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:159.out 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:160 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:160.out 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:161 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:161.out 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:162 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:162.out 2023-06-09T04:41:41.551 INFO:teuthology.orchestra.run.smithi149.stdout:163 2023-06-09T04:41:41.552 INFO:teuthology.orchestra.run.smithi149.stdout:163.out 2023-06-09T04:41:41.552 INFO:teuthology.orchestra.run.smithi149.stdout:164 2023-06-09T04:41:41.552 INFO:teuthology.orchestra.run.smithi149.stdout:164.out 2023-06-09T04:41:41.552 INFO:teuthology.orchestra.run.smithi149.stdout:165 2023-06-09T04:41:41.552 INFO:teuthology.orchestra.run.smithi149.stdout:165.out 2023-06-09T04:41:41.552 INFO:teuthology.orchestra.run.smithi149.stdout:166 2023-06-09T04:41:41.552 INFO:teuthology.orchestra.run.smithi149.stdout:166.out 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:167 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:167.out 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:168 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:168.out 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:169 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:169.out 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:170 2023-06-09T04:41:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:170.out 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:171 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:171.out 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:172 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:172.out 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:173 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:173.out 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:174 2023-06-09T04:41:41.554 INFO:teuthology.orchestra.run.smithi149.stdout:174.out 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:175 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:175.out 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:176 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:176.out 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:177 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:177.out 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:178 2023-06-09T04:41:41.555 INFO:teuthology.orchestra.run.smithi149.stdout:178.out 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:179 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:179.out 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:180 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:180.out 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:181 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:181.out 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:182 2023-06-09T04:41:41.556 INFO:teuthology.orchestra.run.smithi149.stdout:182.out 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:183 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:183.out 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:184 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:184.out 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:185 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:185.out 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:186 2023-06-09T04:41:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:186.out 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:187 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:187.out 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:188 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:188.out 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:189 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:189.out 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:190 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:190.out 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:191 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:191.out 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:192 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:192.out 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:193 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:193.out 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:194 2023-06-09T04:41:41.559 INFO:teuthology.orchestra.run.smithi149.stdout:194.out 2023-06-09T04:41:41.560 INFO:teuthology.orchestra.run.smithi149.stdout:195 2023-06-09T04:41:41.560 INFO:teuthology.orchestra.run.smithi149.stdout:195.out 2023-06-09T04:41:41.560 INFO:teuthology.orchestra.run.smithi149.stdout:196 2023-06-09T04:41:41.560 INFO:teuthology.orchestra.run.smithi149.stdout:196.out 2023-06-09T04:41:41.560 INFO:teuthology.orchestra.run.smithi149.stdout:197 2023-06-09T04:41:41.560 INFO:teuthology.orchestra.run.smithi149.stdout:197.out 2023-06-09T04:41:41.560 INFO:teuthology.orchestra.run.smithi149.stdout:198 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:198.out 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:199 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:199.out 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:200 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:200.out 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:201 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:201.out 2023-06-09T04:41:41.561 INFO:teuthology.orchestra.run.smithi149.stdout:202 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:202.out 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:203 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:203.out 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:204 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:204.out 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:205 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:205.out 2023-06-09T04:41:41.562 INFO:teuthology.orchestra.run.smithi149.stdout:206 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:206.out 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:207 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:207.out 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:208 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:208.out 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:209 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:209.out 2023-06-09T04:41:41.563 INFO:teuthology.orchestra.run.smithi149.stdout:210 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:210.out 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:211 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:211.out 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:212 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:212.out 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:213 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:213.out 2023-06-09T04:41:41.564 INFO:teuthology.orchestra.run.smithi149.stdout:214 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:214.out 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:215 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:215.out 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:216 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:216.out 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:217 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:217.out 2023-06-09T04:41:41.565 INFO:teuthology.orchestra.run.smithi149.stdout:218 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:218.out 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:219 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:219.out 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:220 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:220.out 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:221 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:221.out 2023-06-09T04:41:41.566 INFO:teuthology.orchestra.run.smithi149.stdout:222 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:222.out 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:223 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:223.out 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:224 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:224.out 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:225 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:225.out 2023-06-09T04:41:41.567 INFO:teuthology.orchestra.run.smithi149.stdout:226 2023-06-09T04:41:41.568 INFO:teuthology.orchestra.run.smithi149.stdout:226.out 2023-06-09T04:41:41.568 INFO:teuthology.orchestra.run.smithi149.stdout:227 2023-06-09T04:41:41.568 INFO:teuthology.orchestra.run.smithi149.stdout:227.out 2023-06-09T04:41:41.568 INFO:teuthology.orchestra.run.smithi149.stdout:228 2023-06-09T04:41:41.568 INFO:teuthology.orchestra.run.smithi149.stdout:228.out 2023-06-09T04:41:41.568 INFO:teuthology.orchestra.run.smithi149.stdout:229 2023-06-09T04:41:41.568 INFO:teuthology.orchestra.run.smithi149.stdout:229.out 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:230 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:230.out 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:231 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:231.out 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:232 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:232.out 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:233 2023-06-09T04:41:41.569 INFO:teuthology.orchestra.run.smithi149.stdout:233.out 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:234 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:234.out 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:235 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:235.out 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:236 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:236.out 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:237 2023-06-09T04:41:41.570 INFO:teuthology.orchestra.run.smithi149.stdout:237.out 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:238 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:238.out 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:239 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:239.out 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:240 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:240.out 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:241 2023-06-09T04:41:41.571 INFO:teuthology.orchestra.run.smithi149.stdout:241.out 2023-06-09T04:41:41.572 INFO:teuthology.orchestra.run.smithi149.stdout:242 2023-06-09T04:41:41.572 INFO:teuthology.orchestra.run.smithi149.stdout:242.out 2023-06-09T04:41:41.572 INFO:teuthology.orchestra.run.smithi149.stdout:243 2023-06-09T04:41:41.572 INFO:teuthology.orchestra.run.smithi149.stdout:243.out 2023-06-09T04:41:41.572 INFO:teuthology.orchestra.run.smithi149.stdout:244 2023-06-09T04:41:41.572 INFO:teuthology.orchestra.run.smithi149.stdout:244.out 2023-06-09T04:41:41.573 INFO:teuthology.orchestra.run.smithi149.stdout:245 2023-06-09T04:41:41.573 INFO:teuthology.orchestra.run.smithi149.stdout:245.out 2023-06-09T04:41:41.573 INFO:teuthology.orchestra.run.smithi149.stdout:246 2023-06-09T04:41:41.573 INFO:teuthology.orchestra.run.smithi149.stdout:246.out 2023-06-09T04:41:41.573 INFO:teuthology.orchestra.run.smithi149.stdout:247 2023-06-09T04:41:41.573 INFO:teuthology.orchestra.run.smithi149.stdout:247.out 2023-06-09T04:41:41.573 INFO:teuthology.orchestra.run.smithi149.stdout:248 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:248.out 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:249 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:249.out 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:250 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:250.out 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:251 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:251.out 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi149.stdout:252 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:252.out 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:253 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:253.out 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:254 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:254.out 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:255 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:255.out 2023-06-09T04:41:41.575 INFO:teuthology.orchestra.run.smithi149.stdout:256 2023-06-09T04:41:41.576 INFO:teuthology.orchestra.run.smithi149.stdout:256.out 2023-06-09T04:41:41.576 INFO:teuthology.orchestra.run.smithi149.stdout:257 2023-06-09T04:41:41.576 INFO:teuthology.orchestra.run.smithi149.stdout:257.out 2023-06-09T04:41:41.576 INFO:teuthology.orchestra.run.smithi149.stdout:258 2023-06-09T04:41:41.576 INFO:teuthology.orchestra.run.smithi149.stdout:258.out 2023-06-09T04:41:41.576 INFO:teuthology.orchestra.run.smithi149.stdout:259 2023-06-09T04:41:41.576 INFO:teuthology.orchestra.run.smithi149.stdout:259.out 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:260 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:260.out 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:261 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:261.out 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:262 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:262.out 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:263 2023-06-09T04:41:41.577 INFO:teuthology.orchestra.run.smithi149.stdout:263.out 2023-06-09T04:41:41.578 INFO:teuthology.orchestra.run.smithi149.stdout:264 2023-06-09T04:41:41.578 INFO:teuthology.orchestra.run.smithi149.stdout:264.out 2023-06-09T04:41:41.578 INFO:teuthology.orchestra.run.smithi149.stdout:265 2023-06-09T04:41:41.578 INFO:teuthology.orchestra.run.smithi149.stdout:265.out 2023-06-09T04:41:41.578 INFO:teuthology.orchestra.run.smithi149.stdout:266 2023-06-09T04:41:41.578 INFO:teuthology.orchestra.run.smithi149.stdout:266.out 2023-06-09T04:41:41.578 INFO:teuthology.orchestra.run.smithi149.stdout:267 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:267.out 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:268 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:268.out 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:269 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:269.out 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:270 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:270.out 2023-06-09T04:41:41.579 INFO:teuthology.orchestra.run.smithi149.stdout:271 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:271.out 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:272 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:272.out 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:273 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:273.out 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:274 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:274.out 2023-06-09T04:41:41.580 INFO:teuthology.orchestra.run.smithi149.stdout:275 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:275.out 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:276 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:276.out 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:277 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:277.out 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:278 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:278.out 2023-06-09T04:41:41.581 INFO:teuthology.orchestra.run.smithi149.stdout:279 2023-06-09T04:41:41.582 INFO:teuthology.orchestra.run.smithi149.stdout:279.out 2023-06-09T04:41:41.582 INFO:teuthology.orchestra.run.smithi149.stdout:280 2023-06-09T04:41:41.582 INFO:teuthology.orchestra.run.smithi149.stdout:280.out 2023-06-09T04:41:41.582 INFO:teuthology.orchestra.run.smithi149.stdout:281 2023-06-09T04:41:41.582 INFO:teuthology.orchestra.run.smithi149.stdout:281.out 2023-06-09T04:41:41.582 INFO:teuthology.orchestra.run.smithi149.stdout:282 2023-06-09T04:41:41.582 INFO:teuthology.orchestra.run.smithi149.stdout:282.out 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:283 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:283.out 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:284 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:284.out 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:285 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:285.out 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:286 2023-06-09T04:41:41.583 INFO:teuthology.orchestra.run.smithi149.stdout:286.out 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:287 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:287.out 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:288 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:288.out 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:289 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:289.out 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:290 2023-06-09T04:41:41.584 INFO:teuthology.orchestra.run.smithi149.stdout:290.out 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:291 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:291.out 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:292 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:292.out 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:293 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:293.out 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:294 2023-06-09T04:41:41.585 INFO:teuthology.orchestra.run.smithi149.stdout:294.out 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:295 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:295.out 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:296 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:296.out 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:297 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:297.out 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:298 2023-06-09T04:41:41.586 INFO:teuthology.orchestra.run.smithi149.stdout:298.out 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:299 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:299.out 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:300 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:300.out 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:301 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:301.out 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:302 2023-06-09T04:41:41.587 INFO:teuthology.orchestra.run.smithi149.stdout:302.out 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:303 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:303.out 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:304 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:304.out 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:305 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:305.out 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:306 2023-06-09T04:41:41.588 INFO:teuthology.orchestra.run.smithi149.stdout:306.out 2023-06-09T04:41:41.589 INFO:teuthology.orchestra.run.smithi149.stdout:307 2023-06-09T04:41:41.589 INFO:teuthology.orchestra.run.smithi149.stdout:307.out 2023-06-09T04:41:41.589 INFO:teuthology.orchestra.run.smithi149.stdout:308 2023-06-09T04:41:41.589 INFO:teuthology.orchestra.run.smithi149.stdout:308.out 2023-06-09T04:41:41.589 INFO:teuthology.orchestra.run.smithi149.stdout:309 2023-06-09T04:41:41.589 INFO:teuthology.orchestra.run.smithi149.stdout:309.out 2023-06-09T04:41:41.589 INFO:teuthology.orchestra.run.smithi149.stdout:310 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:310.out 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:311 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:311.out 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:312 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:312.out 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:313 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:313.out 2023-06-09T04:41:41.590 INFO:teuthology.orchestra.run.smithi149.stdout:314 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:314.out 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:315 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:315.out 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:316 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:316.out 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:317 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:317.out 2023-06-09T04:41:41.591 INFO:teuthology.orchestra.run.smithi149.stdout:318 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:318.out 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:319 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:319.out 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:320 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:320.out 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:321 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:321.out 2023-06-09T04:41:41.592 INFO:teuthology.orchestra.run.smithi149.stdout:322 2023-06-09T04:41:41.593 INFO:teuthology.orchestra.run.smithi149.stdout:322.out 2023-06-09T04:41:41.593 INFO:teuthology.orchestra.run.smithi149.stdout:323 2023-06-09T04:41:41.593 INFO:teuthology.orchestra.run.smithi149.stdout:323.out 2023-06-09T04:41:41.593 INFO:teuthology.orchestra.run.smithi149.stdout:324 2023-06-09T04:41:41.593 INFO:teuthology.orchestra.run.smithi149.stdout:324.out 2023-06-09T04:41:41.593 INFO:teuthology.orchestra.run.smithi149.stdout:325 2023-06-09T04:41:41.593 INFO:teuthology.orchestra.run.smithi149.stdout:325.out 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:326 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:326.out 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:327 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:327.out 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:328 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:328.out 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:329 2023-06-09T04:41:41.594 INFO:teuthology.orchestra.run.smithi149.stdout:329.out 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:330 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:330.out 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:331 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:331.out 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:332 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:332.out 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:333 2023-06-09T04:41:41.595 INFO:teuthology.orchestra.run.smithi149.stdout:333.out 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:334 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:334.out 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:335 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:335.out 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:336 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:336.out 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:337 2023-06-09T04:41:41.596 INFO:teuthology.orchestra.run.smithi149.stdout:337.out 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:338 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:338.out 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:339 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:339.out 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:340 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:340.out 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:341 2023-06-09T04:41:41.597 INFO:teuthology.orchestra.run.smithi149.stdout:341.out 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:342 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:342.out 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:343 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:343.out 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:344 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:344.out 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:345 2023-06-09T04:41:41.598 INFO:teuthology.orchestra.run.smithi149.stdout:345.out 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:346 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:346.out 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:347 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:347.out 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:348 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:348.out 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:349 2023-06-09T04:41:41.599 INFO:teuthology.orchestra.run.smithi149.stdout:349.out 2023-06-09T04:41:41.600 INFO:teuthology.orchestra.run.smithi149.stdout:350 2023-06-09T04:41:41.600 INFO:teuthology.orchestra.run.smithi149.stdout:350.out 2023-06-09T04:41:41.600 INFO:teuthology.orchestra.run.smithi149.stdout:351 2023-06-09T04:41:41.600 INFO:teuthology.orchestra.run.smithi149.stdout:351.out 2023-06-09T04:41:41.600 INFO:teuthology.orchestra.run.smithi149.stdout:352 2023-06-09T04:41:41.600 INFO:teuthology.orchestra.run.smithi149.stdout:352.out 2023-06-09T04:41:41.600 INFO:teuthology.orchestra.run.smithi149.stdout:353 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:353.out 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:354 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:354.out 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:355 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:355.out 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:356 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:356.out 2023-06-09T04:41:41.601 INFO:teuthology.orchestra.run.smithi149.stdout:357 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:357.out 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:358 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:358.out 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:359 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:359.out 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:360 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:360.out 2023-06-09T04:41:41.602 INFO:teuthology.orchestra.run.smithi149.stdout:361 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:361.out 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:362 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:362.out 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:363 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:363.out 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:364 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:364.out 2023-06-09T04:41:41.603 INFO:teuthology.orchestra.run.smithi149.stdout:365 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:365.out 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:366 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:366.out 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:367 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:367.out 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:368 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:368.out 2023-06-09T04:41:41.604 INFO:teuthology.orchestra.run.smithi149.stdout:369 2023-06-09T04:41:41.605 INFO:teuthology.orchestra.run.smithi149.stdout:369.out 2023-06-09T04:41:41.605 INFO:teuthology.orchestra.run.smithi149.stdout:370 2023-06-09T04:41:41.605 INFO:teuthology.orchestra.run.smithi149.stdout:370.out 2023-06-09T04:41:41.605 INFO:teuthology.orchestra.run.smithi149.stdout:371 2023-06-09T04:41:41.605 INFO:teuthology.orchestra.run.smithi149.stdout:371.out 2023-06-09T04:41:41.605 INFO:teuthology.orchestra.run.smithi149.stdout:372 2023-06-09T04:41:41.605 INFO:teuthology.orchestra.run.smithi149.stdout:372.out 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:373 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:373.out 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:374 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:374.out 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:375 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:375.out 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:376 2023-06-09T04:41:41.606 INFO:teuthology.orchestra.run.smithi149.stdout:376.out 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:377 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:377.out 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:378 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:378.out 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:379 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:379.out 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:380 2023-06-09T04:41:41.607 INFO:teuthology.orchestra.run.smithi149.stdout:380.out 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:381 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:381.out 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:382 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:382.out 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:383 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:383.out 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:384 2023-06-09T04:41:41.608 INFO:teuthology.orchestra.run.smithi149.stdout:384.out 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:385 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:385.out 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:386 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:386.out 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:387 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:387.out 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:388 2023-06-09T04:41:41.609 INFO:teuthology.orchestra.run.smithi149.stdout:388.out 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:389 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:389.out 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:390 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:390.out 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:391 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:391.out 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:392 2023-06-09T04:41:41.610 INFO:teuthology.orchestra.run.smithi149.stdout:392.out 2023-06-09T04:41:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:393 2023-06-09T04:41:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:393.out 2023-06-09T04:41:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:394 2023-06-09T04:41:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:394.out 2023-06-09T04:41:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:395 2023-06-09T04:41:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:395.out 2023-06-09T04:41:41.611 INFO:teuthology.orchestra.run.smithi149.stdout:396 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:396.out 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:397 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:397.out 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:398 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:398.out 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:399 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:399.out 2023-06-09T04:41:41.612 INFO:teuthology.orchestra.run.smithi149.stdout:400 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:400.out 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:401 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:401.out 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:402 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:402.out 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:403 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:403.out 2023-06-09T04:41:41.613 INFO:teuthology.orchestra.run.smithi149.stdout:404 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:404.out 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:405 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:405.out 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:406 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:406.out 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:407 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:407.out 2023-06-09T04:41:41.614 INFO:teuthology.orchestra.run.smithi149.stdout:408 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:408.out 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:409 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:409.out 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:410 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:410.out 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:411 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:411.out 2023-06-09T04:41:41.615 INFO:teuthology.orchestra.run.smithi149.stdout:412 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:412.out 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:413 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:413.out 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:414 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:414.out 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:415 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:415.out 2023-06-09T04:41:41.616 INFO:teuthology.orchestra.run.smithi149.stdout:416 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:416.out 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:417 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:417.out 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:418 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:418.out 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:419 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:419.out 2023-06-09T04:41:41.617 INFO:teuthology.orchestra.run.smithi149.stdout:420 2023-06-09T04:41:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:420.out 2023-06-09T04:41:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:421 2023-06-09T04:41:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:421.out 2023-06-09T04:41:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:422 2023-06-09T04:41:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:422.out 2023-06-09T04:41:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:423 2023-06-09T04:41:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:423.out 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:424 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:424.out 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:425 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:425.out 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:426 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:426.out 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:427 2023-06-09T04:41:41.619 INFO:teuthology.orchestra.run.smithi149.stdout:427.out 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:428 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:428.out 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:429 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:429.out 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:430 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:430.out 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:431 2023-06-09T04:41:41.620 INFO:teuthology.orchestra.run.smithi149.stdout:431.out 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:432 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:432.out 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:433 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:433.out 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:434 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:434.out 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:435 2023-06-09T04:41:41.621 INFO:teuthology.orchestra.run.smithi149.stdout:435.out 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:436 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:436.out 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:437 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:437.out 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:438 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:438.out 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:439 2023-06-09T04:41:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:439.out 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:440 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:440.out 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:441 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:441.out 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:442 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:442.out 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:443 2023-06-09T04:41:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:443.out 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:444 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:444.out 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:445 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:445.out 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:446 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:446.out 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:447 2023-06-09T04:41:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:447.out 2023-06-09T04:41:41.625 INFO:teuthology.orchestra.run.smithi149.stdout:448 2023-06-09T04:41:41.625 INFO:teuthology.orchestra.run.smithi149.stdout:448.out 2023-06-09T04:41:41.625 INFO:teuthology.orchestra.run.smithi149.stdout:449 2023-06-09T04:41:41.625 INFO:teuthology.orchestra.run.smithi149.stdout:449.out 2023-06-09T04:41:41.625 INFO:teuthology.orchestra.run.smithi149.stdout:450 2023-06-09T04:41:41.625 INFO:teuthology.orchestra.run.smithi149.stdout:450.out 2023-06-09T04:41:41.625 INFO:teuthology.orchestra.run.smithi149.stdout:451 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:451.out 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:452 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:452.out 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:453 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:453.out 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:454 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:454.out 2023-06-09T04:41:41.626 INFO:teuthology.orchestra.run.smithi149.stdout:455 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:455.out 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:456 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:456.out 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:457 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:457.out 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:458 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:458.out 2023-06-09T04:41:41.627 INFO:teuthology.orchestra.run.smithi149.stdout:459 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:459.out 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:460 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:460.out 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:461 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:461.out 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:462 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:462.out 2023-06-09T04:41:41.628 INFO:teuthology.orchestra.run.smithi149.stdout:463 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:463.out 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:464 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:464.out 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:465 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:465.out 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:466 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:466.out 2023-06-09T04:41:41.629 INFO:teuthology.orchestra.run.smithi149.stdout:467 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:467.out 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:468 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:468.out 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:469 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:469.out 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:470 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:470.out 2023-06-09T04:41:41.630 INFO:teuthology.orchestra.run.smithi149.stdout:471 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:471.out 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:472 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:472.out 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:473 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:473.out 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:474 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:474.out 2023-06-09T04:41:41.631 INFO:teuthology.orchestra.run.smithi149.stdout:475 2023-06-09T04:41:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:475.out 2023-06-09T04:41:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:476 2023-06-09T04:41:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:476.out 2023-06-09T04:41:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:477 2023-06-09T04:41:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:477.out 2023-06-09T04:41:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:478 2023-06-09T04:41:41.632 INFO:teuthology.orchestra.run.smithi149.stdout:478.out 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:479 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:479.out 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:480 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:480.out 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:481 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:481.out 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:482 2023-06-09T04:41:41.633 INFO:teuthology.orchestra.run.smithi149.stdout:482.out 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:483 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:483.out 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:484 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:484.out 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:485 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:485.out 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:486 2023-06-09T04:41:41.634 INFO:teuthology.orchestra.run.smithi149.stdout:486.out 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:487 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:487.out 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:488 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:488.out 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:489 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:489.out 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:490 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run.smithi149.stdout:490.out 2023-06-09T04:41:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:491 2023-06-09T04:41:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:491.out 2023-06-09T04:41:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:492 2023-06-09T04:41:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:492.out 2023-06-09T04:41:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:493 2023-06-09T04:41:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:493.out 2023-06-09T04:41:41.636 INFO:teuthology.orchestra.run.smithi149.stdout:494 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:494.out 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:495 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:495.out 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:496 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:496.out 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:497 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:497.out 2023-06-09T04:41:41.637 INFO:teuthology.orchestra.run.smithi149.stdout:498 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:498.out 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:499 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:499.out 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:500 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:500.out 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:501 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:501.out 2023-06-09T04:41:41.638 INFO:teuthology.orchestra.run.smithi149.stdout:502 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:502.out 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:503 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:503.out 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:504 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:504.out 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:505 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:505.out 2023-06-09T04:41:41.639 INFO:teuthology.orchestra.run.smithi149.stdout:506 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:506.out 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:507 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:507.out 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:508 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:508.out 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:509 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:509.out 2023-06-09T04:41:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:510 2023-06-09T04:41:41.641 INFO:teuthology.orchestra.run.smithi149.stdout:510.out 2023-06-09T04:41:41.641 INFO:teuthology.orchestra.run.smithi149.stdout:511 2023-06-09T04:41:41.641 INFO:teuthology.orchestra.run.smithi149.stdout:511.out 2023-06-09T04:41:41.641 INFO:teuthology.orchestra.run.smithi149.stdout:512 2023-06-09T04:41:41.641 INFO:teuthology.orchestra.run.smithi149.stdout:512.out 2023-06-09T04:41:41.641 INFO:teuthology.orchestra.run.smithi149.stdout:513 2023-06-09T04:41:41.641 INFO:teuthology.orchestra.run.smithi149.stdout:513.out 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:514 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:514.out 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:515 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:515.out 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:516 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:516.out 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:517 2023-06-09T04:41:41.642 INFO:teuthology.orchestra.run.smithi149.stdout:517.out 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:518 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:518.out 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:519 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:519.out 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:520 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:520.out 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:521 2023-06-09T04:41:41.643 INFO:teuthology.orchestra.run.smithi149.stdout:521.out 2023-06-09T04:41:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:522 2023-06-09T04:41:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:522.out 2023-06-09T04:41:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:523 2023-06-09T04:41:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:523.out 2023-06-09T04:41:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:524 2023-06-09T04:41:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:524.out 2023-06-09T04:41:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:525 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:525.out 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:526 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:526.out 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:527 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:527.out 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:528 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:528.out 2023-06-09T04:41:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:529 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:529.out 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:530 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:530.out 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:531 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:531.out 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:532 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:532.out 2023-06-09T04:41:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:533 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:533.out 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:534 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:534.out 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:535 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:535.out 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:536 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:536.out 2023-06-09T04:41:41.647 INFO:teuthology.orchestra.run.smithi149.stdout:537 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:537.out 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:538 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:538.out 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:539 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:539.out 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:540 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:540.out 2023-06-09T04:41:41.648 INFO:teuthology.orchestra.run.smithi149.stdout:541 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:541.out 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:542 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:542.out 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:543 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:543.out 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:544 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:544.out 2023-06-09T04:41:41.649 INFO:teuthology.orchestra.run.smithi149.stdout:545 2023-06-09T04:41:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:545.out 2023-06-09T04:41:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:546 2023-06-09T04:41:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:546.out 2023-06-09T04:41:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:547 2023-06-09T04:41:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:547.out 2023-06-09T04:41:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:548 2023-06-09T04:41:41.650 INFO:teuthology.orchestra.run.smithi149.stdout:548.out 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:549 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:549.out 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:550 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:550.out 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:551 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:551.out 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:552 2023-06-09T04:41:41.651 INFO:teuthology.orchestra.run.smithi149.stdout:552.out 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:553 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:553.out 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:554 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:554.out 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:555 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:555.out 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:556 2023-06-09T04:41:41.652 INFO:teuthology.orchestra.run.smithi149.stdout:556.out 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:557 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:557.out 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:558 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:558.out 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:559 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:559.out 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:560 2023-06-09T04:41:41.653 INFO:teuthology.orchestra.run.smithi149.stdout:560.out 2023-06-09T04:41:41.654 INFO:teuthology.orchestra.run.smithi149.stdout:561 2023-06-09T04:41:41.654 INFO:teuthology.orchestra.run.smithi149.stdout:561.out 2023-06-09T04:41:41.654 INFO:teuthology.orchestra.run.smithi149.stdout:562 2023-06-09T04:41:41.654 INFO:teuthology.orchestra.run.smithi149.stdout:562.out 2023-06-09T04:41:41.654 INFO:teuthology.orchestra.run.smithi149.stdout:563 2023-06-09T04:41:41.654 INFO:teuthology.orchestra.run.smithi149.stdout:563.out 2023-06-09T04:41:41.654 INFO:teuthology.orchestra.run.smithi149.stdout:564 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:564.out 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:565 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:565.out 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:566 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:566.out 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:567 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:567.out 2023-06-09T04:41:41.655 INFO:teuthology.orchestra.run.smithi149.stdout:568 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:568.out 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:569 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:569.out 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:570 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:570.out 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:571 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:571.out 2023-06-09T04:41:41.656 INFO:teuthology.orchestra.run.smithi149.stdout:572 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:572.out 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:573 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:573.out 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:574 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:574.out 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:575 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:575.out 2023-06-09T04:41:41.657 INFO:teuthology.orchestra.run.smithi149.stdout:576 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:576.out 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:577 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:577.out 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:578 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:578.out 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:579 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:579.out 2023-06-09T04:41:41.658 INFO:teuthology.orchestra.run.smithi149.stdout:580 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:580.out 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:581 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:581.out 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:582 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:582.out 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:583 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:583.out 2023-06-09T04:41:41.659 INFO:teuthology.orchestra.run.smithi149.stdout:584 2023-06-09T04:41:41.660 INFO:teuthology.orchestra.run.smithi149.stdout:584.out 2023-06-09T04:41:41.660 INFO:teuthology.orchestra.run.smithi149.stdout:585 2023-06-09T04:41:41.660 INFO:teuthology.orchestra.run.smithi149.stdout:585.out 2023-06-09T04:41:41.660 INFO:teuthology.orchestra.run.smithi149.stdout:586 2023-06-09T04:41:41.660 INFO:teuthology.orchestra.run.smithi149.stdout:586.out 2023-06-09T04:41:41.660 INFO:teuthology.orchestra.run.smithi149.stdout:587 2023-06-09T04:41:41.660 INFO:teuthology.orchestra.run.smithi149.stdout:587.out 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:588 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:588.out 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:589 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:589.out 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:590 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:590.out 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:591 2023-06-09T04:41:41.661 INFO:teuthology.orchestra.run.smithi149.stdout:591.out 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:592 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:592.out 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:593 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:593.out 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:594 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:594.out 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:595 2023-06-09T04:41:41.662 INFO:teuthology.orchestra.run.smithi149.stdout:595.out 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:596 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:596.out 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:597 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:597.out 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:598 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:598.out 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:599 2023-06-09T04:41:41.663 INFO:teuthology.orchestra.run.smithi149.stdout:599.out 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:600 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:600.out 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:601 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:601.out 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:602 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:602.out 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:603 2023-06-09T04:41:41.664 INFO:teuthology.orchestra.run.smithi149.stdout:603.out 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:604 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:604.out 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:605 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:605.out 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:606 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:606.out 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:607 2023-06-09T04:41:41.665 INFO:teuthology.orchestra.run.smithi149.stdout:607.out 2023-06-09T04:41:41.666 INFO:teuthology.orchestra.run.smithi149.stdout:608 2023-06-09T04:41:41.666 INFO:teuthology.orchestra.run.smithi149.stdout:608.out 2023-06-09T04:41:41.666 INFO:teuthology.orchestra.run.smithi149.stdout:609 2023-06-09T04:41:41.666 INFO:teuthology.orchestra.run.smithi149.stdout:609.out 2023-06-09T04:41:41.666 INFO:teuthology.orchestra.run.smithi149.stdout:610 2023-06-09T04:41:41.666 INFO:teuthology.orchestra.run.smithi149.stdout:610.out 2023-06-09T04:41:41.666 INFO:teuthology.orchestra.run.smithi149.stdout:611 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:611.out 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:612 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:612.out 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:613 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:613.out 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:614 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:614.out 2023-06-09T04:41:41.667 INFO:teuthology.orchestra.run.smithi149.stdout:615 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:615.out 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:616 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:616.out 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:617 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:617.out 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:618 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:618.out 2023-06-09T04:41:41.668 INFO:teuthology.orchestra.run.smithi149.stdout:619 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:619.out 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:620 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:620.out 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:621 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:621.out 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:622 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:622.out 2023-06-09T04:41:41.669 INFO:teuthology.orchestra.run.smithi149.stdout:623 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:623.out 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:624 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:624.out 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:625 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:625.out 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:626 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:626.out 2023-06-09T04:41:41.670 INFO:teuthology.orchestra.run.smithi149.stdout:627 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:627.out 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:628 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:628.out 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:629 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:629.out 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:630 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:630.out 2023-06-09T04:41:41.671 INFO:teuthology.orchestra.run.smithi149.stdout:631 2023-06-09T04:41:41.672 INFO:teuthology.orchestra.run.smithi149.stdout:631.out 2023-06-09T04:41:41.672 INFO:teuthology.orchestra.run.smithi149.stdout:632 2023-06-09T04:41:41.672 INFO:teuthology.orchestra.run.smithi149.stdout:632.out 2023-06-09T04:41:41.672 INFO:teuthology.orchestra.run.smithi149.stdout:633 2023-06-09T04:41:41.672 INFO:teuthology.orchestra.run.smithi149.stdout:633.out 2023-06-09T04:41:41.672 INFO:teuthology.orchestra.run.smithi149.stdout:634 2023-06-09T04:41:41.672 INFO:teuthology.orchestra.run.smithi149.stdout:634.out 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:635 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:635.out 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:636 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:636.out 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:637 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:637.out 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:638 2023-06-09T04:41:41.673 INFO:teuthology.orchestra.run.smithi149.stdout:638.out 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:639 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:639.out 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:640 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:640.out 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:641 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:641.out 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:642 2023-06-09T04:41:41.674 INFO:teuthology.orchestra.run.smithi149.stdout:642.out 2023-06-09T04:41:41.675 INFO:teuthology.orchestra.run.smithi149.stdout:643 2023-06-09T04:41:41.675 INFO:teuthology.orchestra.run.smithi149.stdout:643.out 2023-06-09T04:41:41.675 INFO:teuthology.orchestra.run.smithi149.stdout:644 2023-06-09T04:41:41.675 INFO:teuthology.orchestra.run.smithi149.stdout:644.out 2023-06-09T04:41:41.675 INFO:teuthology.orchestra.run.smithi149.stdout:645 2023-06-09T04:41:41.675 INFO:teuthology.orchestra.run.smithi149.stdout:645.out 2023-06-09T04:41:41.675 INFO:teuthology.orchestra.run.smithi149.stdout:646 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:646.out 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:647 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:647.out 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:648 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:648.out 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:649 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:649.out 2023-06-09T04:41:41.676 INFO:teuthology.orchestra.run.smithi149.stdout:650 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:650.out 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:651 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:651.out 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:652 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:652.out 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:653 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:653.out 2023-06-09T04:41:41.677 INFO:teuthology.orchestra.run.smithi149.stdout:654 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:654.out 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:655 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:655.out 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:656 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:656.out 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:657 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:657.out 2023-06-09T04:41:41.678 INFO:teuthology.orchestra.run.smithi149.stdout:658 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:658.out 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:659 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:659.out 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:660 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:660.out 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:661 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:661.out 2023-06-09T04:41:41.679 INFO:teuthology.orchestra.run.smithi149.stdout:662 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:662.out 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:663 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:663.out 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:664 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:664.out 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:665 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:665.out 2023-06-09T04:41:41.680 INFO:teuthology.orchestra.run.smithi149.stdout:666 2023-06-09T04:41:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:666.out 2023-06-09T04:41:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:667 2023-06-09T04:41:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:667.out 2023-06-09T04:41:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:668 2023-06-09T04:41:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:668.out 2023-06-09T04:41:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:669 2023-06-09T04:41:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:669.out 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:670 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:670.out 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:671 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:671.out 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:672 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:672.out 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:673 2023-06-09T04:41:41.682 INFO:teuthology.orchestra.run.smithi149.stdout:673.out 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:674 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:674.out 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:675 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:675.out 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:676 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:676.out 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:677 2023-06-09T04:41:41.683 INFO:teuthology.orchestra.run.smithi149.stdout:677.out 2023-06-09T04:41:41.684 INFO:teuthology.orchestra.run.smithi149.stdout:678 2023-06-09T04:41:41.684 INFO:teuthology.orchestra.run.smithi149.stdout:678.out 2023-06-09T04:41:41.684 INFO:teuthology.orchestra.run.smithi149.stdout:679 2023-06-09T04:41:41.684 INFO:teuthology.orchestra.run.smithi149.stdout:679.out 2023-06-09T04:41:41.684 INFO:teuthology.orchestra.run.smithi149.stdout:680 2023-06-09T04:41:41.684 INFO:teuthology.orchestra.run.smithi149.stdout:680.out 2023-06-09T04:41:41.684 INFO:teuthology.orchestra.run.smithi149.stdout:681 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:681.out 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:682 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:682.out 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:683 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:683.out 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:684 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:684.out 2023-06-09T04:41:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:685 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:685.out 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:686 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:686.out 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:687 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:687.out 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:688 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:688.out 2023-06-09T04:41:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:689 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:689.out 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:690 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:690.out 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:691 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:691.out 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:692 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:692.out 2023-06-09T04:41:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:693 2023-06-09T04:41:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:693.out 2023-06-09T04:41:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:694 2023-06-09T04:41:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:694.out 2023-06-09T04:41:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:695 2023-06-09T04:41:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:695.out 2023-06-09T04:41:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:696 2023-06-09T04:41:41.688 INFO:teuthology.orchestra.run.smithi149.stdout:696.out 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:697 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:697.out 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:698 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:698.out 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:699 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:699.out 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:700 2023-06-09T04:41:41.689 INFO:teuthology.orchestra.run.smithi149.stdout:700.out 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:701 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:701.out 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:702 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:702.out 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:703 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:703.out 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:704 2023-06-09T04:41:41.690 INFO:teuthology.orchestra.run.smithi149.stdout:704.out 2023-06-09T04:41:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:705 2023-06-09T04:41:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:705.out 2023-06-09T04:41:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:706 2023-06-09T04:41:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:706.out 2023-06-09T04:41:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:707 2023-06-09T04:41:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:707.out 2023-06-09T04:41:41.691 INFO:teuthology.orchestra.run.smithi149.stdout:708 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:708.out 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:709 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:709.out 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:710 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:710.out 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:711 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:711.out 2023-06-09T04:41:41.692 INFO:teuthology.orchestra.run.smithi149.stdout:712 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:712.out 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:713 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:713.out 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:714 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:714.out 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:715 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:715.out 2023-06-09T04:41:41.693 INFO:teuthology.orchestra.run.smithi149.stdout:716 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:716.out 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:717 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:717.out 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:718 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:718.out 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:719 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:719.out 2023-06-09T04:41:41.694 INFO:teuthology.orchestra.run.smithi149.stdout:720 2023-06-09T04:41:41.695 INFO:teuthology.orchestra.run.smithi149.stdout:720.out 2023-06-09T04:41:41.695 INFO:teuthology.orchestra.run.smithi149.stdout:721 2023-06-09T04:41:41.695 INFO:teuthology.orchestra.run.smithi149.stdout:721.out 2023-06-09T04:41:41.695 INFO:teuthology.orchestra.run.smithi149.stdout:722 2023-06-09T04:41:41.695 INFO:teuthology.orchestra.run.smithi149.stdout:722.out 2023-06-09T04:41:41.695 INFO:teuthology.orchestra.run.smithi149.stdout:723 2023-06-09T04:41:41.695 INFO:teuthology.orchestra.run.smithi149.stdout:723.out 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:724 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:724.out 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:725 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:725.out 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:726 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:726.out 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:727 2023-06-09T04:41:41.696 INFO:teuthology.orchestra.run.smithi149.stdout:727.out 2023-06-09T04:41:41.697 INFO:teuthology.orchestra.run.smithi149.stdout:group.list 2023-06-09T04:41:41.697 INFO:teuthology.orchestra.run.smithi149.stdout:Makefile 2023-06-09T04:41:41.697 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-09T04:41:41.917 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:41:41.920 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:41:41.921 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:41:41.922 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:41:41.922 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:46.983 INFO:teuthology.orchestra.run.smithi149.stdout:generic/001 4s 2023-06-09T04:41:46.987 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/001 2023-06-09T04:41:46.988 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:41:46.989 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:47.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:47.730 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-09T04:41:47.929 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:41:47.932 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:41:47.933 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:41:47.934 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:41:47.934 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:48.434 INFO:teuthology.orchestra.run.smithi149.stdout:generic/002 0s 2023-06-09T04:41:48.441 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/002 2023-06-09T04:41:48.441 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:41:48.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:48.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:48.612 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-09T04:41:48.829 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:41:48.832 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:41:48.833 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:41:48.834 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:41:48.834 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:49.145 INFO:teuthology.orchestra.run.smithi149.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-09T04:41:49.149 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/003 2023-06-09T04:41:49.149 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/003 2023-06-09T04:41:49.150 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:41:49.151 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:49.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:49.176 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-09T04:41:49.370 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:41:49.374 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:41:49.375 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:41:49.375 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:41:49.376 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:49.671 INFO:teuthology.orchestra.run.smithi149.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-09T04:41:49.675 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/004 2023-06-09T04:41:49.675 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/004 2023-06-09T04:41:49.675 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:41:49.677 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:49.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:49.700 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-09T04:41:49.924 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:41:49.928 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:41:49.928 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:41:49.929 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:41:49.929 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:50.428 INFO:teuthology.orchestra.run.smithi149.stdout:generic/005 0s 2023-06-09T04:41:50.433 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/005 2023-06-09T04:41:50.433 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:41:50.435 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:50.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:41:50.530 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-09T04:41:50.734 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:41:50.738 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:41:50.739 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:41:50.740 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:41:50.740 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:41:59.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:59.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:15.503 INFO:teuthology.orchestra.run.smithi149.stdout:generic/006 25s 2023-06-09T04:42:15.508 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/006 2023-06-09T04:42:15.508 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:42:15.510 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:42:15.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:42:15.567 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-09T04:42:15.991 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:42:15.995 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:42:15.995 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:42:15.996 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:42:15.997 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:42:29.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:29.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:59.689 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:59.693 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:06.355 INFO:teuthology.orchestra.run.smithi149.stdout:generic/007 50s 2023-06-09T04:43:06.367 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/007 2023-06-09T04:43:06.367 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:43:06.370 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:06.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:06.472 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-09T04:43:06.702 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:43:06.706 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:06.707 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:43:06.708 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:43:06.708 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:07.095 INFO:teuthology.orchestra.run.smithi149.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:43:07.099 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/008 2023-06-09T04:43:07.099 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/008 2023-06-09T04:43:07.100 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:43:07.101 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:07.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:07.126 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-09T04:43:07.358 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:43:07.362 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:07.363 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:43:07.364 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:43:07.364 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:07.739 INFO:teuthology.orchestra.run.smithi149.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:43:07.742 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/009 2023-06-09T04:43:07.743 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/009 2023-06-09T04:43:07.743 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:43:07.745 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:07.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:07.773 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-09T04:43:07.968 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:43:07.972 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:07.973 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:43:07.974 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:43:07.974 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:08.266 INFO:teuthology.orchestra.run.smithi149.stdout:generic/010 [not run] /tmp/tmp.cJJFcf5ijVxfstests-dev/src/dbtest not built 2023-06-09T04:43:08.270 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/010 2023-06-09T04:43:08.271 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/010 2023-06-09T04:43:08.271 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:43:08.273 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:08.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:08.298 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-09T04:43:08.493 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:43:08.497 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:08.497 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:43:08.498 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:43:08.498 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:29.880 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:29.883 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:45.179 INFO:teuthology.orchestra.run.smithi149.stdout:generic/011 37s 2023-06-09T04:43:45.184 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/011 2023-06-09T04:43:45.184 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:43:45.186 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:45.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:45.395 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-09T04:43:45.596 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:43:45.600 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:45.601 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:43:45.602 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:43:45.602 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:46.057 INFO:teuthology.orchestra.run.smithi149.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:43:46.061 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/012 2023-06-09T04:43:46.061 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/012 2023-06-09T04:43:46.061 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:43:46.063 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:46.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:43:46.136 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-09T04:43:46.334 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:43:46.338 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:43:46.338 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:43:46.340 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:43:46.340 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:43:59.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:59.958 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:30.473 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:30.478 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:40.259 INFO:teuthology.orchestra.run.smithi149.stdout:generic/013 54s 2023-06-09T04:44:40.269 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/013 2023-06-09T04:44:40.270 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:44:40.274 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:44:40.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:44:40.313 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-09T04:44:40.575 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:44:40.583 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:44:40.583 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:44:40.584 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:44:40.584 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:45:00.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:00.541 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:31.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:31.130 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:01.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:01.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:31.414 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:31.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:01.745 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:01.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:32.134 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:32.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:02.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:02.424 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:33.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:33.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:03.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:03.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:29.449 INFO:teuthology.orchestra.run.smithi149.stdout:generic/014 289s 2023-06-09T04:49:29.467 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/014 2023-06-09T04:49:29.467 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:29.469 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:29.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:29.522 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-09T04:49:30.002 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:30.009 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:30.009 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:30.010 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:30.011 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:30.487 INFO:teuthology.orchestra.run.smithi149.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:49:30.496 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/015 2023-06-09T04:49:30.496 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/015 2023-06-09T04:49:30.496 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:30.498 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:30.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:30.522 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-09T04:49:30.899 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:30.906 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:30.907 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:30.908 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:30.908 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:31.811 INFO:teuthology.orchestra.run.smithi149.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:49:31.821 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/016 2023-06-09T04:49:31.821 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/016 2023-06-09T04:49:31.821 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:31.823 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:32.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:32.140 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-09T04:49:32.552 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:32.556 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:32.556 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:32.557 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:33.057 INFO:teuthology.orchestra.run.smithi149.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:49:33.062 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/017 2023-06-09T04:49:33.062 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/017 2023-06-09T04:49:33.062 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:33.068 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:33.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:33.097 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-09T04:49:33.458 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:33.465 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:33.466 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:33.467 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:33.467 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:34.151 INFO:teuthology.orchestra.run.smithi149.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-09T04:49:34.180 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/018 2023-06-09T04:49:34.181 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/018 2023-06-09T04:49:34.181 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:34.183 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:34.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:34.215 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-09T04:49:34.511 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:34.517 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:34.517 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:34.518 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:34.518 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:34.550 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:34.552 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:34.984 INFO:teuthology.orchestra.run.smithi149.stdout:generic/019 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:49:34.996 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/019 2023-06-09T04:49:34.996 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/019 2023-06-09T04:49:34.997 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:34.999 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:35.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:35.028 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-09T04:49:35.423 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:35.430 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:35.430 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:35.435 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:35.435 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:39.216 INFO:teuthology.orchestra.run.smithi149.stdout:generic/020 4s 2023-06-09T04:49:39.223 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/020 2023-06-09T04:49:39.223 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:39.227 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:39.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:39.498 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-09T04:49:39.959 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:39.967 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:39.969 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:39.971 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:39.971 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:40.586 INFO:teuthology.orchestra.run.smithi149.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:49:40.593 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/021 2023-06-09T04:49:40.594 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/021 2023-06-09T04:49:40.594 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:40.596 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:40.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:40.926 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-09T04:49:41.300 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:41.309 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:41.309 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:41.310 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:41.310 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:41.952 INFO:teuthology.orchestra.run.smithi149.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:49:41.957 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/022 2023-06-09T04:49:41.958 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/022 2023-06-09T04:49:41.958 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:49:41.959 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:49:42.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:42.118 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-09T04:49:42.638 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:49:42.643 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:49:42.644 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:49:42.645 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:49:42.645 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:04.899 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:04.901 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:35.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:35.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:47.153 INFO:teuthology.orchestra.run.smithi149.stdout:generic/023 65s 2023-06-09T04:50:47.163 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/023 2023-06-09T04:50:47.164 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:50:47.166 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:47.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:47.571 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-09T04:50:47.972 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:50:47.977 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:47.978 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:50:47.979 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:50:47.979 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:48.542 INFO:teuthology.orchestra.run.smithi149.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:50:48.550 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/024 2023-06-09T04:50:48.550 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/024 2023-06-09T04:50:48.550 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:50:48.552 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:48.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:48.904 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-09T04:50:49.300 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:50:49.306 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:49.307 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:50:49.308 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:50:49.308 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:49.847 INFO:teuthology.orchestra.run.smithi149.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:50:49.852 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/025 2023-06-09T04:50:49.852 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/025 2023-06-09T04:50:49.852 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:50:49.858 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:49.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:49.993 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-09T04:50:50.584 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:50:50.591 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:50.592 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:50:50.592 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:50:50.593 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:51.246 INFO:teuthology.orchestra.run.smithi149.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-09T04:50:51.250 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/026 2023-06-09T04:50:51.250 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/026 2023-06-09T04:50:51.250 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:50:51.252 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:51.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:51.305 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-09T04:50:51.702 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:50:51.716 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:51.716 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:50:51.718 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:50:51.718 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:52.225 INFO:teuthology.orchestra.run.smithi149.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:50:52.232 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/027 2023-06-09T04:50:52.232 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/027 2023-06-09T04:50:52.232 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:50:52.234 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:52.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:52.264 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-09T04:50:52.642 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:50:52.657 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:52.657 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:50:52.658 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:50:52.658 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:58.102 INFO:teuthology.orchestra.run.smithi149.stdout:generic/028 6s 2023-06-09T04:50:58.107 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/028 2023-06-09T04:50:58.107 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:50:58.109 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:50:58.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:50:58.135 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-09T04:50:58.339 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:50:58.343 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:50:58.343 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:50:58.344 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:50:58.344 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:02.365 INFO:teuthology.orchestra.run.smithi149.stdout:generic/029 4s 2023-06-09T04:51:02.369 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/029 2023-06-09T04:51:02.369 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:02.371 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:02.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:02.380 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-09T04:51:02.595 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:02.599 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:02.599 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:02.600 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:02.601 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:05.800 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:05.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:07.393 INFO:teuthology.orchestra.run.smithi149.stdout:generic/030 5s 2023-06-09T04:51:07.397 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/030 2023-06-09T04:51:07.397 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:07.399 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:07.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:07.408 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-09T04:51:07.606 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:07.611 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:07.611 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:07.612 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:07.612 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:08.008 INFO:teuthology.orchestra.run.smithi149.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:51:08.012 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/031 2023-06-09T04:51:08.013 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/031 2023-06-09T04:51:08.013 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:08.014 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:08.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:08.041 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-09T04:51:08.280 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:08.285 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:08.285 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:08.286 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:08.286 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:08.604 INFO:teuthology.orchestra.run.smithi149.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:51:08.608 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/032 2023-06-09T04:51:08.609 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/032 2023-06-09T04:51:08.609 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:08.611 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:08.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:08.636 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-09T04:51:08.831 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:08.834 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:08.835 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:08.836 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:08.836 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:09.214 INFO:teuthology.orchestra.run.smithi149.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:51:09.218 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/033 2023-06-09T04:51:09.218 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/033 2023-06-09T04:51:09.218 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:09.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:09.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:09.252 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-09T04:51:09.464 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:09.468 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:09.469 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:09.470 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:09.470 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:09.844 INFO:teuthology.orchestra.run.smithi149.stdout:generic/034 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:09.848 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/034 2023-06-09T04:51:09.848 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/034 2023-06-09T04:51:09.848 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:09.850 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:09.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:09.876 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-09T04:51:10.083 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:10.087 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:10.088 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:10.089 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:10.089 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:10.493 INFO:teuthology.orchestra.run.smithi149.stdout:generic/035 0s 2023-06-09T04:51:10.497 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/035 2023-06-09T04:51:10.497 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:10.499 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:10.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:10.735 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-09T04:51:11.064 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:11.068 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:11.068 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:11.070 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:11.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:21.469 INFO:teuthology.orchestra.run.smithi149.stdout:generic/036 10s 2023-06-09T04:51:21.474 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/036 2023-06-09T04:51:21.474 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:21.476 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:21.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:21.841 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-09T04:51:22.047 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:22.051 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:22.051 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:22.052 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:22.052 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:24.614 INFO:teuthology.orchestra.run.smithi149.stdout:generic/037 2s 2023-06-09T04:51:24.619 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/037 2023-06-09T04:51:24.619 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:24.621 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:24.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:24.630 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-09T04:51:24.824 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:24.828 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:24.828 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:24.829 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:24.829 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:25.135 INFO:teuthology.orchestra.run.smithi149.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:51:25.139 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/038 2023-06-09T04:51:25.139 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/038 2023-06-09T04:51:25.139 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:25.141 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:25.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:25.171 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-09T04:51:25.391 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:25.395 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:25.395 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:25.396 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:25.396 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:25.734 INFO:teuthology.orchestra.run.smithi149.stdout:generic/039 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:25.738 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/039 2023-06-09T04:51:25.738 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/039 2023-06-09T04:51:25.738 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:25.740 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:25.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:25.772 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-09T04:51:25.970 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:25.974 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:25.974 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:25.975 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:25.975 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:26.318 INFO:teuthology.orchestra.run.smithi149.stdout:generic/040 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:26.322 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/040 2023-06-09T04:51:26.322 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/040 2023-06-09T04:51:26.323 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:26.324 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:26.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:26.354 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-09T04:51:26.549 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:26.553 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:26.554 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:26.554 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:26.555 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:26.890 INFO:teuthology.orchestra.run.smithi149.stdout:generic/041 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:26.894 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/041 2023-06-09T04:51:26.894 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/041 2023-06-09T04:51:26.894 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:26.896 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:26.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:26.924 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-09T04:51:27.129 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:27.133 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:27.134 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:27.135 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:27.135 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:27.592 INFO:teuthology.orchestra.run.smithi149.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-09T04:51:27.613 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/042 2023-06-09T04:51:27.613 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/042 2023-06-09T04:51:27.613 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:27.615 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:27.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:27.636 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-09T04:51:27.843 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:27.847 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:27.848 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:27.848 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:27.849 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:28.337 INFO:teuthology.orchestra.run.smithi149.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-09T04:51:28.367 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/043 2023-06-09T04:51:28.367 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/043 2023-06-09T04:51:28.367 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:28.369 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:28.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:28.394 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-09T04:51:28.611 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:28.615 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:28.616 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:28.617 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:28.617 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:29.075 INFO:teuthology.orchestra.run.smithi149.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-09T04:51:29.105 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/044 2023-06-09T04:51:29.106 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/044 2023-06-09T04:51:29.106 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:29.108 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:29.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:29.137 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-09T04:51:29.334 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:29.338 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:29.338 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:29.339 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:29.339 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:29.785 INFO:teuthology.orchestra.run.smithi149.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-09T04:51:29.813 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/045 2023-06-09T04:51:29.813 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/045 2023-06-09T04:51:29.814 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:29.815 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:29.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:29.836 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-09T04:51:30.062 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:30.066 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:30.066 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:30.067 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:30.067 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:30.539 INFO:teuthology.orchestra.run.smithi149.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-09T04:51:30.561 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/046 2023-06-09T04:51:30.562 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/046 2023-06-09T04:51:30.562 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:30.564 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:30.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:30.582 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-09T04:51:30.777 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:30.781 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:30.781 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:30.782 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:30.782 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:31.250 INFO:teuthology.orchestra.run.smithi149.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-09T04:51:31.272 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/047 2023-06-09T04:51:31.273 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/047 2023-06-09T04:51:31.273 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:31.275 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:31.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:31.298 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-09T04:51:31.495 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:31.499 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:31.499 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:31.500 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:31.501 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:31.938 INFO:teuthology.orchestra.run.smithi149.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-09T04:51:31.952 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/048 2023-06-09T04:51:31.953 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/048 2023-06-09T04:51:31.953 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:31.954 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:31.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:31.983 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-09T04:51:32.181 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:32.185 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:32.185 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:32.186 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:32.186 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:32.640 INFO:teuthology.orchestra.run.smithi149.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-09T04:51:32.659 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/049 2023-06-09T04:51:32.659 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/049 2023-06-09T04:51:32.659 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:32.661 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:32.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:32.684 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-09T04:51:32.889 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:32.893 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:32.894 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:32.895 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:32.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:33.369 INFO:teuthology.orchestra.run.smithi149.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-09T04:51:33.387 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/050 2023-06-09T04:51:33.387 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/050 2023-06-09T04:51:33.387 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:33.389 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:33.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:33.410 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-09T04:51:33.606 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:33.610 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:33.610 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:33.611 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:33.611 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:34.077 INFO:teuthology.orchestra.run.smithi149.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-09T04:51:34.080 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/051 2023-06-09T04:51:34.081 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/051 2023-06-09T04:51:34.081 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:34.082 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:34.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:34.112 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-09T04:51:34.313 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:34.317 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:34.318 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:34.319 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:34.319 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:34.762 INFO:teuthology.orchestra.run.smithi149.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-09T04:51:34.780 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/052 2023-06-09T04:51:34.780 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/052 2023-06-09T04:51:34.781 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:34.782 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:34.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:34.809 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-09T04:51:35.005 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:35.009 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:35.009 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:35.010 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:35.010 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:35.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:35.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:36.017 INFO:teuthology.orchestra.run.smithi149.stdout:generic/053 1s 2023-06-09T04:51:36.039 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/053 2023-06-09T04:51:36.040 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:36.041 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:36.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:36.050 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-09T04:51:37.347 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:37.351 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:37.351 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:37.352 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:37.352 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:37.853 INFO:teuthology.orchestra.run.smithi149.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-09T04:51:37.871 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/054 2023-06-09T04:51:37.871 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/054 2023-06-09T04:51:37.871 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:37.873 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:37.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:37.906 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-09T04:51:38.103 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:38.107 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:38.107 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:38.108 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:38.109 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:38.582 INFO:teuthology.orchestra.run.smithi149.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-09T04:51:38.618 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/055 2023-06-09T04:51:38.618 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/055 2023-06-09T04:51:38.618 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:38.620 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:38.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:38.640 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-09T04:51:38.835 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:38.839 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:38.840 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:38.841 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:38.841 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:39.202 INFO:teuthology.orchestra.run.smithi149.stdout:generic/056 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:39.205 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/056 2023-06-09T04:51:39.206 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/056 2023-06-09T04:51:39.206 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:39.208 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:39.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:39.234 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-09T04:51:39.466 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:39.470 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:39.471 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:39.472 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:39.472 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:39.818 INFO:teuthology.orchestra.run.smithi149.stdout:generic/057 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:39.822 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/057 2023-06-09T04:51:39.822 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/057 2023-06-09T04:51:39.822 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:39.824 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:39.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:39.846 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-09T04:51:40.045 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:40.049 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:40.049 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:40.050 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:40.050 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:40.453 INFO:teuthology.orchestra.run.smithi149.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:51:40.457 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/058 2023-06-09T04:51:40.457 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/058 2023-06-09T04:51:40.457 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:40.459 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:40.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:40.815 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-09T04:51:41.096 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:41.100 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:41.100 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:41.101 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:41.101 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:41.456 INFO:teuthology.orchestra.run.smithi149.stdout:generic/059 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:41.460 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/059 2023-06-09T04:51:41.460 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/059 2023-06-09T04:51:41.460 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:41.462 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:41.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:41.484 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-09T04:51:41.681 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:41.685 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:41.686 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:41.687 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:41.687 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:42.082 INFO:teuthology.orchestra.run.smithi149.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:51:42.086 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/060 2023-06-09T04:51:42.086 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/060 2023-06-09T04:51:42.086 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:42.088 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:42.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:42.391 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-09T04:51:42.684 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:42.689 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:42.689 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:42.690 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:43.105 INFO:teuthology.orchestra.run.smithi149.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:51:43.108 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/061 2023-06-09T04:51:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/061 2023-06-09T04:51:43.109 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:43.110 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:43.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:43.402 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-09T04:51:43.741 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:43.745 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:43.745 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:43.746 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:43.746 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:45.604 INFO:teuthology.orchestra.run.smithi149.stdout:generic/062 2s 2023-06-09T04:51:45.656 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/062 2023-06-09T04:51:45.656 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:45.660 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:45.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:45.672 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-09T04:51:45.875 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:45.878 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:45.879 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:45.880 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:45.880 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:46.338 INFO:teuthology.orchestra.run.smithi149.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:51:46.342 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/063 2023-06-09T04:51:46.342 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/063 2023-06-09T04:51:46.343 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:46.345 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:46.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:46.567 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-09T04:51:46.977 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:46.981 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:46.982 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:46.982 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:47.317 INFO:teuthology.orchestra.run.smithi149.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:51:47.321 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/064 2023-06-09T04:51:47.321 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/064 2023-06-09T04:51:47.321 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:47.323 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:47.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:47.349 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-09T04:51:47.551 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:47.555 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:47.556 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:47.557 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:47.557 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:47.946 INFO:teuthology.orchestra.run.smithi149.stdout:generic/065 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:47.950 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/065 2023-06-09T04:51:47.950 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/065 2023-06-09T04:51:47.950 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:47.952 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:47.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:47.985 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-09T04:51:48.202 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:48.206 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:48.206 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:48.207 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:48.207 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:48.522 INFO:teuthology.orchestra.run.smithi149.stdout:generic/066 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:48.526 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/066 2023-06-09T04:51:48.526 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/066 2023-06-09T04:51:48.527 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:48.528 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:48.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:48.551 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-09T04:51:48.757 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:48.760 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:48.761 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:48.762 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:48.762 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:49.114 INFO:teuthology.orchestra.run.smithi149.stdout:generic/067 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:51:49.118 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/067 2023-06-09T04:51:49.119 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/067 2023-06-09T04:51:49.119 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:49.121 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:49.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:49.149 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-09T04:51:49.354 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:49.358 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:49.358 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:49.359 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:49.360 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:49.687 INFO:teuthology.orchestra.run.smithi149.stdout:generic/068 [not run] ceph does not support freezing 2023-06-09T04:51:49.690 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/068 2023-06-09T04:51:49.691 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/068 2023-06-09T04:51:49.691 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:49.693 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:49.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:49.713 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-09T04:51:49.935 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:49.939 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:49.939 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:49.940 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:49.940 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:55.537 INFO:teuthology.orchestra.run.smithi149.stdout:generic/069 5s 2023-06-09T04:51:55.547 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/069 2023-06-09T04:51:55.548 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:51:55.550 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:51:55.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:51:55.563 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-09T04:51:55.757 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:51:55.761 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:51:55.761 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:51:55.762 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:51:55.762 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:07.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:07.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:07.206 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T04:52:07.203+0000 7fd1388f4700 -1 received signal: Hangup from (PID: 109114) UID: 0 2023-06-09T04:52:07.208 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T04:52:07.206+0000 7f46ca054700 -1 received signal: Hangup from (PID: 109114) UID: 0 2023-06-09T04:52:14.734 INFO:teuthology.orchestra.run.smithi149.stdout:generic/070 19s 2023-06-09T04:52:14.739 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/070 2023-06-09T04:52:14.740 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:52:14.743 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:15.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:15.045 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-09T04:52:15.598 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:52:15.607 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:15.611 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:52:15.612 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:52:15.613 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:16.102 INFO:teuthology.orchestra.run.smithi149.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T04:52:16.106 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/071 2023-06-09T04:52:16.106 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/071 2023-06-09T04:52:16.106 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:52:16.108 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:16.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:16.143 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-09T04:52:16.492 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:52:16.497 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:16.497 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:52:16.499 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:52:16.500 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:17.119 INFO:teuthology.orchestra.run.smithi149.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:52:17.124 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/072 2023-06-09T04:52:17.124 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/072 2023-06-09T04:52:17.124 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:52:17.127 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:17.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:17.164 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-09T04:52:17.473 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:52:17.477 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:17.478 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:52:17.479 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:52:17.479 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:18.006 INFO:teuthology.orchestra.run.smithi149.stdout:generic/073 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:52:18.018 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/073 2023-06-09T04:52:18.018 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/073 2023-06-09T04:52:18.019 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:52:18.022 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:18.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:18.048 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-09T04:52:18.423 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:52:18.432 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:18.432 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:52:18.433 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:52:18.433 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:37.581 INFO:teuthology.orchestra.run.smithi149.stdout:generic/074 19s 2023-06-09T04:52:37.594 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/074 2023-06-09T04:52:37.594 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:52:37.604 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:52:38.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:52:38.627 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-09T04:52:39.195 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:52:39.200 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:52:39.200 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:52:39.201 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:52:39.201 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:17.161 INFO:teuthology.orchestra.run.smithi149.stdout:generic/075 38s 2023-06-09T04:53:17.166 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/075 2023-06-09T04:53:17.166 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:17.167 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:17.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:17.545 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-09T04:53:17.934 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:17.938 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:17.938 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:17.939 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:17.939 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:18.386 INFO:teuthology.orchestra.run.smithi149.stdout:generic/076 [not run] require 172.21.15.149:6789:/scratch to be local device 2023-06-09T04:53:18.391 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/076 2023-06-09T04:53:18.391 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/076 2023-06-09T04:53:18.391 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:18.400 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:18.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:18.436 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-09T04:53:18.739 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:18.744 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:18.745 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:18.746 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:18.746 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:25.112 INFO:teuthology.orchestra.run.smithi149.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:53:25.117 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/077 2023-06-09T04:53:25.117 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/077 2023-06-09T04:53:25.117 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:25.119 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:25.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:25.538 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-09T04:53:25.938 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:25.943 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:25.943 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:25.944 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:25.944 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:26.502 INFO:teuthology.orchestra.run.smithi149.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:53:26.507 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/078 2023-06-09T04:53:26.507 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/078 2023-06-09T04:53:26.507 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:26.515 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:26.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:26.897 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-09T04:53:27.283 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:27.288 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:27.288 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:27.289 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:27.289 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:27.854 INFO:teuthology.orchestra.run.smithi149.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-09T04:53:27.866 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/079 2023-06-09T04:53:27.867 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/079 2023-06-09T04:53:27.867 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:27.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:27.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:27.932 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-09T04:53:28.298 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:28.302 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:28.303 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:28.304 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:28.304 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:30.871 INFO:teuthology.orchestra.run.smithi149.stdout:generic/080 2s 2023-06-09T04:53:30.877 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/080 2023-06-09T04:53:30.877 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:30.880 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:30.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:30.929 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-09T04:53:31.265 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:31.269 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:31.269 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:31.270 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:31.270 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:31.798 INFO:teuthology.orchestra.run.smithi149.stdout:generic/081 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:53:31.803 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/081 2023-06-09T04:53:31.803 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/081 2023-06-09T04:53:31.803 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:31.808 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:31.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:31.837 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-09T04:53:32.199 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:32.205 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:32.206 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:32.207 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:32.207 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:32.700 INFO:teuthology.orchestra.run.smithi149.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T04:53:32.706 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/082 2023-06-09T04:53:32.707 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/082 2023-06-09T04:53:32.707 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:32.709 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:32.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:32.740 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-09T04:53:33.107 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:33.115 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:33.115 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:33.116 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:33.116 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:33.567 INFO:teuthology.orchestra.run.smithi149.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:53:33.571 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/083 2023-06-09T04:53:33.571 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/083 2023-06-09T04:53:33.572 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:33.574 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:33.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:33.605 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-09T04:53:33.922 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:33.926 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:33.926 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:33.929 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:33.929 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:40.145 INFO:teuthology.orchestra.run.smithi149.stdout:generic/084 6s 2023-06-09T04:53:40.157 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/084 2023-06-09T04:53:40.158 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:40.160 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:40.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:40.185 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-09T04:53:40.550 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:40.554 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:40.557 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:40.558 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:40.558 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:41.064 INFO:teuthology.orchestra.run.smithi149.stdout:generic/085 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T04:53:41.073 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/085 2023-06-09T04:53:41.073 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/085 2023-06-09T04:53:41.073 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:41.075 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:41.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:41.102 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-09T04:53:41.463 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:41.467 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:41.467 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:41.468 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:41.468 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:41.923 INFO:teuthology.orchestra.run.smithi149.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:53:41.927 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/086 2023-06-09T04:53:41.927 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/086 2023-06-09T04:53:41.927 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:41.929 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:41.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:41.977 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-09T04:53:42.328 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:42.333 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:42.334 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:42.336 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:42.337 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:43.153 INFO:teuthology.orchestra.run.smithi149.stdout:generic/087 1s 2023-06-09T04:53:43.191 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/087 2023-06-09T04:53:43.191 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:43.193 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:43.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:43.481 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-09T04:53:44.016 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:44.025 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:44.026 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:44.027 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:44.027 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:44.580 INFO:teuthology.orchestra.run.smithi149.stdout:generic/088 0s 2023-06-09T04:53:44.597 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/088 2023-06-09T04:53:44.597 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T04:53:44.600 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:53:44.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:53:44.760 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-09T04:53:45.348 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T04:53:45.356 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T04:53:45.356 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T04:53:45.357 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T04:53:45.358 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T04:55:06.200 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:06.203 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:36.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:36.396 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:06.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:06.476 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:36.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:36.557 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:06.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:06.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:37.082 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:37.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:37.182 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T04:57:37.180+0000 7f46ca054700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 109935) UID: 0 2023-06-09T04:57:37.182 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T04:57:37.180+0000 7fd1388f4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 109935) UID: 0 2023-06-09T05:00:19.702 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:19.705 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:49.766 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:49.769 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:19.853 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:19.856 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:50.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:50.265 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:01:50.358 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T05:01:50.355+0000 7fd1388f4700 -1 Fail to open '/proc/110078/cmdline' error = (2) No such file or directory 2023-06-09T05:01:50.358 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T05:01:50.355+0000 7fd1388f4700 -1 received signal: Hangup from (PID: 110078) UID: 0 2023-06-09T05:01:50.363 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T05:01:50.354+0000 7f46ca054700 -1 Fail to open '/proc/110078/cmdline' error = (2) No such file or directory 2023-06-09T05:01:50.363 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T05:01:50.354+0000 7f46ca054700 -1 received signal: Hangup from (PID: 110078) UID: 0 2023-06-09T05:02:05.418 INFO:teuthology.orchestra.run.smithi149.stdout:generic/089 500s 2023-06-09T05:02:05.425 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/089 2023-06-09T05:02:05.425 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:02:05.427 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:02:06.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:02:06.181 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-06-09T05:02:06.409 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:02:06.413 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:02:06.414 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:02:06.415 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:02:06.415 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:02:07.156 INFO:teuthology.orchestra.run.smithi149.stdout:generic/090 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:02:07.160 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/090 2023-06-09T05:02:07.160 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/090 2023-06-09T05:02:07.160 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:02:07.162 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:02:07.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:02:07.188 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-06-09T05:02:07.386 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:02:07.390 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:02:07.390 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:02:07.391 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:02:07.391 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:49.631 INFO:teuthology.orchestra.run.smithi149.stdout:generic/091 102s 2023-06-09T05:03:49.635 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/091 2023-06-09T05:03:49.635 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:03:49.637 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:50.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:03:50.042 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-06-09T05:03:50.258 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:03:50.262 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:03:50.262 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:03:50.263 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:03:50.263 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:50.610 INFO:teuthology.orchestra.run.smithi149.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:03:50.614 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/092 2023-06-09T05:03:50.614 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/092 2023-06-09T05:03:50.614 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:03:50.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:50.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:03:50.643 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-06-09T05:03:50.846 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:03:50.850 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:03:50.850 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:03:50.851 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:03:50.851 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:52.161 INFO:teuthology.orchestra.run.smithi149.stdout:generic/093 1s 2023-06-09T05:03:52.409 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/093 2023-06-09T05:03:52.409 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:03:52.412 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:52.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:03:52.808 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-06-09T05:03:53.027 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:03:53.031 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:03:53.031 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:03:53.032 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:03:53.032 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:53.404 INFO:teuthology.orchestra.run.smithi149.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T05:03:53.408 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/094 2023-06-09T05:03:53.409 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/094 2023-06-09T05:03:53.409 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:03:53.410 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:03:53.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:03:53.816 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-06-09T05:03:54.022 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:03:54.026 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:03:54.027 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:03:54.028 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:03:54.028 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:07.356 INFO:teuthology.orchestra.run.smithi149.stdout:generic/095 13s 2023-06-09T05:04:07.377 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/095 2023-06-09T05:04:07.378 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:07.380 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:07.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:07.388 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-06-09T05:04:07.593 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:07.597 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:07.597 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:07.598 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:07.598 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:08.003 INFO:teuthology.orchestra.run.smithi149.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T05:04:08.007 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/096 2023-06-09T05:04:08.007 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/096 2023-06-09T05:04:08.007 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:08.009 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:08.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:08.041 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-06-09T05:04:08.252 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:08.256 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:08.256 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:08.257 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:08.257 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:09.164 INFO:teuthology.orchestra.run.smithi149.stdout:generic/097 1s 2023-06-09T05:04:09.168 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/097 2023-06-09T05:04:09.168 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:09.170 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:09.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:09.204 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-06-09T05:04:09.408 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:09.412 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:09.413 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:09.414 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:09.414 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:12.793 INFO:teuthology.orchestra.run.smithi149.stdout:generic/098 3s 2023-06-09T05:04:12.798 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/098 2023-06-09T05:04:12.798 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:12.800 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:12.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:12.809 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-06-09T05:04:13.005 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:13.009 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:13.010 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:13.010 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:13.011 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:13.934 INFO:teuthology.orchestra.run.smithi149.stdout:generic/099 0s 2023-06-09T05:04:13.939 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/099 2023-06-09T05:04:13.939 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:13.941 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:14.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:14.342 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-06-09T05:04:14.542 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:14.547 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:14.547 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:14.548 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:14.548 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:26.127 INFO:teuthology.orchestra.run.smithi149.stdout:generic/100 12s 2023-06-09T05:04:26.131 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/100 2023-06-09T05:04:26.131 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:26.133 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:29.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:29.933 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-06-09T05:04:30.275 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:30.279 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:30.280 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:30.281 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:30.281 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:30.644 INFO:teuthology.orchestra.run.smithi149.stdout:generic/101 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:04:30.648 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/101 2023-06-09T05:04:30.648 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/101 2023-06-09T05:04:30.648 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:30.650 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:30.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:30.670 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-06-09T05:04:30.874 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:30.878 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:30.879 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:31.209 INFO:teuthology.orchestra.run.smithi149.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:04:31.212 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/102 2023-06-09T05:04:31.213 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/102 2023-06-09T05:04:31.213 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:31.215 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:31.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:31.235 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-06-09T05:04:31.438 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:31.442 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:31.442 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:31.443 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:31.444 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:31.806 INFO:teuthology.orchestra.run.smithi149.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:04:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/103 2023-06-09T05:04:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/103 2023-06-09T05:04:31.810 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:31.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:32.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:32.225 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-06-09T05:04:32.489 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:32.493 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:32.493 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:32.494 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:32.494 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:32.832 INFO:teuthology.orchestra.run.smithi149.stdout:generic/104 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:04:32.836 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/104 2023-06-09T05:04:32.836 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/104 2023-06-09T05:04:32.836 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:32.838 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:32.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:32.870 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-06-09T05:04:33.083 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:33.088 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:33.088 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:33.089 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:33.089 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:34.082 INFO:teuthology.orchestra.run.smithi149.stdout:generic/105 1s 2023-06-09T05:04:34.089 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/105 2023-06-09T05:04:34.089 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:34.091 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:34.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:34.100 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-06-09T05:04:34.298 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:34.302 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:34.302 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:34.303 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:34.304 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:34.662 INFO:teuthology.orchestra.run.smithi149.stdout:generic/106 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:04:34.666 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/106 2023-06-09T05:04:34.666 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/106 2023-06-09T05:04:34.666 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:34.668 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:34.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:34.695 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-06-09T05:04:34.899 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:34.903 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:34.903 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:34.904 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:34.905 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:35.280 INFO:teuthology.orchestra.run.smithi149.stdout:generic/107 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:04:35.284 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/107 2023-06-09T05:04:35.284 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/107 2023-06-09T05:04:35.284 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:35.286 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:35.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:35.317 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-06-09T05:04:35.526 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:35.530 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:35.530 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:35.531 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:35.531 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:36.009 INFO:teuthology.orchestra.run.smithi149.stdout:generic/108 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:04:36.013 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/108 2023-06-09T05:04:36.013 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/108 2023-06-09T05:04:36.013 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:36.015 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:36.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:36.037 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-06-09T05:04:36.245 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:36.249 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:36.250 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:36.251 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:36.251 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:43.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:43.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:46.703 INFO:teuthology.orchestra.run.smithi149.stdout:generic/109 10s 2023-06-09T05:04:46.709 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/109 2023-06-09T05:04:46.709 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:04:46.711 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:04:46.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:04:46.744 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-06-09T05:04:47.675 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:04:47.679 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:04:47.679 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:04:47.680 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:04:47.681 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:08.881 INFO:teuthology.orchestra.run.smithi149.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:05:08.885 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/110 2023-06-09T05:05:08.886 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/110 2023-06-09T05:05:08.886 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:05:08.888 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:09.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:05:09.290 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-06-09T05:05:09.646 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:05:09.650 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:05:09.651 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:05:09.652 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:05:09.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:09.994 INFO:teuthology.orchestra.run.smithi149.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:05:09.998 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/111 2023-06-09T05:05:09.999 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/111 2023-06-09T05:05:09.999 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:05:10.000 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:10.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:05:10.360 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-06-09T05:05:10.614 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:05:10.618 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:05:10.619 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:05:10.620 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:05:10.620 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:14.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:14.558 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:26.482 INFO:teuthology.orchestra.run.smithi149.stdout:generic/112 16s 2023-06-09T05:05:26.486 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/112 2023-06-09T05:05:26.486 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:05:26.488 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:26.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:05:26.817 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-06-09T05:05:27.100 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:05:27.104 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:05:27.104 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:05:27.105 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:05:27.105 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:43.464 INFO:teuthology.orchestra.run.smithi149.stdout:generic/113 16s 2023-06-09T05:05:43.476 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/113 2023-06-09T05:05:43.476 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:05:43.478 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:43.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:05:43.549 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-06-09T05:05:44.323 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:05:44.327 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:05:44.327 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:05:44.328 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:05:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:44.621 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:44.623 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:44.723 INFO:teuthology.orchestra.run.smithi149.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-06-09T05:05:44.727 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/114 2023-06-09T05:05:44.727 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/114 2023-06-09T05:05:44.727 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:05:44.729 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:44.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:05:44.759 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-06-09T05:05:44.963 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:05:44.967 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:05:44.968 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:05:44.969 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:05:44.969 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:45.322 INFO:teuthology.orchestra.run.smithi149.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:05:45.326 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/115 2023-06-09T05:05:45.326 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/115 2023-06-09T05:05:45.326 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:05:45.328 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:45.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:05:45.690 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-06-09T05:05:45.942 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:05:45.946 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:05:45.947 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:05:45.948 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:05:45.948 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:46.321 INFO:teuthology.orchestra.run.smithi149.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:05:46.325 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/116 2023-06-09T05:05:46.325 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/116 2023-06-09T05:05:46.325 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:05:46.327 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:05:46.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:05:46.539 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-06-09T05:05:46.949 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:05:46.953 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:05:46.953 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:05:46.954 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:05:46.955 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:00.641 INFO:teuthology.orchestra.run.smithi149.stdout:generic/117 13s 2023-06-09T05:06:00.646 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/117 2023-06-09T05:06:00.646 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:00.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:00.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:00.656 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-06-09T05:06:00.890 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:00.894 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:00.895 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:00.896 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:00.896 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:01.699 INFO:teuthology.orchestra.run.smithi149.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:06:01.703 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/118 2023-06-09T05:06:01.704 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/118 2023-06-09T05:06:01.704 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:01.706 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:02.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:02.112 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-06-09T05:06:02.424 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:02.428 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:02.429 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:02.430 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:02.430 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:02.769 INFO:teuthology.orchestra.run.smithi149.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:06:02.773 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/119 2023-06-09T05:06:02.773 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/119 2023-06-09T05:06:02.773 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:02.775 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:03.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:03.112 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-06-09T05:06:03.382 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:03.386 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:03.387 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:03.388 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:03.388 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:03.713 INFO:teuthology.orchestra.run.smithi149.stdout:generic/120 [not run] atime not maintained by ceph 2023-06-09T05:06:03.717 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/120 2023-06-09T05:06:03.717 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/120 2023-06-09T05:06:03.717 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:03.719 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:03.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:03.740 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-06-09T05:06:03.942 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:03.946 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:03.946 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:03.947 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:03.947 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:04.307 INFO:teuthology.orchestra.run.smithi149.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:06:04.310 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/121 2023-06-09T05:06:04.311 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/121 2023-06-09T05:06:04.311 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:04.312 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:04.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:04.634 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-06-09T05:06:04.937 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:04.941 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:04.941 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:04.942 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:04.943 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:05.308 INFO:teuthology.orchestra.run.smithi149.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:06:05.312 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/122 2023-06-09T05:06:05.312 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/122 2023-06-09T05:06:05.312 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:05.314 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:05.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:05.714 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-06-09T05:06:05.962 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:05.966 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:05.967 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:05.967 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:05.968 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:06.516 INFO:teuthology.orchestra.run.smithi149.stdout:generic/123 0s 2023-06-09T05:06:06.520 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/123 2023-06-09T05:06:06.521 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:06.522 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:06.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:06.779 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-06-09T05:06:07.143 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:07.147 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:07.148 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:07.149 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:07.149 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:09.626 INFO:teuthology.orchestra.run.smithi149.stdout:generic/124 2s 2023-06-09T05:06:09.636 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/124 2023-06-09T05:06:09.636 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:06:09.640 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:09.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:06:09.976 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-06-09T05:06:10.434 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:06:10.438 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:06:10.438 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:06:10.439 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:06:10.439 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:06:14.751 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:14.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:44.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:44.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:11.943 INFO:teuthology.orchestra.run.smithi149.stdout:generic/125 61s 2023-06-09T05:07:11.949 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/125 2023-06-09T05:07:11.949 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:07:11.951 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:07:12.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:07:12.256 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-06-09T05:07:12.579 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:07:12.583 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:07:12.583 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:07:12.584 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:07:12.584 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:07:13.082 INFO:teuthology.orchestra.run.smithi149.stdout:generic/126 1s 2023-06-09T05:07:13.086 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/126 2023-06-09T05:07:13.086 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:07:13.088 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:07:13.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:07:13.521 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-06-09T05:07:13.754 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:07:13.758 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:07:13.759 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:07:13.760 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:07:13.760 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:07:14.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:14.950 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:45.101 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:45.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:15.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:15.249 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:45.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:08:45.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:15.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:15.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:45.545 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:09:45.548 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:15.616 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:15.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:45.721 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:45.723 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:15.852 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:15.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:45.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:45.950 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:16.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:16.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:46.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:46.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:16.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:16.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:46.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:13:46.454 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:16.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:16.559 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:46.633 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:14:46.635 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:17.039 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:17.042 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:47.111 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:47.113 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:17.184 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:17.186 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:47.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:47.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:53.810 INFO:teuthology.orchestra.run.smithi149.stdout:generic/127 580s 2023-06-09T05:16:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/127 2023-06-09T05:16:53.815 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:16:53.817 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:16:54.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:16:54.224 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-06-09T05:16:54.493 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:16:54.497 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:16:54.498 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:16:54.499 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:16:54.499 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:16:55.737 INFO:teuthology.orchestra.run.smithi149.stdout:generic/128 1s 2023-06-09T05:16:55.742 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/128 2023-06-09T05:16:55.742 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:16:55.744 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:16:55.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:16:55.753 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-06-09T05:16:55.959 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:16:55.964 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:16:55.964 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:16:55.965 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:16:55.965 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:17:17.335 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:17.337 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:47.672 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:47.687 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:18.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:18.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:48.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:48.142 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:18.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:18.256 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:48.344 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:48.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:18.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:18.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:18.648 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T05:20:18.638+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258117) UID: 0 2023-06-09T05:20:18.648 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T05:20:18.633+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258117) UID: 0 2023-06-09T05:20:18.649 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T05:20:18.638+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258117) UID: 0 2023-06-09T05:20:18.649 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T05:20:18.638+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258117) UID: 0 2023-06-09T05:24:55.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:55.594 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:55.878 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T05:24:55.874+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258187) UID: 0 2023-06-09T05:24:55.878 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T05:24:55.874+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258187) UID: 0 2023-06-09T05:24:55.878 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T05:24:55.874+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258187) UID: 0 2023-06-09T05:24:55.879 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T05:24:55.874+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258187) UID: 0 2023-06-09T05:24:55.977 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T05:24:55.975+0000 7f70361b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112629) UID: 0 2023-06-09T05:24:55.978 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T05:24:55.975+0000 7fe30460e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112629) UID: 0 2023-06-09T05:24:55.979 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T05:24:55.976+0000 7fc102cf8700 -1 Fail to open '/proc/112629/cmdline' error = (2) No such file or directory 2023-06-09T05:24:55.979 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T05:24:55.976+0000 7fc102cf8700 -1 received signal: Hangup from (PID: 112629) UID: 0 2023-06-09T05:24:55.980 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T05:24:55.975+0000 7f5a931e5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112629) UID: 0 2023-06-09T05:32:30.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:30.318 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:30.523 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T05:32:30.520+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258274) UID: 0 2023-06-09T05:32:30.524 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T05:32:30.520+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258274) UID: 0 2023-06-09T05:32:30.524 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T05:32:30.520+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258274) UID: 0 2023-06-09T05:32:30.525 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T05:32:30.520+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258274) UID: 0 2023-06-09T05:37:56.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:56.695 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:56.813 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T05:37:56.811+0000 7f70361b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112789) UID: 0 2023-06-09T05:37:56.814 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T05:37:56.811+0000 7f5a931e5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112789) UID: 0 2023-06-09T05:37:56.814 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T05:37:56.811+0000 7fe30460e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112789) UID: 0 2023-06-09T05:37:56.814 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T05:37:56.811+0000 7fc102cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112789) UID: 0 2023-06-09T05:37:57.022 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T05:37:57.019+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258350) UID: 0 2023-06-09T05:37:57.023 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T05:37:57.020+0000 7f9fc24c4700 -1 received signal: Hangup from (PID: 258350) UID: 0 2023-06-09T05:37:57.024 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T05:37:57.019+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258350) UID: 0 2023-06-09T05:37:57.024 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T05:37:57.020+0000 7f18d4cee700 -1 received signal: Hangup from (PID: 258350) UID: 0 2023-06-09T05:38:09.865 INFO:teuthology.orchestra.run.smithi149.stdout:generic/129 1273s 2023-06-09T05:38:09.959 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/129 2023-06-09T05:38:09.959 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:38:09.963 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:38:09.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:38:09.976 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-06-09T05:38:10.244 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:38:10.248 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:38:10.248 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:38:10.249 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:38:10.250 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:38:25.596 INFO:teuthology.orchestra.run.smithi149.stdout:generic/130 15s 2023-06-09T05:38:25.603 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/130 2023-06-09T05:38:25.603 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:38:25.605 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:38:25.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:38:25.614 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-06-09T05:38:25.820 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:38:25.824 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:38:25.824 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:38:25.825 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:38:25.825 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:38:27.674 INFO:teuthology.orchestra.run.smithi149.stdout:generic/131 1s 2023-06-09T05:38:27.679 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/131 2023-06-09T05:38:27.680 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:38:27.682 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:38:27.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:38:27.934 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-06-09T05:38:28.693 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:38:28.697 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:38:28.698 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:38:28.700 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:38:28.700 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:38:42.718 INFO:teuthology.orchestra.run.smithi149.stdout:generic/132 13s 2023-06-09T05:38:42.723 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/132 2023-06-09T05:38:42.723 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:38:42.725 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:38:42.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:38:42.734 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-06-09T05:38:42.969 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:38:42.973 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:38:42.973 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:38:42.974 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:38:42.975 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:02.932 INFO:teuthology.orchestra.run.smithi149.stdout:generic/133 259s 2023-06-09T05:43:02.951 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/133 2023-06-09T05:43:02.951 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:02.953 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:03.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:03.388 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-06-09T05:43:03.864 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:03.868 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:03.868 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:03.869 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:03.869 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:04.268 INFO:teuthology.orchestra.run.smithi149.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:04.271 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/134 2023-06-09T05:43:04.272 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/134 2023-06-09T05:43:04.272 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:04.274 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:04.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:04.673 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-06-09T05:43:04.909 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:04.914 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:04.914 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:04.915 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:04.915 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:06.092 INFO:teuthology.orchestra.run.smithi149.stdout:generic/135 1s 2023-06-09T05:43:06.097 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/135 2023-06-09T05:43:06.097 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:06.099 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:06.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:06.108 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-06-09T05:43:06.322 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:06.326 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:06.327 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:06.327 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:06.328 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:06.688 INFO:teuthology.orchestra.run.smithi149.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:43:06.691 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/136 2023-06-09T05:43:06.692 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/136 2023-06-09T05:43:06.692 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:06.694 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:06.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:06.864 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-06-09T05:43:07.347 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:07.351 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:07.351 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:07.352 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:07.352 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:07.720 INFO:teuthology.orchestra.run.smithi149.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:07.724 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/137 2023-06-09T05:43:07.724 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/137 2023-06-09T05:43:07.725 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:07.726 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:08.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:08.112 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-06-09T05:43:08.375 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:08.379 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:08.380 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:08.381 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:08.381 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:08.743 INFO:teuthology.orchestra.run.smithi149.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:08.747 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/138 2023-06-09T05:43:08.747 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/138 2023-06-09T05:43:08.748 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:08.749 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:09.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:09.192 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-06-09T05:43:09.406 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:09.410 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:09.411 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:09.412 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:09.412 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:09.777 INFO:teuthology.orchestra.run.smithi149.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:09.781 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/139 2023-06-09T05:43:09.781 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/139 2023-06-09T05:43:09.782 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:09.783 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:09.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:09.929 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-06-09T05:43:10.425 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:10.428 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:10.429 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:10.430 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:10.430 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:10.800 INFO:teuthology.orchestra.run.smithi149.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:10.804 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/140 2023-06-09T05:43:10.805 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/140 2023-06-09T05:43:10.805 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:10.807 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:11.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:11.233 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-06-09T05:43:11.457 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:11.461 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:11.462 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:11.463 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:11.463 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:12.057 INFO:teuthology.orchestra.run.smithi149.stdout:generic/141 1s 2023-06-09T05:43:12.106 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/141 2023-06-09T05:43:12.106 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:12.108 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:12.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:12.116 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-06-09T05:43:12.337 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:12.341 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:12.342 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:12.343 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:12.343 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:12.726 INFO:teuthology.orchestra.run.smithi149.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:12.730 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/142 2023-06-09T05:43:12.730 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/142 2023-06-09T05:43:12.730 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:12.732 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:13.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:13.173 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-06-09T05:43:13.396 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:13.400 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:13.401 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:13.401 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:13.771 INFO:teuthology.orchestra.run.smithi149.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:13.775 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/143 2023-06-09T05:43:13.776 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/143 2023-06-09T05:43:13.776 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:13.778 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:14.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:14.161 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-06-09T05:43:14.423 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:14.427 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:14.428 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:14.429 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:14.429 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:14.787 INFO:teuthology.orchestra.run.smithi149.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:14.790 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/144 2023-06-09T05:43:14.791 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/144 2023-06-09T05:43:14.791 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:14.793 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:15.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:15.137 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-06-09T05:43:15.464 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:15.468 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:15.468 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:15.469 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:15.469 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:15.831 INFO:teuthology.orchestra.run.smithi149.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:15.835 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/145 2023-06-09T05:43:15.835 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/145 2023-06-09T05:43:15.836 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:15.837 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:16.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:16.277 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-06-09T05:43:16.535 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:16.539 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:16.539 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:16.540 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:16.541 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:16.899 INFO:teuthology.orchestra.run.smithi149.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:16.902 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/146 2023-06-09T05:43:16.903 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/146 2023-06-09T05:43:16.903 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:16.904 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:17.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:17.354 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-06-09T05:43:17.574 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:17.578 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:17.578 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:17.579 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:17.579 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:17.943 INFO:teuthology.orchestra.run.smithi149.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:17.947 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/147 2023-06-09T05:43:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/147 2023-06-09T05:43:17.948 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:17.950 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:18.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:18.239 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-06-09T05:43:18.611 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:18.615 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:18.615 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:18.616 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:18.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:18.976 INFO:teuthology.orchestra.run.smithi149.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:18.980 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/148 2023-06-09T05:43:18.981 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/148 2023-06-09T05:43:18.981 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:18.983 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:19.234 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:19.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:19.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:19.280 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-06-09T05:43:19.649 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:19.653 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:19.654 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:19.655 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:19.655 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:20.033 INFO:teuthology.orchestra.run.smithi149.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:20.037 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/149 2023-06-09T05:43:20.037 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/149 2023-06-09T05:43:20.037 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:20.039 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:20.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:20.424 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-06-09T05:43:20.694 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:20.698 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:20.698 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:20.699 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:20.699 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:21.063 INFO:teuthology.orchestra.run.smithi149.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:21.066 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/150 2023-06-09T05:43:21.067 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/150 2023-06-09T05:43:21.067 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:21.069 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:21.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:21.433 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-06-09T05:43:21.727 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:21.732 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:21.732 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:21.733 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:21.733 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:22.099 INFO:teuthology.orchestra.run.smithi149.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:22.103 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/151 2023-06-09T05:43:22.103 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/151 2023-06-09T05:43:22.104 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:22.105 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:22.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:22.327 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-06-09T05:43:22.756 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:22.760 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:22.760 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:22.761 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:22.761 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:23.122 INFO:teuthology.orchestra.run.smithi149.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/152 2023-06-09T05:43:23.125 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/152 2023-06-09T05:43:23.126 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:23.127 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:23.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:23.564 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-06-09T05:43:23.802 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:23.806 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:23.806 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:23.807 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:23.807 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:24.181 INFO:teuthology.orchestra.run.smithi149.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:24.185 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/153 2023-06-09T05:43:24.185 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/153 2023-06-09T05:43:24.185 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:24.187 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:24.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:24.420 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-06-09T05:43:24.834 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:24.838 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:24.838 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:24.839 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:24.839 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:25.200 INFO:teuthology.orchestra.run.smithi149.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:25.204 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/154 2023-06-09T05:43:25.204 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/154 2023-06-09T05:43:25.204 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:25.206 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:25.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:25.617 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-06-09T05:43:25.858 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:25.862 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:25.862 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:25.863 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:25.863 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:26.228 INFO:teuthology.orchestra.run.smithi149.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:26.233 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/155 2023-06-09T05:43:26.233 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/155 2023-06-09T05:43:26.233 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:26.235 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:26.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:26.682 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-06-09T05:43:26.897 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:26.901 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:26.901 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:26.902 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:26.902 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:27.271 INFO:teuthology.orchestra.run.smithi149.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:27.276 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/156 2023-06-09T05:43:27.276 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/156 2023-06-09T05:43:27.276 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:27.278 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:27.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:27.731 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-06-09T05:43:27.951 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:27.955 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:27.956 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:27.957 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:27.957 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:28.318 INFO:teuthology.orchestra.run.smithi149.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:28.322 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/157 2023-06-09T05:43:28.322 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/157 2023-06-09T05:43:28.322 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:28.324 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:28.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:28.734 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-06-09T05:43:28.968 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:28.973 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:28.973 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:28.974 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:28.974 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:29.331 INFO:teuthology.orchestra.run.smithi149.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:43:29.335 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/158 2023-06-09T05:43:29.335 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/158 2023-06-09T05:43:29.335 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:29.337 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:29.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:29.541 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-06-09T05:43:29.993 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:29.997 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:29.998 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:29.998 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:29.999 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:30.372 INFO:teuthology.orchestra.run.smithi149.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-06-09T05:43:30.376 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/159 2023-06-09T05:43:30.377 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/159 2023-06-09T05:43:30.377 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:30.378 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:30.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:30.420 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-06-09T05:43:30.626 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:30.630 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:30.630 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:30.631 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:30.632 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:31.004 INFO:teuthology.orchestra.run.smithi149.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-06-09T05:43:31.008 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/160 2023-06-09T05:43:31.008 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/160 2023-06-09T05:43:31.008 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:31.010 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:31.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:31.045 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-06-09T05:43:31.284 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:31.288 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:31.288 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:31.289 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:31.289 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:32.144 INFO:teuthology.orchestra.run.smithi149.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:32.202 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/161 2023-06-09T05:43:32.202 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/161 2023-06-09T05:43:32.202 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:32.246 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:32.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:32.306 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-06-09T05:43:32.513 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:32.517 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:32.518 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:32.519 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:32.519 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:33.062 INFO:teuthology.orchestra.run.smithi149.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T05:43:33.111 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/162 2023-06-09T05:43:33.112 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/162 2023-06-09T05:43:33.112 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:33.119 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:33.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:33.460 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-06-09T05:43:33.715 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:33.719 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:33.720 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:33.721 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:33.721 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:34.240 INFO:teuthology.orchestra.run.smithi149.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T05:43:34.607 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/163 2023-06-09T05:43:34.607 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/163 2023-06-09T05:43:34.607 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:34.612 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:34.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:34.709 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-06-09T05:43:34.918 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:34.922 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:34.923 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:34.924 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:34.924 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:35.696 INFO:teuthology.orchestra.run.smithi149.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:35.796 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/164 2023-06-09T05:43:35.796 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/164 2023-06-09T05:43:35.797 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:35.800 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:35.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:35.887 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-06-09T05:43:36.109 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:36.116 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:36.116 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:36.116 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:36.116 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:36.728 INFO:teuthology.orchestra.run.smithi149.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:36.736 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/165 2023-06-09T05:43:36.736 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/165 2023-06-09T05:43:36.736 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:36.825 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:37.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:37.011 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-06-09T05:43:37.309 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:37.313 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:37.313 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:37.314 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:37.314 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:38.267 INFO:teuthology.orchestra.run.smithi149.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:38.273 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/166 2023-06-09T05:43:38.273 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/166 2023-06-09T05:43:38.273 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:38.292 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:38.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:38.326 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-06-09T05:43:38.533 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:38.538 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:38.538 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:38.539 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:38.539 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:39.365 INFO:teuthology.orchestra.run.smithi149.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:39.388 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/167 2023-06-09T05:43:39.388 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/167 2023-06-09T05:43:39.388 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:39.415 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:39.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:39.534 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-06-09T05:43:39.773 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:39.777 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:39.778 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:39.779 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:39.779 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:40.610 INFO:teuthology.orchestra.run.smithi149.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:40.738 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/168 2023-06-09T05:43:40.738 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/168 2023-06-09T05:43:40.738 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:40.754 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:40.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:40.782 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-06-09T05:43:40.990 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:40.994 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:40.995 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:40.996 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:40.996 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:41.792 INFO:teuthology.orchestra.run.smithi149.stdout:generic/169 0s 2023-06-09T05:43:41.797 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/169 2023-06-09T05:43:41.797 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:41.799 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:41.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:41.807 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-06-09T05:43:42.022 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:42.026 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:42.026 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:42.027 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:42.028 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:43.010 INFO:teuthology.orchestra.run.smithi149.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/170 2023-06-09T05:43:43.040 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/170 2023-06-09T05:43:43.041 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:43.043 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:43.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:43.065 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-06-09T05:43:43.270 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:43.274 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:43.275 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:43.276 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:43.276 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:44.198 INFO:teuthology.orchestra.run.smithi149.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:44.238 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/171 2023-06-09T05:43:44.238 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/171 2023-06-09T05:43:44.238 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:44.299 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:44.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:44.328 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-06-09T05:43:44.533 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:44.537 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:44.538 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:44.539 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:44.539 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:45.518 INFO:teuthology.orchestra.run.smithi149.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:45.529 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/172 2023-06-09T05:43:45.530 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/172 2023-06-09T05:43:45.530 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:45.544 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:45.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:45.572 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-06-09T05:43:45.777 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:45.781 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:45.781 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:45.782 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:45.782 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:46.674 INFO:teuthology.orchestra.run.smithi149.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:46.723 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/173 2023-06-09T05:43:46.723 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/173 2023-06-09T05:43:46.723 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:46.746 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:46.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:46.794 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-06-09T05:43:47.003 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:47.007 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:47.008 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:47.009 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:47.009 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:47.974 INFO:teuthology.orchestra.run.smithi149.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:48.010 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/174 2023-06-09T05:43:48.010 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/174 2023-06-09T05:43:48.010 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:48.013 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:48.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:48.039 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-06-09T05:43:48.268 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:48.272 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:48.273 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:48.274 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:48.274 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:48.985 INFO:teuthology.orchestra.run.smithi149.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:49.235 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/175 2023-06-09T05:43:49.235 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/175 2023-06-09T05:43:49.236 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:49.252 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:49.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:49.288 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-06-09T05:43:49.470 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:49.472 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:49.494 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:49.498 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:49.499 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:49.500 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:49.500 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:50.202 INFO:teuthology.orchestra.run.smithi149.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:50.209 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/176 2023-06-09T05:43:50.209 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/176 2023-06-09T05:43:50.209 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:50.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:50.373 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-06-09T05:43:50.716 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:50.720 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:50.720 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:50.721 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:50.721 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:51.223 INFO:teuthology.orchestra.run.smithi149.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T05:43:51.227 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/177 2023-06-09T05:43:51.228 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/177 2023-06-09T05:43:51.228 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:51.230 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:51.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:51.518 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-06-09T05:43:51.865 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:51.869 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:51.870 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:51.871 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:51.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:52.244 INFO:teuthology.orchestra.run.smithi149.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:52.248 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/178 2023-06-09T05:43:52.248 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/178 2023-06-09T05:43:52.248 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:52.250 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:52.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:52.634 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-06-09T05:43:52.917 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:52.921 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:52.922 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:52.923 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:52.923 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:53.313 INFO:teuthology.orchestra.run.smithi149.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:53.317 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/179 2023-06-09T05:43:53.317 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/179 2023-06-09T05:43:53.317 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:53.319 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:53.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:53.684 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-06-09T05:43:53.973 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:53.977 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:53.978 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:53.979 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:53.979 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:54.347 INFO:teuthology.orchestra.run.smithi149.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:54.351 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/180 2023-06-09T05:43:54.352 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/180 2023-06-09T05:43:54.352 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:54.354 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:54.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:54.763 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-06-09T05:43:55.012 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:55.016 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:55.016 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:55.017 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:55.017 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:55.379 INFO:teuthology.orchestra.run.smithi149.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:43:55.383 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/181 2023-06-09T05:43:55.383 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/181 2023-06-09T05:43:55.384 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:55.385 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:55.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:55.817 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-06-09T05:43:56.034 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:56.038 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:56.039 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:56.040 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:56.040 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:56.425 INFO:teuthology.orchestra.run.smithi149.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:43:56.429 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/182 2023-06-09T05:43:56.430 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/182 2023-06-09T05:43:56.430 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:56.432 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:56.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:56.796 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-06-09T05:43:57.087 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:57.091 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:57.092 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:57.093 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:57.093 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:58.052 INFO:teuthology.orchestra.run.smithi149.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:58.060 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/183 2023-06-09T05:43:58.060 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/183 2023-06-09T05:43:58.060 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:58.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:58.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:58.105 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-06-09T05:43:58.340 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:58.344 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:58.344 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:58.345 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:58.345 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:58.724 INFO:teuthology.orchestra.run.smithi149.stdout:generic/184 0s 2023-06-09T05:43:58.729 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/184 2023-06-09T05:43:58.729 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:58.731 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:58.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:58.763 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-06-09T05:43:58.984 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:43:58.989 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:43:58.989 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:43:58.990 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:43:58.990 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:59.721 INFO:teuthology.orchestra.run.smithi149.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:43:59.859 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/185 2023-06-09T05:43:59.859 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/185 2023-06-09T05:43:59.860 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:43:59.863 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:43:59.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:43:59.952 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-06-09T05:44:00.198 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:00.202 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:00.203 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:00.204 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:00.204 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:01.034 INFO:teuthology.orchestra.run.smithi149.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/186 2023-06-09T05:44:01.047 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/186 2023-06-09T05:44:01.048 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:01.135 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:01.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:01.197 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-06-09T05:44:01.406 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:01.410 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:01.411 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:01.412 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:02.309 INFO:teuthology.orchestra.run.smithi149.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:02.353 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/187 2023-06-09T05:44:02.354 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/187 2023-06-09T05:44:02.354 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:02.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:02.407 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-06-09T05:44:02.614 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:02.618 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:02.619 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:02.620 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:02.620 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:03.499 INFO:teuthology.orchestra.run.smithi149.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:03.571 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/188 2023-06-09T05:44:03.572 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/188 2023-06-09T05:44:03.572 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:03.583 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:03.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:03.613 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-06-09T05:44:03.817 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:03.821 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:03.822 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:03.823 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:03.823 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:04.733 INFO:teuthology.orchestra.run.smithi149.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:04.789 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/189 2023-06-09T05:44:04.789 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/189 2023-06-09T05:44:04.789 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:04.798 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:04.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:04.829 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-06-09T05:44:05.037 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:05.041 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:05.041 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:05.042 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:05.042 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:06.024 INFO:teuthology.orchestra.run.smithi149.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:06.046 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/190 2023-06-09T05:44:06.046 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/190 2023-06-09T05:44:06.047 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:06.049 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:06.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:06.079 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-06-09T05:44:06.315 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:06.319 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:06.320 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:06.321 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:06.321 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:07.275 INFO:teuthology.orchestra.run.smithi149.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:07.313 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/191 2023-06-09T05:44:07.313 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/191 2023-06-09T05:44:07.313 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:07.320 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:07.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:07.347 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-06-09T05:44:07.562 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:07.566 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:07.567 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:07.568 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:07.568 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:07.902 INFO:teuthology.orchestra.run.smithi149.stdout:generic/192 [not run] atime not maintained by ceph 2023-06-09T05:44:07.906 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/192 2023-06-09T05:44:07.906 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/192 2023-06-09T05:44:07.906 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:07.908 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:07.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:07.941 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-06-09T05:44:08.149 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:08.153 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:08.153 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:08.154 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:08.154 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:09.045 INFO:teuthology.orchestra.run.smithi149.stdout:generic/193 1s 2023-06-09T05:44:09.050 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/193 2023-06-09T05:44:09.050 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:09.052 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:09.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:09.339 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-06-09T05:44:09.704 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:09.708 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:09.709 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:09.710 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:09.710 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:10.668 INFO:teuthology.orchestra.run.smithi149.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:10.680 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/194 2023-06-09T05:44:10.681 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/194 2023-06-09T05:44:10.681 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:10.685 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:10.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:10.720 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-06-09T05:44:10.954 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:10.958 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:10.958 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:10.959 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:10.959 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:11.640 INFO:teuthology.orchestra.run.smithi149.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:11.853 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/195 2023-06-09T05:44:11.853 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/195 2023-06-09T05:44:11.853 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:11.873 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:11.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:11.956 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-06-09T05:44:12.164 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:12.168 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:12.169 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:12.170 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:12.170 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:12.872 INFO:teuthology.orchestra.run.smithi149.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:12.879 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/196 2023-06-09T05:44:12.879 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/196 2023-06-09T05:44:12.879 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:12.990 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:13.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:13.173 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-06-09T05:44:13.398 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:13.402 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:13.402 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:13.403 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:13.403 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:14.204 INFO:teuthology.orchestra.run.smithi149.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:14.321 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/197 2023-06-09T05:44:14.321 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/197 2023-06-09T05:44:14.322 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:14.326 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:14.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:14.381 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-06-09T05:44:14.590 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:14.594 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:14.595 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:14.595 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:14.596 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:15.330 INFO:teuthology.orchestra.run.smithi149.stdout:generic/198 1s 2023-06-09T05:44:15.335 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/198 2023-06-09T05:44:15.336 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:15.337 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:15.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:15.711 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-06-09T05:44:15.997 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:16.001 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:16.001 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:16.003 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:16.003 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:16.646 INFO:teuthology.orchestra.run.smithi149.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:16.652 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/199 2023-06-09T05:44:16.652 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/199 2023-06-09T05:44:16.652 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:16.913 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:17.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:17.037 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-06-09T05:44:17.244 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:17.248 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:17.248 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:17.249 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:17.249 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:18.046 INFO:teuthology.orchestra.run.smithi149.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:18.125 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/200 2023-06-09T05:44:18.125 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/200 2023-06-09T05:44:18.125 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:18.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:18.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:18.204 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-06-09T05:44:18.450 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:18.454 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:18.454 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:18.455 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:18.455 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:19.413 INFO:teuthology.orchestra.run.smithi149.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:19.447 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/201 2023-06-09T05:44:19.447 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/201 2023-06-09T05:44:19.447 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:19.451 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:19.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:19.487 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-06-09T05:44:19.591 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:19.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:19.696 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:19.700 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:19.701 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:19.702 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:19.702 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:20.611 INFO:teuthology.orchestra.run.smithi149.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:20.622 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/202 2023-06-09T05:44:20.622 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/202 2023-06-09T05:44:20.622 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:20.633 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:20.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:20.685 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-06-09T05:44:20.894 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:20.898 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:20.899 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:20.900 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:20.900 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:21.711 INFO:teuthology.orchestra.run.smithi149.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:21.745 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/203 2023-06-09T05:44:21.745 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/203 2023-06-09T05:44:21.745 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:21.750 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:21.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:21.856 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-06-09T05:44:22.064 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:22.068 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:22.069 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:22.070 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:22.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:23.023 INFO:teuthology.orchestra.run.smithi149.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:44:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/204 2023-06-09T05:44:23.028 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/204 2023-06-09T05:44:23.029 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:23.031 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:23.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:23.059 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-06-09T05:44:23.302 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:23.306 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:23.307 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:23.307 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:23.308 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:24.134 INFO:teuthology.orchestra.run.smithi149.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:24.255 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/205 2023-06-09T05:44:24.256 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/205 2023-06-09T05:44:24.256 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:24.265 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:24.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:24.302 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-06-09T05:44:24.509 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:24.513 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:24.514 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:24.515 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:24.515 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:25.330 INFO:teuthology.orchestra.run.smithi149.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:44:25.359 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/206 2023-06-09T05:44:25.359 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/206 2023-06-09T05:44:25.360 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:25.371 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:25.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:25.475 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-06-09T05:44:25.688 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:25.692 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:25.692 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:25.693 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:25.693 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:34.605 INFO:teuthology.orchestra.run.smithi149.stdout:generic/207 9s 2023-06-09T05:44:34.610 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/207 2023-06-09T05:44:34.610 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:44:34.612 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:35.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:44:35.045 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-06-09T05:44:35.269 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:44:35.273 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:44:35.274 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:44:35.275 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:44:35.275 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:44:49.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:49.689 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:19.831 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:19.835 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:50.129 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:45:50.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:20.227 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:20.230 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:50.341 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:46:50.343 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:20.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:20.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:50.534 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:50.541 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:47:55.820 INFO:teuthology.orchestra.run.smithi149.stdout:generic/208 200s 2023-06-09T05:47:55.825 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/208 2023-06-09T05:47:55.825 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:47:55.827 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:47:56.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:47:56.242 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-06-09T05:47:56.483 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:47:56.487 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:47:56.487 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:47:56.488 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:47:56.489 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:20.681 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:20.684 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:27.105 INFO:teuthology.orchestra.run.smithi149.stdout:generic/209 31s 2023-06-09T05:48:27.110 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/209 2023-06-09T05:48:27.110 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:27.113 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:27.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:27.250 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-06-09T05:48:27.741 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:27.745 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:27.745 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:27.746 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:27.746 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:28.189 INFO:teuthology.orchestra.run.smithi149.stdout:generic/210 1s 2023-06-09T05:48:28.194 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/210 2023-06-09T05:48:28.194 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:28.196 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:28.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:28.611 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-06-09T05:48:28.856 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:28.860 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:28.861 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:28.862 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:28.862 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:29.383 INFO:teuthology.orchestra.run.smithi149.stdout:generic/211 0s 2023-06-09T05:48:29.388 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/211 2023-06-09T05:48:29.388 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:29.390 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:29.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:29.428 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-06-09T05:48:29.633 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:29.637 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:29.638 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:29.638 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:29.639 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:30.072 INFO:teuthology.orchestra.run.smithi149.stdout:generic/212 1s 2023-06-09T05:48:30.077 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/212 2023-06-09T05:48:30.077 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:30.079 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:30.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:30.118 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-06-09T05:48:30.329 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:30.334 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:30.334 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:30.335 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:30.335 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:30.705 INFO:teuthology.orchestra.run.smithi149.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:48:30.709 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/213 2023-06-09T05:48:30.709 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/213 2023-06-09T05:48:30.709 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:30.711 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:30.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:30.744 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-06-09T05:48:30.949 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:30.953 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:30.953 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:30.954 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:30.955 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:31.321 INFO:teuthology.orchestra.run.smithi149.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:48:31.324 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/214 2023-06-09T05:48:31.325 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/214 2023-06-09T05:48:31.325 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:31.327 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:31.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:31.352 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-06-09T05:48:31.591 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:31.594 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:31.595 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:31.596 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:34.093 INFO:teuthology.orchestra.run.smithi149.stdout:generic/215 3s 2023-06-09T05:48:34.098 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/215 2023-06-09T05:48:34.099 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:34.101 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:34.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:34.152 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-06-09T05:48:34.370 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:34.374 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:34.374 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:34.375 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:34.375 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:35.230 INFO:teuthology.orchestra.run.smithi149.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:35.356 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/216 2023-06-09T05:48:35.356 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/216 2023-06-09T05:48:35.356 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:35.375 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:35.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:35.406 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-06-09T05:48:35.612 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:35.616 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:35.617 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:35.618 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:35.618 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:36.570 INFO:teuthology.orchestra.run.smithi149.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:36.586 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/217 2023-06-09T05:48:36.586 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/217 2023-06-09T05:48:36.587 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:36.593 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:36.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:36.621 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-06-09T05:48:36.826 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:36.830 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:36.831 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:36.832 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:36.832 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:37.626 INFO:teuthology.orchestra.run.smithi149.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:37.772 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/218 2023-06-09T05:48:37.772 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/218 2023-06-09T05:48:37.772 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:37.806 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:37.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:37.837 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-06-09T05:48:38.051 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:38.055 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:38.056 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:38.057 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:38.057 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:38.413 INFO:teuthology.orchestra.run.smithi149.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:48:38.417 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/219 2023-06-09T05:48:38.417 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/219 2023-06-09T05:48:38.418 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:38.420 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:38.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:38.446 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-06-09T05:48:38.664 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:38.668 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:38.669 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:38.670 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:38.670 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:39.627 INFO:teuthology.orchestra.run.smithi149.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:39.643 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/220 2023-06-09T05:48:39.643 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/220 2023-06-09T05:48:39.643 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:39.647 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:39.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:39.678 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-06-09T05:48:39.896 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:39.900 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:39.901 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:39.902 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:39.902 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:41.281 INFO:teuthology.orchestra.run.smithi149.stdout:generic/221 1s 2023-06-09T05:48:41.286 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/221 2023-06-09T05:48:41.287 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:41.289 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:41.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:41.327 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-06-09T05:48:41.535 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:41.539 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:41.540 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:41.540 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:42.154 INFO:teuthology.orchestra.run.smithi149.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:42.183 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/222 2023-06-09T05:48:42.183 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/222 2023-06-09T05:48:42.183 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:42.309 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:42.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:42.473 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-06-09T05:48:42.705 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:42.709 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:42.709 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:42.710 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:42.710 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:43.055 INFO:teuthology.orchestra.run.smithi149.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:48:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/223 2023-06-09T05:48:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/223 2023-06-09T05:48:43.059 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:43.061 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:43.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:43.090 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-06-09T05:48:43.303 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:43.307 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:43.307 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:43.308 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:43.308 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:43.641 INFO:teuthology.orchestra.run.smithi149.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:48:43.645 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/224 2023-06-09T05:48:43.645 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/224 2023-06-09T05:48:43.645 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:43.648 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:43.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:43.673 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-06-09T05:48:43.886 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:43.890 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:43.890 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:43.891 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:43.891 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:44.291 INFO:teuthology.orchestra.run.smithi149.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T05:48:44.295 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/225 2023-06-09T05:48:44.295 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/225 2023-06-09T05:48:44.295 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:44.297 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:44.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:44.598 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-06-09T05:48:44.961 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:44.965 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:44.966 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:44.966 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:44.966 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:45.352 INFO:teuthology.orchestra.run.smithi149.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:48:45.356 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/226 2023-06-09T05:48:45.356 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/226 2023-06-09T05:48:45.356 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:45.358 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:45.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:45.391 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-06-09T05:48:45.607 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:45.611 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:45.612 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:45.612 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:45.613 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/227 2023-06-09T05:48:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/227 2023-06-09T05:48:46.467 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:46.570 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:46.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:46.599 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-06-09T05:48:46.807 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:46.811 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:46.811 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:46.812 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:46.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:47.186 INFO:teuthology.orchestra.run.smithi149.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:48:47.190 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/228 2023-06-09T05:48:47.190 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/228 2023-06-09T05:48:47.190 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:47.192 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:47.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:47.218 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-06-09T05:48:47.423 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:47.427 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:47.427 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:47.428 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:47.428 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:48.349 INFO:teuthology.orchestra.run.smithi149.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:48.375 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/229 2023-06-09T05:48:48.375 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/229 2023-06-09T05:48:48.375 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:48.389 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:48.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:48.421 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-06-09T05:48:48.631 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:48.635 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:48.635 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:48.636 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:48.636 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:49.003 INFO:teuthology.orchestra.run.smithi149.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:48:49.007 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/230 2023-06-09T05:48:49.007 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/230 2023-06-09T05:48:49.008 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:49.009 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:49.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:49.038 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-06-09T05:48:49.246 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:49.250 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:49.250 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:49.251 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:49.252 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:49.585 INFO:teuthology.orchestra.run.smithi149.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:48:49.589 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/231 2023-06-09T05:48:49.589 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/231 2023-06-09T05:48:49.589 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:49.591 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:49.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:49.627 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-06-09T05:48:49.840 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:49.844 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:49.844 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:49.845 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:49.845 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:50.182 INFO:teuthology.orchestra.run.smithi149.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:48:50.186 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/232 2023-06-09T05:48:50.186 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/232 2023-06-09T05:48:50.186 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:50.188 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:50.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:50.214 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-06-09T05:48:50.433 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:50.437 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:50.437 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:50.438 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:50.438 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:50.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:50.786 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:48:50.794 INFO:teuthology.orchestra.run.smithi149.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:48:50.798 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/233 2023-06-09T05:48:50.799 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/233 2023-06-09T05:48:50.799 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:50.801 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:50.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:50.827 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-06-09T05:48:51.086 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:51.090 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:51.090 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:51.091 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:51.091 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:51.427 INFO:teuthology.orchestra.run.smithi149.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:48:51.431 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/234 2023-06-09T05:48:51.431 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/234 2023-06-09T05:48:51.432 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:51.434 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:51.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:51.468 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-06-09T05:48:51.683 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:51.687 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:51.688 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:51.688 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:52.038 INFO:teuthology.orchestra.run.smithi149.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:48:52.042 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/235 2023-06-09T05:48:52.042 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/235 2023-06-09T05:48:52.042 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:52.044 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:52.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:52.067 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-06-09T05:48:52.272 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:52.276 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:52.277 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:52.278 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:52.278 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:generic/236 1s 2023-06-09T05:48:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/236 2023-06-09T05:48:53.700 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:53.702 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:54.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:54.111 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-06-09T05:48:54.357 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:54.361 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:54.361 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:54.362 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:54.362 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:54.959 INFO:teuthology.orchestra.run.smithi149.stdout:generic/237 0s 2023-06-09T05:48:54.966 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/237 2023-06-09T05:48:54.966 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:54.968 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:55.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:55.383 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-06-09T05:48:55.610 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:55.614 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:55.615 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:55.616 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:55.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:56.502 INFO:teuthology.orchestra.run.smithi149.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:48:56.534 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/238 2023-06-09T05:48:56.534 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/238 2023-06-09T05:48:56.534 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:48:56.539 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:48:56.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:48:56.576 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-06-09T05:48:56.812 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:48:56.816 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:48:56.817 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:48:56.818 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:48:56.818 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:49:20.892 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:20.959 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:51.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:51.711 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:22.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:22.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:53.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:53.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:50:57.328 INFO:teuthology.orchestra.run.smithi149.stdout:generic/239 120s 2023-06-09T05:50:57.339 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/239 2023-06-09T05:50:57.339 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:50:57.341 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:50:57.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:50:57.622 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-06-09T05:50:58.007 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:50:58.011 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:50:58.011 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:50:58.012 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:50:58.012 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:50:58.831 INFO:teuthology.orchestra.run.smithi149.stdout:generic/240 0s 2023-06-09T05:50:58.877 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/240 2023-06-09T05:50:58.877 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:50:58.879 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:50:59.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:50:59.287 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-06-09T05:50:59.533 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:50:59.537 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:50:59.537 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:50:59.538 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:50:59.539 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:51:23.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:23.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:51:23.407 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T05:51:23.405+0000 7f46ca054700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114645) UID: 0 2023-06-09T05:51:23.407 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T05:51:23.405+0000 7fd1388f4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114645) UID: 0 2023-06-09T05:52:12.909 INFO:teuthology.orchestra.run.smithi149.stdout:generic/241 73s 2023-06-09T05:52:12.913 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/241 2023-06-09T05:52:12.913 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:12.915 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:14.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:14.273 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-06-09T05:52:15.121 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:15.138 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:15.138 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:15.139 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:15.139 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:16.059 INFO:teuthology.orchestra.run.smithi149.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:52:16.066 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/242 2023-06-09T05:52:16.066 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/242 2023-06-09T05:52:16.066 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:16.070 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:16.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:16.235 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-06-09T05:52:16.454 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:16.458 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:16.458 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:16.459 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:16.459 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:17.361 INFO:teuthology.orchestra.run.smithi149.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:52:17.471 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/243 2023-06-09T05:52:17.471 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/243 2023-06-09T05:52:17.472 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:17.517 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:17.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:17.547 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-06-09T05:52:17.791 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:17.795 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:17.796 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:17.797 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:17.797 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:18.252 INFO:teuthology.orchestra.run.smithi149.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:52:18.256 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/244 2023-06-09T05:52:18.256 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/244 2023-06-09T05:52:18.257 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:18.259 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:18.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:18.295 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-06-09T05:52:18.506 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:18.510 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:18.511 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:18.511 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:18.511 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:18.921 INFO:teuthology.orchestra.run.smithi149.stdout:generic/245 0s 2023-06-09T05:52:18.926 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/245 2023-06-09T05:52:18.926 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:18.928 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:19.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:19.016 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-06-09T05:52:19.616 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:19.620 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:19.621 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:19.621 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:19.622 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:20.022 INFO:teuthology.orchestra.run.smithi149.stdout:generic/246 1s 2023-06-09T05:52:20.027 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/246 2023-06-09T05:52:20.027 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:20.029 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:20.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:20.287 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-06-09T05:52:20.667 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:20.671 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:20.671 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:20.672 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:20.672 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:26.173 INFO:teuthology.orchestra.run.smithi149.stdout:generic/247 6s 2023-06-09T05:52:26.178 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/247 2023-06-09T05:52:26.178 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:26.180 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:26.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:26.189 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-06-09T05:52:26.402 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:26.406 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:26.406 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:26.407 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:26.407 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:26.798 INFO:teuthology.orchestra.run.smithi149.stdout:generic/248 0s 2023-06-09T05:52:26.803 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/248 2023-06-09T05:52:26.803 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:26.805 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:26.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:26.841 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-06-09T05:52:27.046 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:27.050 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:27.050 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:27.051 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:27.051 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:27.614 INFO:teuthology.orchestra.run.smithi149.stdout:generic/249 0s 2023-06-09T05:52:27.619 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/249 2023-06-09T05:52:27.619 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:27.621 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:28.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:28.062 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-06-09T05:52:28.287 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:28.299 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:28.303 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:28.305 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:28.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:28.690 INFO:teuthology.orchestra.run.smithi149.stdout:generic/250 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:52:28.694 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/250 2023-06-09T05:52:28.695 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/250 2023-06-09T05:52:28.695 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:28.697 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:28.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:28.730 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-06-09T05:52:28.935 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:28.939 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:28.939 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:28.940 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:28.940 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:29.460 INFO:teuthology.orchestra.run.smithi149.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:29.479 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/251 2023-06-09T05:52:29.479 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/251 2023-06-09T05:52:29.479 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:29.481 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:29.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:29.509 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-06-09T05:52:29.738 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:29.742 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:29.742 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:29.743 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:29.743 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:30.097 INFO:teuthology.orchestra.run.smithi149.stdout:generic/252 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:52:30.101 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/252 2023-06-09T05:52:30.101 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/252 2023-06-09T05:52:30.101 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:30.103 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:30.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:30.135 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-06-09T05:52:30.355 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:30.358 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:30.359 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:30.360 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:30.360 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:31.297 INFO:teuthology.orchestra.run.smithi149.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:52:31.308 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/253 2023-06-09T05:52:31.309 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/253 2023-06-09T05:52:31.309 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:31.312 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:31.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:31.342 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-06-09T05:52:31.575 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:31.579 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:31.580 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:31.580 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:31.581 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:32.341 INFO:teuthology.orchestra.run.smithi149.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:52:32.455 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/254 2023-06-09T05:52:32.456 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/254 2023-06-09T05:52:32.456 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:32.484 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:32.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:32.552 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-06-09T05:52:32.787 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:32.791 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:32.791 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:32.792 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:32.792 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:33.226 INFO:teuthology.orchestra.run.smithi149.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:52:33.230 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/255 2023-06-09T05:52:33.230 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/255 2023-06-09T05:52:33.230 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:33.232 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:33.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:33.499 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-06-09T05:52:33.890 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:33.894 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:33.894 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:33.895 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:33.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:34.516 INFO:teuthology.orchestra.run.smithi149.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:52:34.520 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/256 2023-06-09T05:52:34.520 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/256 2023-06-09T05:52:34.520 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:34.522 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:34.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:34.550 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-06-09T05:52:34.758 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:34.762 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:34.762 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:34.763 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:34.763 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:35.721 INFO:teuthology.orchestra.run.smithi149.stdout:generic/257 1s 2023-06-09T05:52:35.726 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/257 2023-06-09T05:52:35.726 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:35.728 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:36.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:36.225 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-06-09T05:52:36.573 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:36.577 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:36.577 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:36.578 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:36.578 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:36.908 INFO:teuthology.orchestra.run.smithi149.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-06-09T05:52:36.912 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/258 2023-06-09T05:52:36.912 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/258 2023-06-09T05:52:36.912 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:36.914 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:36.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:36.944 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-06-09T05:52:37.149 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:37.153 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:37.154 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:37.155 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:37.155 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:37.954 INFO:teuthology.orchestra.run.smithi149.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:52:38.021 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/259 2023-06-09T05:52:38.022 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/259 2023-06-09T05:52:38.022 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:38.090 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:38.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:38.120 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-06-09T05:52:38.344 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:38.348 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:38.349 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:38.350 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:38.350 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:38.902 INFO:teuthology.orchestra.run.smithi149.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:38.922 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/260 2023-06-09T05:52:38.922 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/260 2023-06-09T05:52:38.922 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:38.925 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:38.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:38.950 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-06-09T05:52:39.154 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:39.158 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:39.159 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:39.159 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:39.877 INFO:teuthology.orchestra.run.smithi149.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:52:39.884 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/261 2023-06-09T05:52:39.884 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/261 2023-06-09T05:52:39.884 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:39.944 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:40.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:40.115 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-06-09T05:52:40.330 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:40.334 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:40.335 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:40.336 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:40.336 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:41.250 INFO:teuthology.orchestra.run.smithi149.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:52:41.270 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/262 2023-06-09T05:52:41.271 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/262 2023-06-09T05:52:41.271 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:52:41.320 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:52:41.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:52:41.346 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-06-09T05:52:41.553 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:52:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:52:41.557 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:52:41.558 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:52:41.558 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:26.354 INFO:teuthology.orchestra.run.smithi149.stdout:generic/263 45s 2023-06-09T05:53:26.359 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/263 2023-06-09T05:53:26.359 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:26.361 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:26.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:26.769 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-06-09T05:53:27.015 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:27.019 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:27.019 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:27.020 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:27.020 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:27.853 INFO:teuthology.orchestra.run.smithi149.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:27.883 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/264 2023-06-09T05:53:27.883 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/264 2023-06-09T05:53:27.883 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:28.000 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:28.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:28.026 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-06-09T05:53:28.231 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:28.236 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:28.236 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:28.237 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:28.237 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:29.083 INFO:teuthology.orchestra.run.smithi149.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:29.203 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/265 2023-06-09T05:53:29.203 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/265 2023-06-09T05:53:29.203 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:29.211 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:29.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:29.245 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-06-09T05:53:29.451 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:29.455 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:29.456 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:29.457 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:29.457 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:30.384 INFO:teuthology.orchestra.run.smithi149.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:30.417 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/266 2023-06-09T05:53:30.417 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/266 2023-06-09T05:53:30.417 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:30.438 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:30.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:30.465 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-06-09T05:53:30.672 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:30.676 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:30.677 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:30.678 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:30.678 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:31.596 INFO:teuthology.orchestra.run.smithi149.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:31.602 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/267 2023-06-09T05:53:31.602 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/267 2023-06-09T05:53:31.602 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:31.605 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:31.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:31.693 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-06-09T05:53:31.930 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:31.934 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:31.934 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:31.935 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:31.935 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:32.810 INFO:teuthology.orchestra.run.smithi149.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:32.863 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/268 2023-06-09T05:53:32.863 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/268 2023-06-09T05:53:32.863 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:32.895 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:32.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:32.921 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-06-09T05:53:33.125 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:33.129 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:33.130 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:33.131 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:33.131 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:33.468 INFO:teuthology.orchestra.run.smithi149.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:53:33.472 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/269 2023-06-09T05:53:33.473 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/269 2023-06-09T05:53:33.473 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:33.475 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:33.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:33.509 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-06-09T05:53:33.712 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:33.716 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:33.717 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:33.718 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:33.718 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:34.121 INFO:teuthology.orchestra.run.smithi149.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:53:34.125 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/270 2023-06-09T05:53:34.125 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/270 2023-06-09T05:53:34.125 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:34.127 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:34.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:34.155 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-06-09T05:53:34.378 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:34.382 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:34.382 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:34.383 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:34.383 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:35.132 INFO:teuthology.orchestra.run.smithi149.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:35.148 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/271 2023-06-09T05:53:35.149 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/271 2023-06-09T05:53:35.149 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:35.286 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:35.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:35.349 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-06-09T05:53:35.556 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:35.560 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:35.561 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:35.562 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:35.562 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:36.357 INFO:teuthology.orchestra.run.smithi149.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:36.365 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/272 2023-06-09T05:53:36.365 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/272 2023-06-09T05:53:36.365 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:36.431 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:36.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:36.545 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-06-09T05:53:36.756 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:36.760 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:36.761 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:36.762 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:36.762 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:37.095 INFO:teuthology.orchestra.run.smithi149.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:53:37.099 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/273 2023-06-09T05:53:37.099 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/273 2023-06-09T05:53:37.099 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:37.101 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:37.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:37.137 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-06-09T05:53:37.352 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:37.356 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:37.357 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:37.357 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:37.358 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:37.699 INFO:teuthology.orchestra.run.smithi149.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T05:53:37.703 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/274 2023-06-09T05:53:37.703 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/274 2023-06-09T05:53:37.703 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:37.705 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:37.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:37.738 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-06-09T05:53:37.951 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:37.955 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:37.955 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:37.956 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:37.957 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:38.295 INFO:teuthology.orchestra.run.smithi149.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:53:38.299 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/275 2023-06-09T05:53:38.299 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/275 2023-06-09T05:53:38.300 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:38.301 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:38.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:38.338 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-06-09T05:53:38.547 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:38.551 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:38.552 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:38.553 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:38.553 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:39.452 INFO:teuthology.orchestra.run.smithi149.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:39.486 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/276 2023-06-09T05:53:39.486 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/276 2023-06-09T05:53:39.486 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:39.511 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:39.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:39.551 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-06-09T05:53:39.763 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:39.767 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:39.767 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:39.768 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:39.768 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:40.144 INFO:teuthology.orchestra.run.smithi149.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-06-09T05:53:40.148 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/277 2023-06-09T05:53:40.149 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/277 2023-06-09T05:53:40.149 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:40.151 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:40.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:40.195 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-06-09T05:53:40.406 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:40.410 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:40.411 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:40.412 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:40.412 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:41.265 INFO:teuthology.orchestra.run.smithi149.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:41.320 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/278 2023-06-09T05:53:41.320 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/278 2023-06-09T05:53:41.320 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:41.334 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:41.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:41.403 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-06-09T05:53:41.618 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:41.622 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:41.623 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:41.624 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:41.624 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:42.427 INFO:teuthology.orchestra.run.smithi149.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:42.433 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/279 2023-06-09T05:53:42.433 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/279 2023-06-09T05:53:42.433 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:42.552 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:42.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:42.616 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-06-09T05:53:42.831 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:42.835 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:42.835 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:42.836 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:42.837 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:43.197 INFO:teuthology.orchestra.run.smithi149.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:53:43.201 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/280 2023-06-09T05:53:43.201 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/280 2023-06-09T05:53:43.201 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:43.203 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:43.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:43.226 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-06-09T05:53:43.433 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:43.437 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:43.437 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:43.438 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:43.438 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:44.185 INFO:teuthology.orchestra.run.smithi149.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:44.191 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/281 2023-06-09T05:53:44.192 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/281 2023-06-09T05:53:44.192 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:44.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:44.383 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-06-09T05:53:44.599 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:44.603 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:44.603 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:44.604 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:44.604 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:45.516 INFO:teuthology.orchestra.run.smithi149.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:45.532 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/282 2023-06-09T05:53:45.532 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/282 2023-06-09T05:53:45.532 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:45.556 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:45.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:45.589 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-06-09T05:53:45.803 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:45.807 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:45.808 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:45.808 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:45.809 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:46.684 INFO:teuthology.orchestra.run.smithi149.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:46.762 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/283 2023-06-09T05:53:46.763 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/283 2023-06-09T05:53:46.763 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:46.769 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:46.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:46.802 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-06-09T05:53:47.016 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:47.020 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:47.020 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:47.021 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:47.021 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:47.917 INFO:teuthology.orchestra.run.smithi149.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:47.963 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/284 2023-06-09T05:53:47.963 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/284 2023-06-09T05:53:47.963 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:47.973 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:48.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:48.004 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-06-09T05:53:48.212 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:48.216 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:48.217 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:48.218 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:48.218 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:49.653 INFO:teuthology.orchestra.run.smithi149.stdout:generic/285 1s 2023-06-09T05:53:49.658 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/285 2023-06-09T05:53:49.658 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:49.660 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:50.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:50.476 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-06-09T05:53:50.795 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:50.804 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:50.804 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:50.808 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:50.808 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:51.348 INFO:teuthology.orchestra.run.smithi149.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:53:51.353 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/286 2023-06-09T05:53:51.353 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/286 2023-06-09T05:53:51.353 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:51.356 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:51.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:51.405 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-06-09T05:53:51.799 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:51.809 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:51.811 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:51.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:53.051 INFO:teuthology.orchestra.run.smithi149.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:53.071 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/287 2023-06-09T05:53:53.071 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/287 2023-06-09T05:53:53.072 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:53.084 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:53.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:53.111 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-06-09T05:53:53.446 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:53.456 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:53.457 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:53.458 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:53.458 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:54.217 INFO:teuthology.orchestra.run.smithi149.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/288 2023-06-09T05:53:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/288 2023-06-09T05:53:54.242 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:54.244 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:54.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:54.272 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-06-09T05:53:54.637 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:54.647 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:54.649 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:54.650 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:54.650 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:55.698 INFO:teuthology.orchestra.run.smithi149.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:55.784 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/289 2023-06-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/289 2023-06-09T05:53:55.785 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:55.789 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:55.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:55.868 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-06-09T05:53:56.210 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:56.215 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:56.216 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:56.217 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:56.217 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:56.998 INFO:teuthology.orchestra.run.smithi149.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:57.239 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/290 2023-06-09T05:53:57.240 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/290 2023-06-09T05:53:57.240 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:57.243 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:57.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:57.268 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-06-09T05:53:57.477 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:57.482 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:57.482 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:57.483 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:57.483 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:58.191 INFO:teuthology.orchestra.run.smithi149.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:58.395 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/291 2023-06-09T05:53:58.395 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/291 2023-06-09T05:53:58.395 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:58.406 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:58.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:58.470 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-06-09T05:53:58.684 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:58.688 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:58.688 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:58.689 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:58.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:59.600 INFO:teuthology.orchestra.run.smithi149.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:53:59.613 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/292 2023-06-09T05:53:59.614 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/292 2023-06-09T05:53:59.614 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:53:59.617 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:53:59.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:53:59.654 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-06-09T05:53:59.865 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:53:59.870 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:53:59.870 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:53:59.871 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:53:59.871 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:00.786 INFO:teuthology.orchestra.run.smithi149.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:00.842 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/293 2023-06-09T05:54:00.842 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/293 2023-06-09T05:54:00.842 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:00.847 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:00.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:00.883 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-06-09T05:54:01.093 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:01.099 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:02.149 INFO:teuthology.orchestra.run.smithi149.stdout:generic/294 1s 2023-06-09T05:54:02.154 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/294 2023-06-09T05:54:02.155 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:02.157 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:02.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:02.165 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-06-09T05:54:02.372 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:02.376 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:02.376 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:02.377 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:02.377 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:03.289 INFO:teuthology.orchestra.run.smithi149.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:03.375 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/295 2023-06-09T05:54:03.375 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/295 2023-06-09T05:54:03.376 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:03.378 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:03.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:03.406 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-06-09T05:54:03.638 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:03.642 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:03.642 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:03.643 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:03.643 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:04.565 INFO:teuthology.orchestra.run.smithi149.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:04.587 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/296 2023-06-09T05:54:04.587 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/296 2023-06-09T05:54:04.587 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:04.594 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:04.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:04.637 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-06-09T05:54:04.848 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:04.852 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:04.852 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:04.853 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:04.853 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:05.736 INFO:teuthology.orchestra.run.smithi149.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:05.742 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/297 2023-06-09T05:54:05.742 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/297 2023-06-09T05:54:05.742 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:05.748 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:05.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:05.824 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-06-09T05:54:06.051 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:06.055 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:06.056 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:06.057 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:06.057 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:07.020 INFO:teuthology.orchestra.run.smithi149.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:07.024 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/298 2023-06-09T05:54:07.025 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/298 2023-06-09T05:54:07.025 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:07.027 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:07.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:07.061 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-06-09T05:54:07.281 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:07.286 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:07.286 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:07.287 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:07.287 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:07.683 INFO:teuthology.orchestra.run.smithi149.stdout:generic/299 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:54:07.687 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/299 2023-06-09T05:54:07.687 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/299 2023-06-09T05:54:07.687 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:07.689 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:07.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:07.729 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-06-09T05:54:07.948 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:07.952 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:07.953 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:07.954 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:07.954 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:08.342 INFO:teuthology.orchestra.run.smithi149.stdout:generic/300 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:54:08.347 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/300 2023-06-09T05:54:08.347 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/300 2023-06-09T05:54:08.347 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:08.349 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:08.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:08.389 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-06-09T05:54:08.596 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:08.600 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:08.600 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:08.601 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:08.601 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:09.465 INFO:teuthology.orchestra.run.smithi149.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:09.480 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/301 2023-06-09T05:54:09.481 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/301 2023-06-09T05:54:09.481 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:09.485 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:09.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:09.549 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-06-09T05:54:09.754 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:09.758 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:09.758 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:09.759 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:09.759 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:10.671 INFO:teuthology.orchestra.run.smithi149.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:10.675 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/302 2023-06-09T05:54:10.675 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/302 2023-06-09T05:54:10.675 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:10.728 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:10.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:10.769 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-06-09T05:54:10.983 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:10.987 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:10.987 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:10.988 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:10.988 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:11.373 INFO:teuthology.orchestra.run.smithi149.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:54:11.377 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/303 2023-06-09T05:54:11.377 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/303 2023-06-09T05:54:11.378 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:11.379 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:11.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:11.726 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-06-09T05:54:12.014 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:12.018 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:12.019 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:12.020 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:12.020 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:12.408 INFO:teuthology.orchestra.run.smithi149.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:54:12.411 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/304 2023-06-09T05:54:12.412 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/304 2023-06-09T05:54:12.412 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:12.414 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:12.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:12.553 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-06-09T05:54:13.055 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:13.059 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:13.060 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:13.060 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:13.061 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:13.971 INFO:teuthology.orchestra.run.smithi149.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:54:13.999 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/305 2023-06-09T05:54:13.999 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/305 2023-06-09T05:54:13.999 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:14.003 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:14.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:14.039 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-06-09T05:54:14.245 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:14.250 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:14.250 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:14.251 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:14.251 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:15.177 INFO:teuthology.orchestra.run.smithi149.stdout:generic/306 1s 2023-06-09T05:54:15.349 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/306 2023-06-09T05:54:15.350 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:15.356 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:15.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:15.782 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-06-09T05:54:16.004 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:16.008 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:16.008 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:16.009 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:16.009 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:17.913 INFO:teuthology.orchestra.run.smithi149.stdout:generic/307 1s 2023-06-09T05:54:17.974 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/307 2023-06-09T05:54:17.975 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:17.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:17.985 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-06-09T05:54:18.208 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:18.212 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:18.212 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:18.213 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:18.213 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:18.598 INFO:teuthology.orchestra.run.smithi149.stdout:generic/308 0s 2023-06-09T05:54:18.602 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/308 2023-06-09T05:54:18.603 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:18.604 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:18.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:18.642 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-06-09T05:54:18.854 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:18.858 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:18.859 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:18.860 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:18.860 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:20.269 INFO:teuthology.orchestra.run.smithi149.stdout:generic/309 1s 2023-06-09T05:54:20.274 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/309 2023-06-09T05:54:20.275 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:54:20.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:20.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:54:20.613 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-06-09T05:54:20.915 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:54:20.920 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:54:20.920 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:54:20.921 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:54:20.921 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:54:34.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:54:34.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:04.365 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:04.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:34.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:34.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:55:38.107 INFO:teuthology.orchestra.run.smithi149.stdout:generic/310 77s 2023-06-09T05:55:38.111 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/310 2023-06-09T05:55:38.112 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:38.114 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:38.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:38.535 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-06-09T05:55:38.940 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:38.944 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:38.945 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:38.945 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:38.946 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:39.340 INFO:teuthology.orchestra.run.smithi149.stdout:generic/311 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:55:39.344 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/311 2023-06-09T05:55:39.344 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/311 2023-06-09T05:55:39.344 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:39.346 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:39.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:39.383 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-06-09T05:55:39.588 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:39.592 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:39.592 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:39.593 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:39.594 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:39.923 INFO:teuthology.orchestra.run.smithi149.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:55:39.927 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/312 2023-06-09T05:55:39.927 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/312 2023-06-09T05:55:39.928 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:39.929 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:39.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:39.955 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-06-09T05:55:40.162 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:40.166 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:40.166 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:40.167 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:40.167 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:44.572 INFO:teuthology.orchestra.run.smithi149.stdout:generic/313 4s 2023-06-09T05:55:44.577 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/313 2023-06-09T05:55:44.577 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:44.580 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:44.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:44.618 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-06-09T05:55:44.828 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:44.832 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:44.833 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:44.834 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:44.834 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:45.396 INFO:teuthology.orchestra.run.smithi149.stdout:generic/314 0s 2023-06-09T05:55:45.400 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/314 2023-06-09T05:55:45.401 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:45.403 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:45.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:45.436 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-06-09T05:55:45.646 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:45.650 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:45.650 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:45.651 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:45.651 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:46.001 INFO:teuthology.orchestra.run.smithi149.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T05:55:46.005 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/315 2023-06-09T05:55:46.005 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/315 2023-06-09T05:55:46.005 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:46.007 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:46.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:46.038 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-06-09T05:55:46.246 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:46.250 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:46.250 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:46.251 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:46.251 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:46.726 INFO:teuthology.orchestra.run.smithi149.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T05:55:46.730 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/316 2023-06-09T05:55:46.730 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/316 2023-06-09T05:55:46.730 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:46.732 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:47.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:47.096 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-06-09T05:55:47.354 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:47.358 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:47.358 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:47.359 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:47.359 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:48.490 INFO:teuthology.orchestra.run.smithi149.stdout:generic/317 1s 2023-06-09T05:55:48.495 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/317 2023-06-09T05:55:48.495 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:48.497 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:48.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:48.506 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-06-09T05:55:48.711 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:48.716 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:48.716 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:48.717 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:48.717 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:49.507 INFO:teuthology.orchestra.run.smithi149.stdout:generic/318 1s 2023-06-09T05:55:49.512 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/318 2023-06-09T05:55:49.512 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:49.514 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:49.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:49.522 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-06-09T05:55:49.742 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:49.746 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:49.746 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:49.747 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:49.747 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:50.343 INFO:teuthology.orchestra.run.smithi149.stdout:generic/319 1s 2023-06-09T05:55:50.348 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/319 2023-06-09T05:55:50.348 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:50.350 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:50.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:50.359 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-06-09T05:55:50.563 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:50.568 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:50.568 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:50.569 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:50.569 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:50.897 INFO:teuthology.orchestra.run.smithi149.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:55:50.901 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/320 2023-06-09T05:55:50.901 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/320 2023-06-09T05:55:50.901 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:50.903 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:50.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:50.928 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-06-09T05:55:51.135 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:51.139 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:51.140 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:51.140 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:51.141 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:51.490 INFO:teuthology.orchestra.run.smithi149.stdout:generic/321 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:55:51.493 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/321 2023-06-09T05:55:51.494 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/321 2023-06-09T05:55:51.494 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:51.496 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:51.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:51.521 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-06-09T05:55:51.727 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:51.731 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:51.732 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:51.733 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:51.733 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:52.075 INFO:teuthology.orchestra.run.smithi149.stdout:generic/322 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:55:52.079 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/322 2023-06-09T05:55:52.079 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/322 2023-06-09T05:55:52.080 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:55:52.081 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:55:52.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:55:52.109 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-06-09T05:55:52.313 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:55:52.317 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:55:52.318 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:55:52.319 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:55:52.319 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:56:04.699 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:04.702 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:56:04.760 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T05:56:04.757+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 364110) UID: 0 2023-06-09T05:56:04.761 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T05:56:04.757+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 364110) UID: 0 2023-06-09T05:56:04.761 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T05:56:04.757+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 364110) UID: 0 2023-06-09T05:56:04.761 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T05:56:04.757+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 364110) UID: 0 2023-06-09T05:57:53.341 INFO:teuthology.orchestra.run.smithi149.stdout:generic/323 121s 2023-06-09T05:57:53.357 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/323 2023-06-09T05:57:53.357 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:57:53.359 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:53.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:57:53.731 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-06-09T05:57:54.386 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:57:54.390 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:57:54.390 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:57:54.391 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:57:54.391 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:54.799 INFO:teuthology.orchestra.run.smithi149.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-06-09T05:57:54.802 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/324 2023-06-09T05:57:54.803 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/324 2023-06-09T05:57:54.803 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:57:54.804 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:54.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:57:54.828 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-06-09T05:57:55.030 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:57:55.034 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:57:55.034 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:57:55.035 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:57:55.035 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:55.877 INFO:teuthology.orchestra.run.smithi149.stdout:generic/325 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:57:55.881 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/325 2023-06-09T05:57:55.881 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/325 2023-06-09T05:57:55.881 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:57:55.883 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:55.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:57:55.922 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-06-09T05:57:56.147 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:57:56.151 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:57:56.151 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:57:56.152 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:57:56.152 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:57.101 INFO:teuthology.orchestra.run.smithi149.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:57:57.243 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/326 2023-06-09T05:57:57.243 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/326 2023-06-09T05:57:57.244 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:57:57.264 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:57.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:57:57.298 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-06-09T05:57:57.550 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:57:57.554 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:57:57.555 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:57:57.556 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:57:57.556 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:58.518 INFO:teuthology.orchestra.run.smithi149.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:57:58.629 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/327 2023-06-09T05:57:58.629 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/327 2023-06-09T05:57:58.629 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:57:58.631 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:58.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:57:58.657 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-06-09T05:57:58.873 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:57:58.877 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:57:58.877 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:57:58.878 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:57:58.878 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:59.760 INFO:teuthology.orchestra.run.smithi149.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:57:59.802 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/328 2023-06-09T05:57:59.802 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/328 2023-06-09T05:57:59.802 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:57:59.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:57:59.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:57:59.876 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-06-09T05:58:00.076 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:00.080 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:00.081 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:00.082 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:00.082 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:01.087 INFO:teuthology.orchestra.run.smithi149.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:58:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/329 2023-06-09T05:58:01.097 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/329 2023-06-09T05:58:01.098 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:01.098 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:01.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:01.133 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-06-09T05:58:01.346 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:01.349 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:01.350 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:01.351 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:01.351 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:02.349 INFO:teuthology.orchestra.run.smithi149.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:58:02.362 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/330 2023-06-09T05:58:02.363 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/330 2023-06-09T05:58:02.363 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:02.365 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:02.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:02.396 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-06-09T05:58:02.616 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:02.620 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:02.620 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:02.621 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:02.621 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:03.863 INFO:teuthology.orchestra.run.smithi149.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:58:03.910 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/331 2023-06-09T05:58:03.910 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/331 2023-06-09T05:58:03.910 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:03.913 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:03.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:03.954 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-06-09T05:58:04.160 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:04.164 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:04.164 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:04.165 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:04.165 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:04.987 INFO:teuthology.orchestra.run.smithi149.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:58:05.001 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/332 2023-06-09T05:58:05.001 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/332 2023-06-09T05:58:05.001 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:05.004 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:05.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:05.136 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-06-09T05:58:05.356 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:05.361 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:05.361 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:05.362 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:05.362 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:06.259 INFO:teuthology.orchestra.run.smithi149.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:58:06.291 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/333 2023-06-09T05:58:06.292 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/333 2023-06-09T05:58:06.292 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:06.321 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:06.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:06.361 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-06-09T05:58:06.576 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:06.580 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:06.581 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:06.582 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:06.582 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:07.472 INFO:teuthology.orchestra.run.smithi149.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:58:07.531 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/334 2023-06-09T05:58:07.531 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/334 2023-06-09T05:58:07.531 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:07.534 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:07.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:07.597 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-06-09T05:58:07.807 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:07.811 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:07.811 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:07.812 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:07.812 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:08.271 INFO:teuthology.orchestra.run.smithi149.stdout:generic/335 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:58:08.275 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/335 2023-06-09T05:58:08.275 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/335 2023-06-09T05:58:08.275 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:08.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:08.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:08.301 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-06-09T05:58:08.522 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:08.526 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:08.527 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:08.528 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:08.528 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:08.986 INFO:teuthology.orchestra.run.smithi149.stdout:generic/336 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:58:08.990 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/336 2023-06-09T05:58:08.990 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/336 2023-06-09T05:58:08.990 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:08.992 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:09.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:09.018 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-06-09T05:58:09.231 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:09.235 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:09.235 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:09.236 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:09.236 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:09.878 INFO:teuthology.orchestra.run.smithi149.stdout:generic/337 0s 2023-06-09T05:58:09.892 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/337 2023-06-09T05:58:09.892 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:09.894 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:09.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:09.903 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-06-09T05:58:10.114 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:10.118 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:10.118 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:10.119 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:10.119 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:10.518 INFO:teuthology.orchestra.run.smithi149.stdout:generic/338 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:58:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/338 2023-06-09T05:58:10.522 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/338 2023-06-09T05:58:10.523 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:58:10.524 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:58:10.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:58:10.545 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-06-09T05:58:10.756 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:58:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:58:10.760 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:58:10.761 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:58:10.762 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:04.416 INFO:teuthology.orchestra.run.smithi149.stdout:generic/339 54s 2023-06-09T05:59:04.446 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/339 2023-06-09T05:59:04.447 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:04.451 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:04.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:04.462 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-06-09T05:59:04.680 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:04.684 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:04.684 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:04.685 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:04.685 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:07.599 INFO:teuthology.orchestra.run.smithi149.stdout:generic/340 3s 2023-06-09T05:59:07.721 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/340 2023-06-09T05:59:07.721 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:07.762 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:07.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:07.794 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-06-09T05:59:08.017 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:08.021 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:08.022 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:08.022 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:08.023 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:08.618 INFO:teuthology.orchestra.run.smithi149.stdout:generic/341 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:59:08.633 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/341 2023-06-09T05:59:08.633 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/341 2023-06-09T05:59:08.633 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:08.635 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:08.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:08.674 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-06-09T05:59:08.901 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:08.905 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:08.905 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:08.906 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:08.906 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:09.243 INFO:teuthology.orchestra.run.smithi149.stdout:generic/342 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:59:09.247 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/342 2023-06-09T05:59:09.247 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/342 2023-06-09T05:59:09.247 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:09.249 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:09.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:09.280 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-06-09T05:59:09.497 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:09.501 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:09.502 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:09.502 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:09.503 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:09.909 INFO:teuthology.orchestra.run.smithi149.stdout:generic/343 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:59:09.913 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/343 2023-06-09T05:59:09.913 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/343 2023-06-09T05:59:09.914 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:09.915 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:09.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:09.948 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-06-09T05:59:10.167 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:10.171 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:10.172 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:10.172 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:10.173 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:15.565 INFO:teuthology.orchestra.run.smithi149.stdout:generic/344 5s 2023-06-09T05:59:15.587 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/344 2023-06-09T05:59:15.587 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:15.601 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:15.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:15.615 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-06-09T05:59:15.823 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:15.827 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:15.828 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:15.829 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:15.829 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:22.070 INFO:teuthology.orchestra.run.smithi149.stdout:generic/345 5s 2023-06-09T05:59:22.092 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/345 2023-06-09T05:59:22.092 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:22.097 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:22.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:22.107 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-06-09T05:59:22.491 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:22.495 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:22.495 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:22.497 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:22.497 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:25.722 INFO:teuthology.orchestra.run.smithi149.stdout:generic/346 3s 2023-06-09T05:59:25.874 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/346 2023-06-09T05:59:25.874 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:25.876 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:25.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:25.885 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-06-09T05:59:26.093 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:26.098 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:26.098 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:26.099 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:26.099 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:26.742 INFO:teuthology.orchestra.run.smithi149.stdout:generic/347 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:59:26.747 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/347 2023-06-09T05:59:26.747 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/347 2023-06-09T05:59:26.747 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:26.749 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:26.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:26.776 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-06-09T05:59:26.981 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:26.985 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:26.986 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:26.987 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:26.987 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:27.354 INFO:teuthology.orchestra.run.smithi149.stdout:generic/348 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:59:27.358 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/348 2023-06-09T05:59:27.358 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/348 2023-06-09T05:59:27.358 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:27.360 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:27.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:27.402 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-06-09T05:59:27.606 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:27.610 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:27.611 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:27.612 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:27.612 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:28.069 INFO:teuthology.orchestra.run.smithi149.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T05:59:28.072 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/349 2023-06-09T05:59:28.073 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/349 2023-06-09T05:59:28.073 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:28.075 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:28.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:28.106 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-06-09T05:59:28.319 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:28.323 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:28.323 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:28.324 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:28.325 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:28.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:28.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:59:28.590 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T05:59:28.587+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378256) UID: 0 2023-06-09T05:59:28.590 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T05:59:28.587+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378256) UID: 0 2023-06-09T05:59:28.591 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T05:59:28.587+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378256) UID: 0 2023-06-09T05:59:28.591 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T05:59:28.587+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 378256) UID: 0 2023-06-09T05:59:29.273 INFO:teuthology.orchestra.run.smithi149.stdout:generic/350 1s 2023-06-09T05:59:29.277 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/350 2023-06-09T05:59:29.278 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:29.280 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:29.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:29.288 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-06-09T05:59:29.539 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:29.543 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:29.544 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:29.545 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:29.545 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:29.911 INFO:teuthology.orchestra.run.smithi149.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:59:29.915 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/351 2023-06-09T05:59:29.915 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/351 2023-06-09T05:59:29.916 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:29.917 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:29.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:29.955 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-06-09T05:59:30.176 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:30.180 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:30.181 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:30.182 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:30.182 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:31.140 INFO:teuthology.orchestra.run.smithi149.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:59:31.181 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/352 2023-06-09T05:59:31.181 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/352 2023-06-09T05:59:31.181 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:31.190 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:31.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:31.219 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-06-09T05:59:31.421 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:31.424 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:31.425 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:31.426 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:31.426 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:32.313 INFO:teuthology.orchestra.run.smithi149.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:59:32.324 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/353 2023-06-09T05:59:32.325 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/353 2023-06-09T05:59:32.325 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:32.328 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:32.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:32.386 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-06-09T05:59:32.629 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:32.634 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:32.634 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:32.635 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:32.635 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:37.804 INFO:teuthology.orchestra.run.smithi149.stdout:generic/354 5s 2023-06-09T05:59:37.812 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/354 2023-06-09T05:59:37.812 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:37.819 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:37.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:37.831 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-06-09T05:59:38.348 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:38.354 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:38.354 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:38.355 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:38.356 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:39.746 INFO:teuthology.orchestra.run.smithi149.stdout:generic/355 1s 2023-06-09T05:59:39.763 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/355 2023-06-09T05:59:39.764 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:39.764 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:40.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:40.194 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-06-09T05:59:40.467 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:40.471 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:40.471 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:40.472 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:40.473 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:41.085 INFO:teuthology.orchestra.run.smithi149.stdout:generic/356 [not run] swapfiles are not supported 2023-06-09T05:59:41.089 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/356 2023-06-09T05:59:41.089 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/356 2023-06-09T05:59:41.089 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:41.091 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:41.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:41.122 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-06-09T05:59:41.336 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:41.340 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:41.340 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:41.341 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:41.341 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:41.920 INFO:teuthology.orchestra.run.smithi149.stdout:generic/357 [not run] swapfiles are not supported 2023-06-09T05:59:41.924 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/357 2023-06-09T05:59:41.924 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/357 2023-06-09T05:59:41.925 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:41.926 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:41.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:41.957 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-06-09T05:59:42.174 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:42.179 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:42.179 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:42.180 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:42.180 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:43.075 INFO:teuthology.orchestra.run.smithi149.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:59:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/358 2023-06-09T05:59:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/358 2023-06-09T05:59:43.137 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:43.199 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:43.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:43.258 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-06-09T05:59:43.463 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:43.467 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:43.467 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:43.468 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:43.469 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:44.462 INFO:teuthology.orchestra.run.smithi149.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:59:44.468 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/359 2023-06-09T05:59:44.468 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/359 2023-06-09T05:59:44.468 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:44.481 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:44.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:44.514 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-06-09T05:59:44.733 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:44.737 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:44.737 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:44.738 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:44.738 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:45.115 INFO:teuthology.orchestra.run.smithi149.stdout:generic/360 1s 2023-06-09T05:59:45.136 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/360 2023-06-09T05:59:45.136 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:45.138 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:45.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:45.167 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-06-09T05:59:45.388 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:45.392 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:45.392 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:45.393 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:45.393 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:45.811 INFO:teuthology.orchestra.run.smithi149.stdout:generic/361 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:59:45.814 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/361 2023-06-09T05:59:45.815 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/361 2023-06-09T05:59:45.815 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:45.817 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:45.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:45.841 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-06-09T05:59:46.051 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:46.056 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:46.056 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:46.057 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:46.057 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:46.382 INFO:teuthology.orchestra.run.smithi149.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:46.386 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/362 2023-06-09T05:59:46.386 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/362 2023-06-09T05:59:46.387 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:46.388 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:46.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:46.421 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-06-09T05:59:46.631 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:46.635 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:46.636 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:46.636 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:46.977 INFO:teuthology.orchestra.run.smithi149.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:46.981 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/363 2023-06-09T05:59:46.981 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/363 2023-06-09T05:59:46.981 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:46.983 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:47.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:47.013 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-06-09T05:59:47.215 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:47.218 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:47.219 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:47.220 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:47.220 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:47.547 INFO:teuthology.orchestra.run.smithi149.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:47.551 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/364 2023-06-09T05:59:47.551 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/364 2023-06-09T05:59:47.551 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:47.553 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:47.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:47.584 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-06-09T05:59:47.821 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:47.825 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:47.827 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:47.828 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:47.828 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:48.147 INFO:teuthology.orchestra.run.smithi149.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:48.151 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/365 2023-06-09T05:59:48.151 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/365 2023-06-09T05:59:48.151 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:48.153 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:48.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:48.175 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-06-09T05:59:48.381 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:48.385 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:48.386 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:48.387 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:48.388 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:48.721 INFO:teuthology.orchestra.run.smithi149.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:48.725 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/366 2023-06-09T05:59:48.725 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/366 2023-06-09T05:59:48.725 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:48.727 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:48.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:48.755 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-06-09T05:59:48.973 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:48.977 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:48.977 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:48.978 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:48.978 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:49.311 INFO:teuthology.orchestra.run.smithi149.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:49.315 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/367 2023-06-09T05:59:49.315 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/367 2023-06-09T05:59:49.315 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:49.317 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:49.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:49.344 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-06-09T05:59:49.554 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:49.558 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:49.558 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:49.559 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:49.559 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:49.877 INFO:teuthology.orchestra.run.smithi149.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:49.881 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/368 2023-06-09T05:59:49.881 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/368 2023-06-09T05:59:49.882 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:49.883 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:49.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:49.907 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-06-09T05:59:50.111 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:50.115 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:50.116 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:50.117 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:50.117 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:50.476 INFO:teuthology.orchestra.run.smithi149.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:50.480 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/369 2023-06-09T05:59:50.480 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/369 2023-06-09T05:59:50.480 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:50.482 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:50.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:50.520 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-06-09T05:59:50.757 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:50.761 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:50.761 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:50.762 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:50.762 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:51.080 INFO:teuthology.orchestra.run.smithi149.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T05:59:51.084 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/370 2023-06-09T05:59:51.085 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/370 2023-06-09T05:59:51.085 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:51.087 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:51.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:51.111 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-06-09T05:59:51.348 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:51.353 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:51.353 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:51.354 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:51.354 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:51.724 INFO:teuthology.orchestra.run.smithi149.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:59:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/371 2023-06-09T05:59:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/371 2023-06-09T05:59:51.728 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:51.730 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:51.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:51.757 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-06-09T05:59:51.982 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:51.986 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:51.987 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:51.988 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:51.988 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:52.926 INFO:teuthology.orchestra.run.smithi149.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:59:52.957 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/372 2023-06-09T05:59:52.957 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/372 2023-06-09T05:59:52.957 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:52.962 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:52.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:52.989 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-06-09T05:59:53.193 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:53.197 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:53.198 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:53.199 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:53.199 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:54.018 INFO:teuthology.orchestra.run.smithi149.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T05:59:54.024 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/373 2023-06-09T05:59:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/373 2023-06-09T05:59:54.025 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:54.122 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:54.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:54.228 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-06-09T05:59:54.463 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:54.467 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:54.467 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:54.468 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:54.468 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:54.999 INFO:teuthology.orchestra.run.smithi149.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T05:59:55.201 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/374 2023-06-09T05:59:55.202 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/374 2023-06-09T05:59:55.202 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:55.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:55.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:55.399 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-06-09T05:59:55.695 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:55.700 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:55.700 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:55.701 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:55.701 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:56.149 INFO:teuthology.orchestra.run.smithi149.stdout:generic/375 1s 2023-06-09T05:59:56.188 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/375 2023-06-09T05:59:56.189 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:56.190 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:56.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:56.680 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-06-09T05:59:56.900 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:56.904 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:56.904 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:56.905 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:56.905 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:57.256 INFO:teuthology.orchestra.run.smithi149.stdout:generic/376 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T05:59:57.259 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/376 2023-06-09T05:59:57.260 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/376 2023-06-09T05:59:57.260 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:57.262 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:57.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:57.293 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-06-09T05:59:57.502 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:57.506 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:57.506 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:57.507 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:57.507 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:58.112 INFO:teuthology.orchestra.run.smithi149.stdout:generic/377 1s 2023-06-09T05:59:58.116 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/377 2023-06-09T05:59:58.117 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:58.118 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:58.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:58.127 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-06-09T05:59:58.340 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:58.344 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:58.345 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:58.346 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:58.346 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:58.816 INFO:teuthology.orchestra.run.smithi149.stdout:generic/378 0s 2023-06-09T05:59:58.830 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/378 2023-06-09T05:59:58.831 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:58.833 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:59.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:59.283 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-06-09T05:59:59.538 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T05:59:59.542 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T05:59:59.542 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T05:59:59.543 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T05:59:59.543 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:59.895 INFO:teuthology.orchestra.run.smithi149.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:59:59.899 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/379 2023-06-09T05:59:59.899 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/379 2023-06-09T05:59:59.900 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T05:59:59.901 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T05:59:59.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:59:59.926 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-06-09T06:00:00.152 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:00.156 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:00.156 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:00.157 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:00.157 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:00.481 INFO:teuthology.orchestra.run.smithi149.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:00.484 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/380 2023-06-09T06:00:00.485 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/380 2023-06-09T06:00:00.485 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:00.487 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:00.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:00.508 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-06-09T06:00:00.715 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:00.719 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:00.720 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:00.721 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:00.721 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:01.045 INFO:teuthology.orchestra.run.smithi149.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/381 2023-06-09T06:00:01.049 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/381 2023-06-09T06:00:01.050 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:01.052 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:01.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:01.081 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-06-09T06:00:01.300 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:01.304 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:01.305 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:01.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:01.639 INFO:teuthology.orchestra.run.smithi149.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:01.643 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/382 2023-06-09T06:00:01.643 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/382 2023-06-09T06:00:01.643 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:01.645 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:01.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:01.671 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-06-09T06:00:01.876 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:01.880 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:01.880 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:01.881 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:01.881 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:02.222 INFO:teuthology.orchestra.run.smithi149.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:02.226 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/383 2023-06-09T06:00:02.226 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/383 2023-06-09T06:00:02.227 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:02.228 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:02.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:02.263 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-06-09T06:00:02.485 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:02.489 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:02.490 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:02.491 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:02.491 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:02.819 INFO:teuthology.orchestra.run.smithi149.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:02.823 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/384 2023-06-09T06:00:02.824 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/384 2023-06-09T06:00:02.824 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:02.825 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:02.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:02.853 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-06-09T06:00:03.074 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:03.078 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:03.078 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:03.079 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:03.079 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:03.396 INFO:teuthology.orchestra.run.smithi149.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:03.400 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/385 2023-06-09T06:00:03.400 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/385 2023-06-09T06:00:03.400 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:03.402 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:03.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:03.435 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-06-09T06:00:03.659 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:03.664 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:03.664 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:03.665 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:03.665 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:03.989 INFO:teuthology.orchestra.run.smithi149.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:03.993 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/386 2023-06-09T06:00:03.994 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/386 2023-06-09T06:00:03.994 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:03.996 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:04.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:04.022 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-06-09T06:00:04.236 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:04.240 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:04.241 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:04.242 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:04.242 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:05.164 INFO:teuthology.orchestra.run.smithi149.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:00:05.232 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/387 2023-06-09T06:00:05.232 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/387 2023-06-09T06:00:05.232 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:05.234 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:05.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:05.264 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-06-09T06:00:05.486 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:05.491 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:05.491 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:05.492 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:05.492 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:05.852 INFO:teuthology.orchestra.run.smithi149.stdout:generic/388 [not run] require 172.21.15.149:6789:/scratch to be local device 2023-06-09T06:00:05.856 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/388 2023-06-09T06:00:05.857 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/388 2023-06-09T06:00:05.857 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:05.859 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:05.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:05.883 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-06-09T06:00:06.095 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:06.099 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:06.099 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:06.100 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:06.100 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:06.422 INFO:teuthology.orchestra.run.smithi149.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-06-09T06:00:06.425 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/389 2023-06-09T06:00:06.426 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/389 2023-06-09T06:00:06.426 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:06.428 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:06.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:06.448 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-06-09T06:00:06.670 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:06.674 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:06.674 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:06.675 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:06.675 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:07.005 INFO:teuthology.orchestra.run.smithi149.stdout:generic/390 [not run] ceph does not support freezing 2023-06-09T06:00:07.009 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/390 2023-06-09T06:00:07.010 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/390 2023-06-09T06:00:07.010 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:07.011 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:07.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:07.038 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-06-09T06:00:07.250 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:07.255 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:07.255 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:07.256 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:07.256 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:07.618 INFO:teuthology.orchestra.run.smithi149.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:00:07.622 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/391 2023-06-09T06:00:07.623 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/391 2023-06-09T06:00:07.623 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:07.624 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:07.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:07.654 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-06-09T06:00:07.857 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:07.861 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:07.861 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:07.862 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:07.862 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:08.365 INFO:teuthology.orchestra.run.smithi149.stdout:generic/392 [not run] ceph does not support shutdown 2023-06-09T06:00:08.386 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/392 2023-06-09T06:00:08.387 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/392 2023-06-09T06:00:08.387 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:08.388 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:08.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:08.416 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-06-09T06:00:08.624 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:08.628 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:08.629 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:08.630 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:09.843 INFO:teuthology.orchestra.run.smithi149.stdout:generic/393 1s 2023-06-09T06:00:09.855 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/393 2023-06-09T06:00:09.855 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:09.857 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:09.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:09.865 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-06-09T06:00:10.083 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:10.087 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:10.088 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:10.089 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:10.089 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:10.472 INFO:teuthology.orchestra.run.smithi149.stdout:generic/394 0s 2023-06-09T06:00:10.485 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/394 2023-06-09T06:00:10.485 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:10.487 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:10.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:10.885 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-06-09T06:00:11.174 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:11.184 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:11.185 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:11.186 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:11.186 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:12.075 INFO:teuthology.orchestra.run.smithi149.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-06-09T06:00:12.110 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/395 2023-06-09T06:00:12.110 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/395 2023-06-09T06:00:12.110 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:12.115 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:12.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:12.165 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-06-09T06:00:12.650 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:12.665 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:12.666 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:12.673 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:12.673 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:13.247 INFO:teuthology.orchestra.run.smithi149.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-06-09T06:00:13.263 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/396 2023-06-09T06:00:13.263 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/396 2023-06-09T06:00:13.264 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:13.265 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:13.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:13.287 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-06-09T06:00:13.522 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:13.526 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:13.526 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:13.527 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:13.527 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:14.100 INFO:teuthology.orchestra.run.smithi149.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-06-09T06:00:14.117 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/397 2023-06-09T06:00:14.117 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/397 2023-06-09T06:00:14.118 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:14.119 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:14.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:14.142 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-06-09T06:00:14.378 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:14.382 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:14.382 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:14.383 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:14.383 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:14.953 INFO:teuthology.orchestra.run.smithi149.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-06-09T06:00:14.968 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/398 2023-06-09T06:00:14.968 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/398 2023-06-09T06:00:14.968 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:14.970 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:14.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:14.999 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-06-09T06:00:15.234 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:15.238 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:15.238 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:15.239 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:15.239 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:15.785 INFO:teuthology.orchestra.run.smithi149.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-06-09T06:00:15.804 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/399 2023-06-09T06:00:15.804 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/399 2023-06-09T06:00:15.805 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:15.806 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:15.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:15.830 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-06-09T06:00:16.063 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:16.067 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:16.067 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:16.068 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:16.068 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:16.405 INFO:teuthology.orchestra.run.smithi149.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:00:16.409 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/400 2023-06-09T06:00:16.409 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/400 2023-06-09T06:00:16.409 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:16.411 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:16.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:16.437 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-06-09T06:00:16.647 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:16.651 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:16.651 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:16.652 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:16.652 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:17.939 INFO:teuthology.orchestra.run.smithi149.stdout:generic/401 1s 2023-06-09T06:00:17.949 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/401 2023-06-09T06:00:17.949 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:17.951 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:17.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:17.965 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-06-09T06:00:18.189 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:18.193 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:18.194 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:18.195 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:18.195 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:18.714 INFO:teuthology.orchestra.run.smithi149.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-06-09T06:00:18.733 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/402 2023-06-09T06:00:18.733 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/402 2023-06-09T06:00:18.733 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:18.735 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:18.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:18.764 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-06-09T06:00:18.977 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:18.981 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:18.981 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:18.982 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:18.982 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:19.709 INFO:teuthology.orchestra.run.smithi149.stdout:generic/403 0s 2023-06-09T06:00:19.717 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/403 2023-06-09T06:00:19.717 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:19.719 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:19.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:19.728 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-06-09T06:00:19.931 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:19.935 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:19.935 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:19.936 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:19.936 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:20.306 INFO:teuthology.orchestra.run.smithi149.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:00:20.309 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/404 2023-06-09T06:00:20.310 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/404 2023-06-09T06:00:20.310 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:20.312 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:20.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:20.342 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-06-09T06:00:20.548 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:20.552 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:20.552 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:20.553 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:20.553 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:20.946 INFO:teuthology.orchestra.run.smithi149.stdout:generic/405 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T06:00:20.950 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/405 2023-06-09T06:00:20.950 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/405 2023-06-09T06:00:20.950 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:20.952 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:20.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:20.974 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-06-09T06:00:21.177 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:21.181 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:21.181 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:21.182 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:21.182 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:23.048 INFO:teuthology.orchestra.run.smithi149.stdout:generic/406 2s 2023-06-09T06:00:23.053 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/406 2023-06-09T06:00:23.054 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:23.056 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:23.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:23.065 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-06-09T06:00:23.273 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:23.277 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:23.277 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:23.278 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:23.278 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:23.663 INFO:teuthology.orchestra.run.smithi149.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:00:23.667 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/407 2023-06-09T06:00:23.667 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/407 2023-06-09T06:00:23.667 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:23.669 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:24.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:24.142 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-06-09T06:00:24.421 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:24.425 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:24.425 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:24.426 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:24.426 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:24.798 INFO:teuthology.orchestra.run.smithi149.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T06:00:24.801 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/408 2023-06-09T06:00:24.802 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/408 2023-06-09T06:00:24.802 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:24.804 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:24.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:24.990 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-06-09T06:00:25.491 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:25.494 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:25.495 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:25.496 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:25.496 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:25.844 INFO:teuthology.orchestra.run.smithi149.stdout:generic/409 [not run] require 172.21.15.149:6789:/scratch to be local device 2023-06-09T06:00:25.849 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/409 2023-06-09T06:00:25.849 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/409 2023-06-09T06:00:25.849 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:25.851 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:25.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:25.880 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-06-09T06:00:26.092 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:26.096 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:26.097 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:26.098 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:26.098 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:26.432 INFO:teuthology.orchestra.run.smithi149.stdout:generic/410 [not run] require 172.21.15.149:6789:/scratch to be local device 2023-06-09T06:00:26.436 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/410 2023-06-09T06:00:26.436 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/410 2023-06-09T06:00:26.437 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:26.438 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:26.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:26.469 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-06-09T06:00:26.674 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:26.678 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:26.678 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:26.679 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:26.679 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:27.035 INFO:teuthology.orchestra.run.smithi149.stdout:generic/411 [not run] require 172.21.15.149:6789:/scratch to be local device 2023-06-09T06:00:27.039 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/411 2023-06-09T06:00:27.039 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/411 2023-06-09T06:00:27.039 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:27.041 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:27.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:27.063 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-06-09T06:00:27.300 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:27.304 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:27.304 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:27.305 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:27.305 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:28.055 INFO:teuthology.orchestra.run.smithi149.stdout:generic/412 1s 2023-06-09T06:00:28.059 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/412 2023-06-09T06:00:28.060 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:28.062 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:28.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:28.070 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-06-09T06:00:28.277 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:28.281 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:28.282 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:28.282 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:28.283 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:28.764 INFO:teuthology.orchestra.run.smithi149.stdout:generic/413 [not run] mount 172.21.15.149:6789:/scratch with dax failed 2023-06-09T06:00:28.768 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/413 2023-06-09T06:00:28.769 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/413 2023-06-09T06:00:28.769 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:28.771 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:28.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:28.798 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-06-09T06:00:29.000 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:29.004 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:29.005 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:29.005 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:29.006 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:29.994 INFO:teuthology.orchestra.run.smithi149.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:00:30.001 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/414 2023-06-09T06:00:30.002 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/414 2023-06-09T06:00:30.002 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:30.041 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:30.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:30.065 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-06-09T06:00:30.271 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:30.275 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:30.276 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:30.276 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:30.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:31.286 INFO:teuthology.orchestra.run.smithi149.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:00:31.358 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/415 2023-06-09T06:00:31.359 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/415 2023-06-09T06:00:31.359 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:31.361 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:31.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:31.391 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-06-09T06:00:31.624 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:31.628 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:31.629 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:31.630 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:31.630 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:31.970 INFO:teuthology.orchestra.run.smithi149.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:00:31.973 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/416 2023-06-09T06:00:31.974 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/416 2023-06-09T06:00:31.974 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:31.976 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:32.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:32.002 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-06-09T06:00:32.220 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:32.224 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:32.224 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:32.225 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:32.226 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:32.709 INFO:teuthology.orchestra.run.smithi149.stdout:generic/417 [not run] ceph does not support shutdown 2023-06-09T06:00:32.737 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/417 2023-06-09T06:00:32.737 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/417 2023-06-09T06:00:32.738 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:32.739 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:32.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:32.769 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-06-09T06:00:32.973 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:32.977 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:32.977 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:32.978 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:32.978 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:33.345 INFO:teuthology.orchestra.run.smithi149.stdout:generic/418 [not run] require 172.21.15.149:6789:/test to be valid block disk 2023-06-09T06:00:33.349 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/418 2023-06-09T06:00:33.349 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/418 2023-06-09T06:00:33.350 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:33.351 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:33.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:33.386 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-06-09T06:00:33.589 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:33.593 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:33.594 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:33.594 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:33.595 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:34.150 INFO:teuthology.orchestra.run.smithi149.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-06-09T06:00:34.169 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/419 2023-06-09T06:00:34.170 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/419 2023-06-09T06:00:34.170 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:34.171 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:34.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:34.199 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-06-09T06:00:34.403 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:34.407 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:34.408 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:34.408 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:34.409 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:34.906 INFO:teuthology.orchestra.run.smithi149.stdout:generic/420 0s 2023-06-09T06:00:34.929 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/420 2023-06-09T06:00:34.929 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:34.931 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:35.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:35.177 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-06-09T06:00:35.611 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:35.615 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:35.615 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:35.616 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:35.616 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:36.159 INFO:teuthology.orchestra.run.smithi149.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-06-09T06:00:36.183 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/421 2023-06-09T06:00:36.184 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/421 2023-06-09T06:00:36.184 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:36.185 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:36.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:36.207 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-06-09T06:00:36.425 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:36.429 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:36.430 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:36.430 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:36.799 INFO:teuthology.orchestra.run.smithi149.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T06:00:36.803 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/422 2023-06-09T06:00:36.803 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/422 2023-06-09T06:00:36.803 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:36.805 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:36.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:36.833 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-06-09T06:00:37.038 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:37.042 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:37.043 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:37.044 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:37.044 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:37.499 INFO:teuthology.orchestra.run.smithi149.stdout:generic/423 0s 2023-06-09T06:00:37.505 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/423 2023-06-09T06:00:37.505 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:37.507 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:37.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:37.955 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-06-09T06:00:38.204 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:38.207 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:38.208 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:38.209 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:38.209 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:38.565 INFO:teuthology.orchestra.run.smithi149.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-06-09T06:00:38.569 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/424 2023-06-09T06:00:38.569 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/424 2023-06-09T06:00:38.569 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:38.571 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:38.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:38.607 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-06-09T06:00:38.829 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:38.833 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:38.833 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:38.834 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:38.834 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:39.214 INFO:teuthology.orchestra.run.smithi149.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-06-09T06:00:39.218 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/425 2023-06-09T06:00:39.218 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/425 2023-06-09T06:00:39.219 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:00:39.221 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:00:39.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:00:39.538 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-06-09T06:00:39.922 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:00:39.926 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:00:39.926 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:00:39.927 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:00:39.927 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:29.801 INFO:teuthology.orchestra.run.smithi149.stdout:generic/426 49s 2023-06-09T06:01:30.132 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/426 2023-06-09T06:01:30.132 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:30.167 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:30.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:30.874 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-06-09T06:01:34.574 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:34.578 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:34.579 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:34.580 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:34.580 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:35.184 INFO:teuthology.orchestra.run.smithi149.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:01:35.188 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/427 2023-06-09T06:01:35.188 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/427 2023-06-09T06:01:35.188 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:35.190 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:35.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:35.221 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-06-09T06:01:35.427 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:35.431 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:35.432 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:35.433 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:35.433 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:35.813 INFO:teuthology.orchestra.run.smithi149.stdout:generic/428 0s 2023-06-09T06:01:35.818 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/428 2023-06-09T06:01:35.818 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:35.820 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:35.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:35.851 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-06-09T06:01:36.089 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:36.093 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:36.093 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:36.094 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:36.094 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:36.673 INFO:teuthology.orchestra.run.smithi149.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-06-09T06:01:36.693 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/429 2023-06-09T06:01:36.693 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/429 2023-06-09T06:01:36.693 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:36.695 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:36.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:36.716 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-06-09T06:01:36.939 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:36.943 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:36.943 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:36.944 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:36.944 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:37.454 INFO:teuthology.orchestra.run.smithi149.stdout:generic/430 0s 2023-06-09T06:01:37.459 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/430 2023-06-09T06:01:37.460 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:37.461 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:37.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:37.873 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-06-09T06:01:38.205 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:38.209 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:38.209 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:38.210 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:38.210 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:38.635 INFO:teuthology.orchestra.run.smithi149.stdout:generic/431 0s 2023-06-09T06:01:38.640 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/431 2023-06-09T06:01:38.641 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:38.642 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:39.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:39.110 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-06-09T06:01:39.367 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:39.371 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:39.371 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:39.372 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:39.372 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:39.804 INFO:teuthology.orchestra.run.smithi149.stdout:generic/432 0s 2023-06-09T06:01:39.809 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/432 2023-06-09T06:01:39.809 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:39.811 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:40.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:40.278 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-06-09T06:01:40.504 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:40.508 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:40.508 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:40.509 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:40.510 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:40.941 INFO:teuthology.orchestra.run.smithi149.stdout:generic/433 0s 2023-06-09T06:01:40.946 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/433 2023-06-09T06:01:40.946 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:40.948 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:41.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:41.401 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-06-09T06:01:41.640 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:41.644 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:41.645 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:41.646 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:41.646 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:42.095 INFO:teuthology.orchestra.run.smithi149.stdout:generic/434 1s 2023-06-09T06:01:42.100 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/434 2023-06-09T06:01:42.100 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:42.102 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:42.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:42.584 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-06-09T06:01:42.810 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:42.814 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:42.814 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:42.816 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:42.816 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:43.406 INFO:teuthology.orchestra.run.smithi149.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-06-09T06:01:43.419 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/435 2023-06-09T06:01:43.420 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/435 2023-06-09T06:01:43.420 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:43.422 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:43.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:43.445 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-06-09T06:01:43.650 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:43.655 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:43.655 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:43.656 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:43.656 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:44.313 INFO:teuthology.orchestra.run.smithi149.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:01:44.316 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/436 2023-06-09T06:01:44.317 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/436 2023-06-09T06:01:44.317 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:44.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:44.767 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-06-09T06:01:45.016 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:45.020 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:45.020 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:45.021 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:45.021 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:45.979 INFO:teuthology.orchestra.run.smithi149.stdout:generic/437 0s 2023-06-09T06:01:45.984 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/437 2023-06-09T06:01:45.984 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:01:45.986 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:01:46.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:01:46.017 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-06-09T06:01:46.247 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:01:46.252 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:01:46.252 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:01:46.253 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:01:46.253 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:21.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:21.361 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:51.856 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:51.858 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:02:52.245 INFO:teuthology.orchestra.run.smithi149.stdout:generic/438 66s 2023-06-09T06:02:52.250 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/438 2023-06-09T06:02:52.250 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:52.252 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:52.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:52.282 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-06-09T06:02:52.488 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:52.492 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:52.492 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:52.493 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:52.493 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:53.604 INFO:teuthology.orchestra.run.smithi149.stdout:generic/439 1s 2023-06-09T06:02:53.609 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/439 2023-06-09T06:02:53.609 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:53.611 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:53.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:53.649 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-06-09T06:02:53.867 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:53.871 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:53.872 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:53.873 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:53.873 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:54.365 INFO:teuthology.orchestra.run.smithi149.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-06-09T06:02:54.382 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/440 2023-06-09T06:02:54.382 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/440 2023-06-09T06:02:54.382 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:54.384 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:54.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:54.407 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-06-09T06:02:54.621 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:54.626 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:54.626 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:54.627 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:54.627 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:55.742 INFO:teuthology.orchestra.run.smithi149.stdout:generic/441 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T06:02:55.746 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/441 2023-06-09T06:02:55.746 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/441 2023-06-09T06:02:55.747 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:55.749 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:55.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:55.774 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-06-09T06:02:55.985 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:55.989 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:55.989 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:55.990 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:55.990 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:56.338 INFO:teuthology.orchestra.run.smithi149.stdout:generic/442 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T06:02:56.342 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/442 2023-06-09T06:02:56.342 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/442 2023-06-09T06:02:56.342 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:56.344 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:56.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:56.375 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-06-09T06:02:56.589 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:56.593 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:56.594 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:56.595 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:56.595 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:56.999 INFO:teuthology.orchestra.run.smithi149.stdout:generic/443 0s 2023-06-09T06:02:57.004 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/443 2023-06-09T06:02:57.005 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:57.006 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:57.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:57.040 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-06-09T06:02:57.245 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:57.249 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:57.250 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:57.251 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:57.251 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:57.694 INFO:teuthology.orchestra.run.smithi149.stdout:generic/444 0s 2023-06-09T06:02:57.699 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/444 2023-06-09T06:02:57.699 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:57.701 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:57.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:57.741 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-06-09T06:02:57.944 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:57.948 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:57.949 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:57.950 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:57.950 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:58.618 INFO:teuthology.orchestra.run.smithi149.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:02:58.622 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/445 2023-06-09T06:02:58.623 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/445 2023-06-09T06:02:58.623 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:02:58.625 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:02:58.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:02:58.805 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-06-09T06:02:59.244 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:02:59.248 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:02:59.249 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:02:59.250 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:02:59.250 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:19.695 INFO:teuthology.orchestra.run.smithi149.stdout:generic/446 20s 2023-06-09T06:03:19.718 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/446 2023-06-09T06:03:19.719 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:19.734 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:19.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:19.755 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-06-09T06:03:19.962 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:19.966 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:19.966 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:19.967 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:19.967 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:20.824 INFO:teuthology.orchestra.run.smithi149.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:03:20.885 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/447 2023-06-09T06:03:20.885 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/447 2023-06-09T06:03:20.886 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:20.888 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:20.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:20.929 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-06-09T06:03:21.132 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:21.137 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:21.137 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:21.138 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:21.138 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:21.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:21.914 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:22.118 INFO:teuthology.orchestra.run.smithi149.stdout:generic/448 1s 2023-06-09T06:03:22.123 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/448 2023-06-09T06:03:22.124 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:22.126 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:22.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:22.521 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-06-09T06:03:22.798 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:22.802 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:22.803 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:22.804 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:22.804 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:23.185 INFO:teuthology.orchestra.run.smithi149.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:03:23.189 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/449 2023-06-09T06:03:23.189 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/449 2023-06-09T06:03:23.189 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:23.191 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:23.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:23.547 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-06-09T06:03:23.845 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:23.849 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:23.849 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:23.850 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:23.850 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:24.617 INFO:teuthology.orchestra.run.smithi149.stdout:generic/450 0s 2023-06-09T06:03:24.621 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/450 2023-06-09T06:03:24.622 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:24.624 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:25.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:25.050 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-06-09T06:03:25.279 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:25.282 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:25.283 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:25.284 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:25.284 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:52.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:52.092 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:55.736 INFO:teuthology.orchestra.run.smithi149.stdout:generic/451 30s 2023-06-09T06:03:55.740 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/451 2023-06-09T06:03:55.741 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:55.743 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:56.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:56.013 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-06-09T06:03:56.382 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:56.386 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:56.386 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:56.388 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:56.388 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:57.010 INFO:teuthology.orchestra.run.smithi149.stdout:generic/452 1s 2023-06-09T06:03:57.015 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/452 2023-06-09T06:03:57.015 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:57.017 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:57.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:57.026 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-06-09T06:03:57.244 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:57.248 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:57.249 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:57.250 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:57.250 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:57.580 INFO:teuthology.orchestra.run.smithi149.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-06-09T06:03:57.584 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/453 2023-06-09T06:03:57.585 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/453 2023-06-09T06:03:57.585 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:57.587 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:57.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:57.617 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-06-09T06:03:57.820 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:57.824 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:57.824 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:57.825 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:57.825 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:58.195 INFO:teuthology.orchestra.run.smithi149.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-06-09T06:03:58.199 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/454 2023-06-09T06:03:58.199 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/454 2023-06-09T06:03:58.199 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:58.201 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:58.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:58.231 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-06-09T06:03:58.440 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:58.444 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:58.444 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:58.445 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:58.445 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:58.847 INFO:teuthology.orchestra.run.smithi149.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T06:03:58.851 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/455 2023-06-09T06:03:58.851 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/455 2023-06-09T06:03:58.851 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:58.853 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:58.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:58.877 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-06-09T06:03:59.082 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:59.086 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:59.086 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:59.087 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:59.087 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:59.456 INFO:teuthology.orchestra.run.smithi149.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:03:59.460 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/456 2023-06-09T06:03:59.460 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/456 2023-06-09T06:03:59.460 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:03:59.462 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:03:59.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:03:59.493 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-06-09T06:03:59.728 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:03:59.732 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:03:59.733 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:03:59.734 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:03:59.734 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:00.699 INFO:teuthology.orchestra.run.smithi149.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:04:00.704 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/457 2023-06-09T06:04:00.704 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/457 2023-06-09T06:04:00.704 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:04:00.707 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:00.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:00.739 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-06-09T06:04:00.951 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:04:00.955 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:04:00.955 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:04:00.956 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:04:00.956 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:01.891 INFO:teuthology.orchestra.run.smithi149.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:04:01.949 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/458 2023-06-09T06:04:01.949 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/458 2023-06-09T06:04:01.949 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:04:01.969 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:02.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:02.007 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-06-09T06:04:02.211 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:04:02.215 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:04:02.215 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:04:02.216 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:04:02.216 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:02.803 INFO:teuthology.orchestra.run.smithi149.stdout:generic/459 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T06:04:02.807 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/459 2023-06-09T06:04:02.808 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/459 2023-06-09T06:04:02.808 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:04:02.809 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:02.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:02.837 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-06-09T06:04:03.043 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:04:03.047 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:04:03.048 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:04:03.049 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:04:03.049 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:05.131 INFO:teuthology.orchestra.run.smithi149.stdout:generic/460 2s 2023-06-09T06:04:05.135 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/460 2023-06-09T06:04:05.135 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:04:05.137 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:05.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:05.146 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-06-09T06:04:05.368 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:04:05.372 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:04:05.373 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:04:05.374 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:04:05.374 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:06.123 INFO:teuthology.orchestra.run.smithi149.stdout:generic/461 [not run] ceph does not support shutdown 2023-06-09T06:04:06.127 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/461 2023-06-09T06:04:06.127 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/461 2023-06-09T06:04:06.127 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:04:06.129 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:06.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:06.154 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-06-09T06:04:06.369 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:04:06.373 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:04:06.374 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:04:06.375 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:04:06.375 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:06.844 INFO:teuthology.orchestra.run.smithi149.stdout:generic/462 [not run] mount 172.21.15.149:6789:/scratch with dax failed 2023-06-09T06:04:06.848 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/462 2023-06-09T06:04:06.849 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/462 2023-06-09T06:04:06.849 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:04:06.851 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:06.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:06.874 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-06-09T06:04:07.096 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:04:07.100 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:04:07.100 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:04:07.101 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:04:07.101 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:07.467 INFO:teuthology.orchestra.run.smithi149.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:04:07.472 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/463 2023-06-09T06:04:07.472 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/463 2023-06-09T06:04:07.472 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:04:07.474 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:07.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:07.826 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-06-09T06:04:08.106 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:04:08.111 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:04:08.111 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:04:08.112 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:04:08.112 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:04:22.170 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:22.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:04:22.222 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T06:04:22.219+0000 7fc102cf8700 -1 Fail to open '/proc/115680/cmdline' error = (2) No such file or directory 2023-06-09T06:04:22.223 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T06:04:22.219+0000 7fc102cf8700 -1 received signal: Hangup from (PID: 115680) UID: 0 2023-06-09T06:04:22.223 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T06:04:22.219+0000 7fe30460e700 -1 Fail to open '/proc/115680/cmdline' error = (2) No such file or directory 2023-06-09T06:04:22.224 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T06:04:22.219+0000 7fe30460e700 -1 received signal: Hangup from (PID: 115680) UID: 0 2023-06-09T06:04:22.225 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T06:04:22.216+0000 7f70361b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115680) UID: 0 2023-06-09T06:04:22.229 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T06:04:22.219+0000 7f5a931e5700 -1 Fail to open '/proc/115680/cmdline' error = (2) No such file or directory 2023-06-09T06:04:22.229 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T06:04:22.219+0000 7f5a931e5700 -1 received signal: Hangup from (PID: 115680) UID: 0 2023-06-09T06:05:05.267 INFO:teuthology.orchestra.run.smithi149.stdout:generic/464 57s 2023-06-09T06:05:05.272 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/464 2023-06-09T06:05:05.272 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:05:05.274 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:05:05.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:05:05.283 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-06-09T06:05:05.502 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:05:05.506 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:05:05.507 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:05:05.508 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:05:05.508 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:05:10.080 INFO:teuthology.orchestra.run.smithi149.stdout:generic/465 4s 2023-06-09T06:05:10.092 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/465 2023-06-09T06:05:10.093 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:05:10.159 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:05:10.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:05:10.183 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-06-09T06:05:10.388 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:05:10.392 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:05:10.393 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:05:10.394 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:05:10.394 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:05:10.761 INFO:teuthology.orchestra.run.smithi149.stdout:generic/466 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T06:05:10.765 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/466 2023-06-09T06:05:10.765 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/466 2023-06-09T06:05:10.765 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:05:10.767 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:05:10.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:05:10.795 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-06-09T06:05:10.996 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:05:11.000 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:05:11.001 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:05:11.002 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:05:11.002 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:08.703 INFO:teuthology.orchestra.run.smithi149.stdout:generic/467 57s 2023-06-09T06:06:08.763 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/467 2023-06-09T06:06:08.763 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:08.774 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:09.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:09.247 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-06-09T06:06:10.381 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:10.385 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:10.385 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:10.386 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:10.386 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:10.933 INFO:teuthology.orchestra.run.smithi149.stdout:generic/468 [not run] ceph does not support shutdown 2023-06-09T06:06:10.961 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/468 2023-06-09T06:06:10.961 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/468 2023-06-09T06:06:10.961 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:10.963 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:10.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:10.990 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-06-09T06:06:11.205 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:11.209 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:11.209 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:11.210 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:11.211 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:11.574 INFO:teuthology.orchestra.run.smithi149.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T06:06:11.578 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/469 2023-06-09T06:06:11.578 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/469 2023-06-09T06:06:11.578 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:11.580 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:11.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:11.616 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-06-09T06:06:11.821 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:11.825 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:11.826 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:11.826 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:11.827 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:12.257 INFO:teuthology.orchestra.run.smithi149.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T06:06:12.261 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/470 2023-06-09T06:06:12.262 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/470 2023-06-09T06:06:12.262 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:12.264 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:12.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:12.290 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-06-09T06:06:12.498 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:12.502 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:12.502 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:12.503 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:12.503 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:12.917 INFO:teuthology.orchestra.run.smithi149.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-06-09T06:06:12.920 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/471 2023-06-09T06:06:12.921 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/471 2023-06-09T06:06:12.921 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:12.923 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:13.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:13.066 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-06-09T06:06:13.564 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:13.568 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:13.569 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:13.570 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:13.570 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:14.198 INFO:teuthology.orchestra.run.smithi149.stdout:generic/472 [not run] swapfiles are not supported 2023-06-09T06:06:14.202 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/472 2023-06-09T06:06:14.203 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/472 2023-06-09T06:06:14.203 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:14.205 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:14.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:14.241 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-06-09T06:06:14.475 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:14.479 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:14.480 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:14.481 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:14.481 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:14.859 INFO:teuthology.orchestra.run.smithi149.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T06:06:14.863 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/473 2023-06-09T06:06:14.863 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/473 2023-06-09T06:06:14.863 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:14.865 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:14.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:14.897 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-06-09T06:06:15.101 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:15.105 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:15.106 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:15.107 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:15.107 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:15.597 INFO:teuthology.orchestra.run.smithi149.stdout:generic/474 [not run] ceph does not support shutdown 2023-06-09T06:06:15.632 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/474 2023-06-09T06:06:15.633 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/474 2023-06-09T06:06:15.633 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:15.635 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:15.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:15.659 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-06-09T06:06:15.861 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:15.865 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:15.866 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:15.867 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:15.867 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:16.212 INFO:teuthology.orchestra.run.smithi149.stdout:generic/475 [not run] require 172.21.15.149:6789:/scratch to be valid block disk 2023-06-09T06:06:16.216 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/475 2023-06-09T06:06:16.216 INFO:teuthology.orchestra.run.smithi149.stdout:Not run: generic/475 2023-06-09T06:06:16.216 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T06:06:16.218 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:06:16.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:06:16.244 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-06-09T06:06:16.445 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T06:06:16.449 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T06:06:16.450 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T06:06:16.450 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T06:06:16.451 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T06:07:12.842 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:12.856 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:43.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:07:43.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:13.627 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:13.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:08:13.966 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T06:08:13.963+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625751) UID: 0 2023-06-09T06:08:13.967 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T06:08:13.964+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625751) UID: 0 2023-06-09T06:08:13.967 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T06:08:13.964+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625751) UID: 0 2023-06-09T06:08:13.972 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T06:08:13.966+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625751) UID: 0 2023-06-09T06:11:41.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:41.576 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:11:42.011 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T06:11:42.008+0000 7fd1388f4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116283) UID: 0 2023-06-09T06:11:42.023 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T06:11:42.009+0000 7f46ca054700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116283) UID: 0 2023-06-09T06:15:54.290 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T06:15:54.286+0000 7f70361b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116339) UID: 0 2023-06-09T06:15:54.291 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T06:15:54.286+0000 7fc102cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116339) UID: 0 2023-06-09T06:15:54.291 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T06:15:54.286+0000 7f5a931e5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116339) UID: 0 2023-06-09T06:15:54.291 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T06:15:54.286+0000 7fe30460e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116339) UID: 0 2023-06-09T06:20:45.700 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:45.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:16.379 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:16.449 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:46.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:46.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:17.067 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:17.077 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:47.325 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:47.343 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:47.425 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T06:22:47.422+0000 7f70361b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116707) UID: 0 2023-06-09T06:22:47.425 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T06:22:47.422+0000 7fc102cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116707) UID: 0 2023-06-09T06:22:47.425 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T06:22:47.422+0000 7f5a931e5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116707) UID: 0 2023-06-09T06:22:47.426 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T06:22:47.423+0000 7fe30460e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116707) UID: 0 2023-06-09T06:26:55.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:55.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:26:55.315 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T06:26:55.311+0000 7fd1388f4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116771) UID: 0 2023-06-09T06:26:55.320 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T06:26:55.310+0000 7f46ca054700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116771) UID: 0 2023-06-09T06:26:55.877 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T06:26:55.874+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626227) UID: 0 2023-06-09T06:26:55.877 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T06:26:55.874+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626227) UID: 0 2023-06-09T06:26:55.878 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T06:26:55.875+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626227) UID: 0 2023-06-09T06:26:55.878 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T06:26:55.875+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626227) UID: 0 2023-06-09T06:30:25.780 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T06:30:25.767+0000 7f70361b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116814) UID: 0 2023-06-09T06:30:25.781 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T06:30:25.772+0000 7f5a931e5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116814) UID: 0 2023-06-09T06:30:25.788 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T06:30:25.775+0000 7fc102cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116814) UID: 0 2023-06-09T06:30:25.794 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T06:30:25.772+0000 7fe30460e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 116814) UID: 0 2023-06-09T06:38:48.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:48.134 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:49.070 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T06:38:49.059+0000 7f7c02041700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626467) UID: 0 2023-06-09T06:38:49.079 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T06:38:49.071+0000 7f18d4cee700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626467) UID: 0 2023-06-09T06:38:49.109 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T06:38:49.071+0000 7f9fc24c4700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626467) UID: 0 2023-06-09T06:38:49.117 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T06:38:49.071+0000 7fa27a023700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626467) UID: 0 2023-06-09T06:53:00.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:00.970 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:53:01.462 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T06:53:01.459+0000 7f46ca054700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117103) UID: 0 2023-06-09T06:53:01.469 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T06:53:01.459+0000 7fd1388f4700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117103) UID: 0 2023-06-09T06:59:04.028 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T06:59:04.024+0000 7f7bf8418700 -1 bdev(0x556db6556000 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-09T06:59:04.046 INFO:tasks.ceph.osd.0.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f7bf8418700 time 2023-06-09T06:59:04.039946+0000 2023-06-09T06:59:04.046 INFO:tasks.ceph.osd.0.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T06:59:04.046 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.047 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x556db1a82d03] 2023-06-09T06:59:04.047 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.047 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.047 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.047 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: clone() 2023-06-09T06:59:04.047 INFO:tasks.ceph.osd.0.smithi149.stderr:*** Caught signal (Aborted) ** 2023-06-09T06:59:04.047 INFO:tasks.ceph.osd.0.smithi149.stderr: in thread 7f7bf8418700 thread_name:bstore_aio 2023-06-09T06:59:04.048 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.048 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f7c0a748ce0] 2023-06-09T06:59:04.048 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: gsignal() 2023-06-09T06:59:04.048 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: abort() 2023-06-09T06:59:04.048 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x556db1a82dc3] 2023-06-09T06:59:04.048 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.048 INFO:tasks.ceph.osd.0.smithi149.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.049 INFO:tasks.ceph.osd.0.smithi149.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.049 INFO:tasks.ceph.osd.0.smithi149.stderr: 8: clone() 2023-06-09T06:59:04.051 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T06:59:04.040+0000 7f7bf8418700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f7bf8418700 time 2023-06-09T06:59:04.039946+0000 2023-06-09T06:59:04.051 INFO:tasks.ceph.osd.0.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T06:59:04.051 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x556db1a82d03] 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: clone() 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.052 INFO:tasks.ceph.osd.0.smithi149.stderr:2023-06-09T06:59:04.044+0000 7f7bf8418700 -1 *** Caught signal (Aborted) ** 2023-06-09T06:59:04.053 INFO:tasks.ceph.osd.0.smithi149.stderr: in thread 7f7bf8418700 thread_name:bstore_aio 2023-06-09T06:59:04.053 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.053 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.053 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f7c0a748ce0] 2023-06-09T06:59:04.053 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: gsignal() 2023-06-09T06:59:04.053 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: abort() 2023-06-09T06:59:04.053 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x556db1a82dc3] 2023-06-09T06:59:04.054 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.054 INFO:tasks.ceph.osd.0.smithi149.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.054 INFO:tasks.ceph.osd.0.smithi149.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.054 INFO:tasks.ceph.osd.0.smithi149.stderr: 8: clone() 2023-06-09T06:59:04.054 INFO:tasks.ceph.osd.0.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T06:59:04.054 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.077 INFO:tasks.ceph.osd.0.smithi149.stderr: -614> 2023-06-09T06:59:04.024+0000 7f7bf8418700 -1 bdev(0x556db6556000 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-09T06:59:04.077 INFO:tasks.ceph.osd.0.smithi149.stderr: -117> 2023-06-09T06:59:04.040+0000 7f7bf8418700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f7bf8418700 time 2023-06-09T06:59:04.039946+0000 2023-06-09T06:59:04.077 INFO:tasks.ceph.osd.0.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x556db1a82d03] 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: clone() 2023-06-09T06:59:04.078 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.079 INFO:tasks.ceph.osd.0.smithi149.stderr: 0> 2023-06-09T06:59:04.044+0000 7f7bf8418700 -1 *** Caught signal (Aborted) ** 2023-06-09T06:59:04.079 INFO:tasks.ceph.osd.0.smithi149.stderr: in thread 7f7bf8418700 thread_name:bstore_aio 2023-06-09T06:59:04.079 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.079 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.079 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f7c0a748ce0] 2023-06-09T06:59:04.079 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: gsignal() 2023-06-09T06:59:04.079 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: abort() 2023-06-09T06:59:04.080 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x556db1a82dc3] 2023-06-09T06:59:04.080 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.080 INFO:tasks.ceph.osd.0.smithi149.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.080 INFO:tasks.ceph.osd.0.smithi149.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.080 INFO:tasks.ceph.osd.0.smithi149.stderr: 8: clone() 2023-06-09T06:59:04.080 INFO:tasks.ceph.osd.0.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T06:59:04.080 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.109 INFO:tasks.ceph.osd.0.smithi149.stderr: -1481> 2023-06-09T06:59:04.024+0000 7f7bf8418700 -1 bdev(0x556db6556000 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-09T06:59:04.110 INFO:tasks.ceph.osd.0.smithi149.stderr: -984> 2023-06-09T06:59:04.040+0000 7f7bf8418700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f7bf8418700 time 2023-06-09T06:59:04.039946+0000 2023-06-09T06:59:04.111 INFO:tasks.ceph.osd.0.smithi149.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4313-ga02638f8/rpm/el8/BUILD/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T06:59:04.111 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.111 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.111 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x556db1a82d03] 2023-06-09T06:59:04.111 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.111 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.111 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.112 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: clone() 2023-06-09T06:59:04.112 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.112 INFO:tasks.ceph.osd.0.smithi149.stderr: -867> 2023-06-09T06:59:04.044+0000 7f7bf8418700 -1 *** Caught signal (Aborted) ** 2023-06-09T06:59:04.112 INFO:tasks.ceph.osd.0.smithi149.stderr: in thread 7f7bf8418700 thread_name:bstore_aio 2023-06-09T06:59:04.112 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.113 INFO:tasks.ceph.osd.0.smithi149.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T06:59:04.113 INFO:tasks.ceph.osd.0.smithi149.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f7c0a748ce0] 2023-06-09T06:59:04.113 INFO:tasks.ceph.osd.0.smithi149.stderr: 2: gsignal() 2023-06-09T06:59:04.113 INFO:tasks.ceph.osd.0.smithi149.stderr: 3: abort() 2023-06-09T06:59:04.113 INFO:tasks.ceph.osd.0.smithi149.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x556db1a82dc3] 2023-06-09T06:59:04.113 INFO:tasks.ceph.osd.0.smithi149.stderr: 5: (KernelDevice::_aio_thread()+0x1798) [0x556db26958d8] 2023-06-09T06:59:04.113 INFO:tasks.ceph.osd.0.smithi149.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556db2697f71] 2023-06-09T06:59:04.114 INFO:tasks.ceph.osd.0.smithi149.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f7c0a73e1cf] 2023-06-09T06:59:04.114 INFO:tasks.ceph.osd.0.smithi149.stderr: 8: clone() 2023-06-09T06:59:04.114 INFO:tasks.ceph.osd.0.smithi149.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T06:59:04.114 INFO:tasks.ceph.osd.0.smithi149.stderr: 2023-06-09T06:59:04.582 INFO:tasks.ceph.osd.0.smithi149.stderr:daemon-helper: command failed with exit status 5 2023-06-09T06:59:11.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-06-09T06:59:17.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~7s 2023-06-09T06:59:24.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~13s 2023-06-09T06:59:31.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-06-09T06:59:37.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~26s 2023-06-09T06:59:44.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2023-06-09T06:59:50.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-06-09T06:59:57.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2023-06-09T07:00:04.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2023-06-09T07:00:10.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2023-06-09T07:00:17.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~66s 2023-06-09T07:00:23.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~73s 2023-06-09T07:00:25.265 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T07:00:25.260+0000 7fe30460e700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117189) UID: 0 2023-06-09T07:00:25.265 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T07:00:25.260+0000 7f5a931e5700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117189) UID: 0 2023-06-09T07:00:25.280 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T07:00:25.259+0000 7fc102cf8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117189) UID: 0 2023-06-09T07:00:25.282 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T07:00:25.260+0000 7f70361b3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117189) UID: 0 2023-06-09T07:00:30.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~79s 2023-06-09T07:00:37.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~86s 2023-06-09T07:00:43.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2023-06-09T07:00:50.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2023-06-09T07:00:56.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~106s 2023-06-09T07:01:03.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~112s 2023-06-09T07:01:10.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~119s 2023-06-09T07:01:16.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~126s 2023-06-09T07:01:23.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~132s 2023-06-09T07:01:29.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~139s 2023-06-09T07:01:36.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2023-06-09T07:01:43.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~152s 2023-06-09T07:01:49.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~159s 2023-06-09T07:01:56.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-06-09T07:02:02.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~172s 2023-06-09T07:02:09.586 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~178s 2023-06-09T07:02:16.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-06-09T07:02:22.800 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~192s 2023-06-09T07:02:29.408 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~198s 2023-06-09T07:02:36.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-06-09T07:02:42.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~212s 2023-06-09T07:02:49.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~218s 2023-06-09T07:02:55.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-06-09T07:03:02.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~231s 2023-06-09T07:03:09.057 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~238s 2023-06-09T07:03:15.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2023-06-09T07:03:22.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~251s 2023-06-09T07:03:28.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~258s 2023-06-09T07:03:35.501 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~264s 2023-06-09T07:03:42.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~271s 2023-06-09T07:03:48.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~278s 2023-06-09T07:03:48.845 INFO:teuthology.orchestra.run.smithi149.stdout:generic/476 3452s 2023-06-09T07:03:48.864 INFO:teuthology.orchestra.run.smithi149.stdout:Ran: generic/476 2023-06-09T07:03:48.864 INFO:teuthology.orchestra.run.smithi149.stdout:Passed all 1 tests 2023-06-09T07:03:48.866 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T07:03:48.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T07:03:48.877 DEBUG:teuthology.orchestra.run.smithi149:> (cd /tmp/tmp.cJJFcf5ijVxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-06-09T07:03:55.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~284s 2023-06-09T07:04:01.873 INFO:teuthology.orchestra.run.smithi149.stdout:FSTYP -- ceph 2023-06-09T07:04:01.877 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM -- Linux/x86_64 smithi149 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-06-09T07:04:01.878 INFO:teuthology.orchestra.run.smithi149.stdout:MKFS_OPTIONS -- 172.21.15.149:6789:/scratch 2023-06-09T07:04:01.879 INFO:teuthology.orchestra.run.smithi149.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAwrIJkgHSfExAAz1DQ8B7I5SY5K4pUK5UXcw== -o context=system_u:object_r:root_t:s0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch 2023-06-09T07:04:01.879 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T07:04:01.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~291s 2023-06-09T07:04:08.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~297s 2023-06-09T07:04:15.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~304s 2023-06-09T07:04:15.148 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-09T07:04:15.149 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T07:04:15.159 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T07:04:15.195 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T07:04:15.196 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T07:04:15.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T07:04:15.971 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.967+0000 7ff704e9e700 1 Processor -- start 2023-06-09T07:04:15.972 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.967+0000 7ff704e9e700 1 -- start start 2023-06-09T07:04:15.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.968+0000 7ff704e9e700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff7001589c0 0x7ff70015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:15.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.968+0000 7ff704e9e700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff700159650 0x7ff7000709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:15.973 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff704e9e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70015d2a0 con 0x7ff700159ad0 2023-06-09T07:04:15.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff704e9e700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7000cce80 con 0x7ff700159650 2023-06-09T07:04:15.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff704e9e700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7000cd160 con 0x7ff7001589c0 2023-06-09T07:04:15.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff700159650 0x7ff7000709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:15.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7ff700159650 0x7ff7000709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48054/0 (socket says 172.21.15.149:48054) 2023-06-09T07:04:15.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 -- 172.21.15.149:0/2468958762 learned_addr learned my addr 172.21.15.149:0/2468958762 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T07:04:15.974 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fe59c700 1 --2- 172.21.15.149:0/2468958762 >> v2:172.21.15.184:3300/0 conn(0x7ff7001589c0 0x7ff70015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:15.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 -- 172.21.15.149:0/2468958762 >> v2:172.21.15.184:3300/0 conn(0x7ff7001589c0 msgr2=0x7ff70015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:15.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 --2- 172.21.15.149:0/2468958762 >> v2:172.21.15.184:3300/0 conn(0x7ff7001589c0 0x7ff70015cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:15.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 -- 172.21.15.149:0/2468958762 >> v1:172.21.15.184:6789/0 conn(0x7ff700159ad0 legacy=0x7ff70006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:15.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 -- 172.21.15.149:0/2468958762 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000cd440 con 0x7ff700159650 2023-06-09T07:04:15.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fdd9b700 1 --2- 172.21.15.149:0/2468958762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff700159650 0x7ff7000709a0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7ff7000cfa40 tx=0x7ff6f400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19f4f5f9dae379d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:15.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fd59a700 1 -- 172.21.15.149:0/2468958762 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f400db60 con 0x7ff700159650 2023-06-09T07:04:15.975 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fd59a700 1 -- 172.21.15.149:0/2468958762 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f400dcc0 con 0x7ff700159650 2023-06-09T07:04:15.976 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.969+0000 7ff6fd59a700 1 -- 172.21.15.149:0/2468958762 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4017660 con 0x7ff700159650 2023-06-09T07:04:15.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 -- 172.21.15.149:0/2468958762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff700159650 msgr2=0x7ff7000709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:15.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 --2- 172.21.15.149:0/2468958762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff700159650 0x7ff7000709a0 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7ff7000cfa40 tx=0x7ff6f400be70 comp rx=0 tx=0).stop 2023-06-09T07:04:15.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 -- 172.21.15.149:0/2468958762 shutdown_connections 2023-06-09T07:04:15.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 --2- 172.21.15.149:0/2468958762 >> v2:172.21.15.184:3300/0 conn(0x7ff7001589c0 0x7ff70015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:15.978 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 --2- 172.21.15.149:0/2468958762 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff700159650 0x7ff7000709a0 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:15.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 -- 172.21.15.149:0/2468958762 >> 172.21.15.149:0/2468958762 conn(0x7ff7000ceed0 msgr2=0x7ff7000cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:15.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 -- 172.21.15.149:0/2468958762 shutdown_connections 2023-06-09T07:04:15.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.970+0000 7ff704e9e700 1 -- 172.21.15.149:0/2468958762 wait complete. 2023-06-09T07:04:15.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.972+0000 7ff704e9e700 1 Processor -- start 2023-06-09T07:04:15.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.972+0000 7ff704e9e700 1 -- start start 2023-06-09T07:04:15.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff704e9e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7001589c0 0x7ff7000b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:15.979 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff704e9e700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff700159650 0x7ff700151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:15.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff704e9e700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff700159ad0 0x7ff7000af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:15.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff704e9e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70015acb0 con 0x7ff7001589c0 2023-06-09T07:04:15.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff704e9e700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70015a070 con 0x7ff700159650 2023-06-09T07:04:15.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff704e9e700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70015a310 con 0x7ff700159ad0 2023-06-09T07:04:15.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7001589c0 0x7ff7000b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:15.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7001589c0 0x7ff7000b1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48060/0 (socket says 172.21.15.149:48060) 2023-06-09T07:04:15.980 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 -- 172.21.15.149:0/1102046801 learned_addr learned my addr 172.21.15.149:0/1102046801 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T07:04:15.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fdd9b700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff700159650 0x7ff700151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:15.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fed9d700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff700159ad0 0x7ff7000af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:15.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 -- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff700159ad0 msgr2=0x7ff7000af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:15.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff700159ad0 0x7ff7000af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:15.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 -- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff700159650 msgr2=0x7ff700151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:15.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff700159650 0x7ff700151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:15.981 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.973+0000 7ff6fe59c700 1 -- 172.21.15.149:0/1102046801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f400b7f0 con 0x7ff7001589c0 2023-06-09T07:04:15.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.974+0000 7ff6fe59c700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7001589c0 0x7ff7000b1d00 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e870 tx=0x7ff6f000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:15.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.974+0000 7ff6eeffd700 1 -- 172.21.15.149:0/1102046801 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0009590 con 0x7ff7001589c0 2023-06-09T07:04:15.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.974+0000 7ff6eeffd700 1 -- 172.21.15.149:0/1102046801 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0013680 con 0x7ff7001589c0 2023-06-09T07:04:15.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.974+0000 7ff6eeffd700 1 -- 172.21.15.149:0/1102046801 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00139f0 con 0x7ff7001589c0 2023-06-09T07:04:15.982 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.974+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70015a5f0 con 0x7ff7001589c0 2023-06-09T07:04:15.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.974+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7000b2240 con 0x7ff7001589c0 2023-06-09T07:04:15.983 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.975+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff700073fa0 con 0x7ff7001589c0 2023-06-09T07:04:15.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.980+0000 7ff6eeffd700 1 -- 172.21.15.149:0/1102046801 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6f0013b50 con 0x7ff7001589c0 2023-06-09T07:04:15.984 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.981+0000 7ff6eeffd700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff6e006ace0 0x7ff6e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:15.987 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.984+0000 7ff6fdd9b700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff6e006ace0 0x7ff6e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:15.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.984+0000 7ff6fdd9b700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff6e006ace0 0x7ff6e006d190 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4000c00 tx=0x7ff6f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:15.988 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.985+0000 7ff6eeffd700 1 -- 172.21.15.149:0/1102046801 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff6f005c860 con 0x7ff7001589c0 2023-06-09T07:04:15.989 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:15.985+0000 7ff6eeffd700 1 -- 172.21.15.149:0/1102046801 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff6f0058670 con 0x7ff7001589c0 2023-06-09T07:04:16.235 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.232+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7000ae100 con 0x7ff7001589c0 2023-06-09T07:04:16.237 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.233+0000 7ff6eeffd700 1 -- 172.21.15.149:0/1102046801 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+18725 (secure 0 0 0) 0x7ff6f0021020 con 0x7ff7001589c0 2023-06-09T07:04:16.237 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-09T07:04:16.238 INFO:teuthology.orchestra.run.smithi149.stdout:{"epoch":45,"fsid":"8958df92-450c-4c1c-8166-a5a3573afffd","created":"2023-06-09T04:36:34.692564+0000","modified":"2023-06-09T06:59:05.457408+0000","last_up_change":"2023-06-09T06:59:04.440427+0000","last_in_change":"2023-06-09T04:36:37.248881+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-09T04:36:46.069368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-09T04:36:46.436093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:38:12.652912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:38:13.159242+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.1099998950958252,"score_stable":2.1099998950958252,"optimal_score":0.87999999523162842,"raw_score_acting":1.8600000143051147,"raw_score_stable":1.8600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a6679ca7-c5dd-4930-9c6f-db3b82326053","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6801","nonce":1207338987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6803","nonce":1207338987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6807","nonce":1207338987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":1207338987},{"type":"v1","addr":"172.21.15.149:6805","nonce":1207338987}]},"public_addr":"172.21.15.149:6801/1207338987","cluster_addr":"172.21.15.149:6803/1207338987","heartbeat_back_addr":"172.21.15.149:6807/1207338987","heartbeat_front_addr":"172.21.15.149:6805/1207338987","state":["exists"]},{"osd":1,"uuid":"780ce4d5-926c-4a8f-8fe1-bd1b9ffa8c61","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6817","nonce":2598467347}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6819","nonce":2598467347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6823","nonce":2598467347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":2598467347},{"type":"v1","addr":"172.21.15.149:6821","nonce":2598467347}]},"public_addr":"172.21.15.149:6817/2598467347","cluster_addr":"172.21.15.149:6819/2598467347","heartbeat_back_addr":"172.21.15.149:6823/2598467347","heartbeat_front_addr":"172.21.15.149:6821/2598467347","state":["exists","up"]},{"osd":2,"uuid":"4589612a-ca2e-4243-89e6-617e6e5a81bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6809","nonce":2663874778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6811","nonce":2663874778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6815","nonce":2663874778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":2663874778},{"type":"v1","addr":"172.21.15.149:6813","nonce":2663874778}]},"public_addr":"172.21.15.149:6809/2663874778","cluster_addr":"172.21.15.149:6811/2663874778","heartbeat_back_addr":"172.21.15.149:6815/2663874778","heartbeat_front_addr":"172.21.15.149:6813/2663874778","state":["exists","up"]},{"osd":3,"uuid":"d53efe1c-2809-4bc8-8957-22555b3ebf2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6825","nonce":132658488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6827","nonce":132658488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6831","nonce":132658488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":132658488},{"type":"v1","addr":"172.21.15.149:6829","nonce":132658488}]},"public_addr":"172.21.15.149:6825/132658488","cluster_addr":"172.21.15.149:6827/132658488","heartbeat_back_addr":"172.21.15.149:6831/132658488","heartbeat_front_addr":"172.21.15.149:6829/132658488","state":["exists","up"]},{"osd":4,"uuid":"898e9fe4-d5ef-4c97-a827-ef5dd658567f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6801","nonce":2011701037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6803","nonce":2011701037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6807","nonce":2011701037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2011701037},{"type":"v1","addr":"172.21.15.184:6805","nonce":2011701037}]},"public_addr":"172.21.15.184:6801/2011701037","cluster_addr":"172.21.15.184:6803/2011701037","heartbeat_back_addr":"172.21.15.184:6807/2011701037","heartbeat_front_addr":"172.21.15.184:6805/2011701037","state":["exists","up"]},{"osd":5,"uuid":"83817238-e73f-425c-8f9d-7b9e96afd4cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6809","nonce":92283709}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6811","nonce":92283709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6815","nonce":92283709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":92283709},{"type":"v1","addr":"172.21.15.184:6813","nonce":92283709}]},"public_addr":"172.21.15.184:6809/92283709","cluster_addr":"172.21.15.184:6811/92283709","heartbeat_back_addr":"172.21.15.184:6815/92283709","heartbeat_front_addr":"172.21.15.184:6813/92283709","state":["exists","up"]},{"osd":6,"uuid":"967a22c1-172f-4201-889f-3d3807bbe2fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6818","nonce":966994911}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6822","nonce":966994911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6830","nonce":966994911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":966994911},{"type":"v1","addr":"172.21.15.184:6826","nonce":966994911}]},"public_addr":"172.21.15.184:6818/966994911","cluster_addr":"172.21.15.184:6822/966994911","heartbeat_back_addr":"172.21.15.184:6830/966994911","heartbeat_front_addr":"172.21.15.184:6826/966994911","state":["exists","up"]},{"osd":7,"uuid":"2e80a178-e8a5-4d68-9e25-0db401c0337e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6817","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6819","nonce":2909689851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6821","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6823","nonce":2909689851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6829","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6831","nonce":2909689851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6825","nonce":2909689851},{"type":"v1","addr":"172.21.15.184:6827","nonce":2909689851}]},"public_addr":"172.21.15.184:6819/2909689851","cluster_addr":"172.21.15.184:6823/2909689851","heartbeat_back_addr":"172.21.15.184:6831/2909689851","heartbeat_front_addr":"172.21.15.184:6827/2909689851","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.226111+0000","dead_epoch":44},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.493651+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.450093+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.479925+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.182796+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.391341+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:42.512717+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:36:44.349518+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":5}]},{"pgid":"7.1b","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T07:04:16.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff6e006ace0 msgr2=0x7ff6e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff6e006ace0 0x7ff6e006d190 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4000c00 tx=0x7ff6f4008040 comp rx=0 tx=0).stop 2023-06-09T07:04:16.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7001589c0 msgr2=0x7ff7000b1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.240 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7001589c0 0x7ff7000b1d00 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000e870 tx=0x7ff6f000eb80 comp rx=0 tx=0).stop 2023-06-09T07:04:16.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 shutdown_connections 2023-06-09T07:04:16.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7ff6e006ace0 0x7ff6e006d190 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7ff700159ad0 0x7ff7000af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff7001589c0 0x7ff7000b1d00 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 --2- 172.21.15.149:0/1102046801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff700159650 0x7ff700151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 >> 172.21.15.149:0/1102046801 conn(0x7ff7000ceed0 msgr2=0x7ff70006da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:16.241 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 shutdown_connections 2023-06-09T07:04:16.242 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.236+0000 7ff704e9e700 1 -- 172.21.15.149:0/1102046801 wait complete. 2023-06-09T07:04:16.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:36:46.069368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:36:46.436093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:38:12.652912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:38:13.159242+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.109999895095825, 'score_stable': 2.109999895095825, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.8600000143051147, 'raw_score_stable': 1.8600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T07:04:16.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T07:04:16.405 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.402+0000 7f45750d6700 1 Processor -- start 2023-06-09T07:04:16.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.403+0000 7f45750d6700 1 -- start start 2023-06-09T07:04:16.407 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.403+0000 7f45750d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45700cd300 0x7f45700ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.403+0000 7f45750d6700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45700716e0 con 0x7f45700cded0 2023-06-09T07:04:16.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.403+0000 7f45750d6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45700ce7e0 con 0x7f45701591d0 2023-06-09T07:04:16.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.403+0000 7f45750d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4570072280 con 0x7f45700cd300 2023-06-09T07:04:16.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456ed9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f45700cded0 0x7f457015d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43700/0 (socket says 172.21.15.149:43700) 2023-06-09T07:04:16.408 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456ed9d700 1 -- 172.21.15.149:0/3209722181 learned_addr learned my addr 172.21.15.149:0/3209722181 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T07:04:16.410 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699803608 0 0) 0x7f45700716e0 con 0x7f45700cded0 2023-06-09T07:04:16.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45580035b0 con 0x7f45700cded0 2023-06-09T07:04:16.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305093451 0 0) 0x7f45580035b0 con 0x7f45700cded0 2023-06-09T07:04:16.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45700cd300 msgr2=0x7f45700ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:16.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45700cd300 0x7f45700ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 >> v1:172.21.15.184:6789/0 conn(0x7f45701591d0 legacy=0x7f4570071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457006f6b0 con 0x7f45700cded0 2023-06-09T07:04:16.411 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f4564001670 con 0x7f45700cded0 2023-06-09T07:04:16.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 >> v1:172.21.15.149:6789/0 conn(0x7f45700cded0 legacy=0x7f457015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4558003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.404+0000 7f456dd9b700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4558004850 0x7f4558004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456dd9b700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45580053b0 0x7f455800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455800e490 con 0x7f4558003a30 2023-06-09T07:04:16.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4558009a30 con 0x7f4558004850 2023-06-09T07:04:16.412 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4558009bf0 con 0x7f45580053b0 2023-06-09T07:04:16.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456ed9d700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4558003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456f59e700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45580053b0 0x7f455800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456ed9d700 1 -- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45580053b0 msgr2=0x7f455800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:16.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456ed9d700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45580053b0 0x7f455800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456ed9d700 1 -- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4558004850 msgr2=0x7f4558004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T07:04:16.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456ed9d700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4558004850 0x7f4558004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.413 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456ed9d700 1 -- 172.21.15.149:0/3209722181 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580035b0 con 0x7f4558003a30 2023-06-09T07:04:16.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456ed9d700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4558003e40 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f456400c210 tx=0x7f4558005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d53b022ad54edfb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:16.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564007b70 con 0x7f4558003a30 2023-06-09T07:04:16.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456400cdb0 con 0x7f4558003a30 2023-06-09T07:04:16.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.405+0000 7f456dd9b700 1 -- 172.21.15.149:0/3209722181 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564005ba0 con 0x7f4558003a30 2023-06-09T07:04:16.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.406+0000 7f45750d6700 1 -- 172.21.15.149:0/3209722181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 msgr2=0x7f4558003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.406+0000 7f45750d6700 1 --2- 172.21.15.149:0/3209722181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4558003e40 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7f456400c210 tx=0x7f4558005880 comp rx=0 tx=0).stop 2023-06-09T07:04:16.414 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.406+0000 7f456f59e700 1 -- 172.21.15.149:0/3209722181 reap_dead start 2023-06-09T07:04:16.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.407+0000 7f45750d6700 1 -- 172.21.15.149:0/3209722181 shutdown_connections 2023-06-09T07:04:16.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.407+0000 7f45750d6700 1 -- 172.21.15.149:0/3209722181 >> 172.21.15.149:0/3209722181 conn(0x7f457006aec0 msgr2=0x7f457006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:16.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.407+0000 7f45750d6700 1 -- 172.21.15.149:0/3209722181 shutdown_connections 2023-06-09T07:04:16.415 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.407+0000 7f45750d6700 1 -- 172.21.15.149:0/3209722181 wait complete. 2023-06-09T07:04:16.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.408+0000 7f45750d6700 1 Processor -- start 2023-06-09T07:04:16.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.408+0000 7f45750d6700 1 -- start start 2023-06-09T07:04:16.417 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f45750d6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4570151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f45750d6700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45701512e0 0x7f45700b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f45750d6700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45700c88f0 0x7f45700c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f45750d6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45701f2130 con 0x7f4558003a30 2023-06-09T07:04:16.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f45750d6700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700b4b70 con 0x7f45700c88f0 2023-06-09T07:04:16.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f45750d6700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45700c92a0 con 0x7f45701512e0 2023-06-09T07:04:16.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f456ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4570151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.418 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f456ed9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4570151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48078/0 (socket says 172.21.15.149:48078) 2023-06-09T07:04:16.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.409+0000 7f456ed9d700 1 -- 172.21.15.149:0/1941884033 learned_addr learned my addr 172.21.15.149:0/1941884033 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T07:04:16.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f456ed9d700 1 -- 172.21.15.149:0/1941884033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45701512e0 msgr2=0x7f45700b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f456ed9d700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45701512e0 0x7f45700b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f456ed9d700 1 -- 172.21.15.149:0/1941884033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45700c88f0 msgr2=0x7f45700c8d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T07:04:16.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f456ed9d700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45700c88f0 0x7f45700c8d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.419 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f456ed9d700 1 -- 172.21.15.149:0/1941884033 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45701f13b0 con 0x7f4558003a30 2023-06-09T07:04:16.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f456ed9d700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4570151970 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f4564005b30 tx=0x7f4564001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:16.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f45577fe700 1 -- 172.21.15.149:0/1941884033 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45640070d0 con 0x7f4558003a30 2023-06-09T07:04:16.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f45577fe700 1 -- 172.21.15.149:0/1941884033 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564007250 con 0x7f4558003a30 2023-06-09T07:04:16.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f45577fe700 1 -- 172.21.15.149:0/1941884033 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564007600 con 0x7f4558003a30 2023-06-09T07:04:16.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4570151750 con 0x7f4558003a30 2023-06-09T07:04:16.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.410+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45701f1930 con 0x7f4558003a30 2023-06-09T07:04:16.420 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.411+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4570073fa0 con 0x7f4558003a30 2023-06-09T07:04:16.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.412+0000 7f45577fe700 1 -- 172.21.15.149:0/1941884033 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4564019030 con 0x7f4558003a30 2023-06-09T07:04:16.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.413+0000 7f45577fe700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f455c06ace0 0x7f455c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.413+0000 7f45577fe700 1 -- 172.21.15.149:0/1941884033 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f456408a8b0 con 0x7f4558003a30 2023-06-09T07:04:16.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.413+0000 7f456e59c700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f455c06ace0 0x7f455c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.413+0000 7f456e59c700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f455c06ace0 0x7f455c06d190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f45700b42b0 tx=0x7f4560006d20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:16.421 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.417+0000 7f45577fe700 1 -- 172.21.15.149:0/1941884033 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4564055870 con 0x7f4558003a30 2023-06-09T07:04:16.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.665+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f45700ce330 con 0x7f4558003a30 2023-06-09T07:04:16.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.666+0000 7f45577fe700 1 -- 172.21.15.149:0/1941884033 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4564058e90 con 0x7f4558003a30 2023-06-09T07:04:16.670 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 8 2023-06-09T07:04:16.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f455c06ace0 msgr2=0x7f455c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.672 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f455c06ace0 0x7f455c06d190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f45700b42b0 tx=0x7f4560006d20 comp rx=0 tx=0).stop 2023-06-09T07:04:16.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 msgr2=0x7f4570151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4570151970 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7f4564005b30 tx=0x7f4564001930 comp rx=0 tx=0).stop 2023-06-09T07:04:16.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 shutdown_connections 2023-06-09T07:04:16.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f455c06ace0 0x7f455c06d190 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45700c88f0 0x7f45700c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4558003a30 0x7f4570151970 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 --2- 172.21.15.149:0/1941884033 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f45701512e0 0x7f45700b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 >> 172.21.15.149:0/1941884033 conn(0x7f457006aec0 msgr2=0x7f45700b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:16.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 shutdown_connections 2023-06-09T07:04:16.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.668+0000 7f45750d6700 1 -- 172.21.15.149:0/1941884033 wait complete. 2023-06-09T07:04:16.687 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T07:04:16.830 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.827+0000 7f81589f1700 1 Processor -- start 2023-06-09T07:04:16.831 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.827+0000 7f81589f1700 1 -- start start 2023-06-09T07:04:16.833 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f81589f1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 0x7f81540c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f81589f1700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f815415a400 0x7f815406a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f81589f1700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81540720f0 con 0x7f81540ccc00 2023-06-09T07:04:16.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f81589f1700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81540ca1e0 con 0x7f815415a400 2023-06-09T07:04:16.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f81589f1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815406a6c0 con 0x7f8154069db0 2023-06-09T07:04:16.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f8152d9d700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f81540ccc00 0x7f81540b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43718/0 (socket says 172.21.15.149:43718) 2023-06-09T07:04:16.834 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f8152d9d700 1 -- 172.21.15.149:0/32612525 learned_addr learned my addr 172.21.15.149:0/32612525 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T07:04:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815259c700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 0x7f81540c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918450532 0 0) 0x7f81540720f0 con 0x7f81540ccc00 2023-06-09T07:04:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f813c0035b0 con 0x7f81540ccc00 2023-06-09T07:04:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 <== mon.0 v1:172.21.15.149:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1336829434 0 0) 0x7f813c0035b0 con 0x7f81540ccc00 2023-06-09T07:04:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 msgr2=0x7f81540c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 0x7f81540c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.835 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 >> v2:172.21.15.184:3300/0 conn(0x7f815415a400 msgr2=0x7f815406a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 --2- 172.21.15.149:0/32612525 >> v2:172.21.15.184:3300/0 conn(0x7f815415a400 0x7f815406a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 --> v1:172.21.15.149:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540cb960 con 0x7f81540ccc00 2023-06-09T07:04:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 <== mon.0 v1:172.21.15.149:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2084163203 0 0) 0x7f814c0019f0 con 0x7f81540ccc00 2023-06-09T07:04:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 >> v1:172.21.15.149:6789/0 conn(0x7f81540ccc00 legacy=0x7f81540b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c003a00 0x7f813c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f813c004850 0x7f813c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.836 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 0x7f813c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540ca1e0 con 0x7f813c003a00 2023-06-09T07:04:16.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815406a6c0 con 0x7f813c004850 2023-06-09T07:04:16.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c00bc20 con 0x7f8154069db0 2023-06-09T07:04:16.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.828+0000 7f815259c700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c003a00 0x7f813c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f8152d9d700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 0x7f813c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815259c700 1 -- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 msgr2=0x7f813c0052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:16.837 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815259c700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f8154069db0 0x7f813c0052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815259c700 1 -- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f813c004850 msgr2=0x7f813c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815259c700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f813c004850 0x7f813c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815259c700 1 -- 172.21.15.149:0/32612525 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0035b0 con 0x7f813c003a00 2023-06-09T07:04:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815259c700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c003a00 0x7f813c003e10 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f8144009860 tx=0x7f813c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7ed7beb11394a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814400c070 con 0x7f813c003a00 2023-06-09T07:04:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8144013610 con 0x7f813c003a00 2023-06-09T07:04:16.838 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.829+0000 7f815159a700 1 -- 172.21.15.149:0/32612525 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81440139a0 con 0x7f813c003a00 2023-06-09T07:04:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.830+0000 7f81589f1700 1 -- 172.21.15.149:0/32612525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c003a00 msgr2=0x7f813c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.830+0000 7f81589f1700 1 --2- 172.21.15.149:0/32612525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f813c003a00 0x7f813c003e10 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7f8144009860 tx=0x7f813c005880 comp rx=0 tx=0).stop 2023-06-09T07:04:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.830+0000 7f8152d9d700 1 -- 172.21.15.149:0/32612525 reap_dead start 2023-06-09T07:04:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.830+0000 7f81589f1700 1 -- 172.21.15.149:0/32612525 shutdown_connections 2023-06-09T07:04:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.830+0000 7f81589f1700 1 -- 172.21.15.149:0/32612525 >> 172.21.15.149:0/32612525 conn(0x7f815406aec0 msgr2=0x7f815406b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.830+0000 7f81589f1700 1 -- 172.21.15.149:0/32612525 shutdown_connections 2023-06-09T07:04:16.839 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.830+0000 7f81589f1700 1 -- 172.21.15.149:0/32612525 wait complete. 2023-06-09T07:04:16.841 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.831+0000 7f81589f1700 1 Processor -- start 2023-06-09T07:04:16.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.831+0000 7f81589f1700 1 -- start start 2023-06-09T07:04:16.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f81589f1700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f813c003a00 0x7f81540c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f81589f1700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f815415a7f0 0x7f81540b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f81589f1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81540c3d50 0x7f81540c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f81589f1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815415af40 con 0x7f81540c3d50 2023-06-09T07:04:16.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f81589f1700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815415d0a0 con 0x7f813c003a00 2023-06-09T07:04:16.842 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f81589f1700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815415d380 con 0x7f815415a7f0 2023-06-09T07:04:16.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81540c3d50 0x7f81540c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81540c3d50 0x7f81540c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48098/0 (socket says 172.21.15.149:48098) 2023-06-09T07:04:16.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 -- 172.21.15.149:0/1941680322 learned_addr learned my addr 172.21.15.149:0/1941680322 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T07:04:16.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 -- 172.21.15.149:0/1941680322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f815415a7f0 msgr2=0x7f81540b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f815415a7f0 0x7f81540b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.843 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 -- 172.21.15.149:0/1941680322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f813c003a00 msgr2=0x7f81540c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:16.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f813c003a00 0x7f81540c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:16.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.832+0000 7f8152d9d700 1 -- 172.21.15.149:0/1941680322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815415d660 con 0x7f81540c3d50 2023-06-09T07:04:16.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.833+0000 7f8152d9d700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81540c3d50 0x7f81540c41a0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f814c001330 tx=0x7f814c00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:16.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.833+0000 7f8142ffd700 1 -- 172.21.15.149:0/1941680322 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0133f0 con 0x7f81540c3d50 2023-06-09T07:04:16.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.833+0000 7f8142ffd700 1 -- 172.21.15.149:0/1941680322 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c013590 con 0x7f81540c3d50 2023-06-09T07:04:16.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.833+0000 7f8142ffd700 1 -- 172.21.15.149:0/1941680322 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c013940 con 0x7f81540c3d50 2023-06-09T07:04:16.844 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.833+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815415ac60 con 0x7f81540c3d50 2023-06-09T07:04:16.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.833+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81540b4e20 con 0x7f81540c3d50 2023-06-09T07:04:16.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.834+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8154073fa0 con 0x7f81540c3d50 2023-06-09T07:04:16.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.834+0000 7f8142ffd700 1 -- 172.21.15.149:0/1941680322 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f814c013aa0 con 0x7f81540c3d50 2023-06-09T07:04:16.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.835+0000 7f8142ffd700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f813406ace0 0x7f813406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:16.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.835+0000 7f8142ffd700 1 -- 172.21.15.149:0/1941680322 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f814c089d30 con 0x7f81540c3d50 2023-06-09T07:04:16.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.835+0000 7f815259c700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f813406ace0 0x7f813406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:16.845 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.835+0000 7f815259c700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f813406ace0 0x7f813406d190 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8144000c00 tx=0x7f8144013000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:16.846 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:16.841+0000 7f8142ffd700 1 -- 172.21.15.149:0/1941680322 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f814c054c60 con 0x7f81540c3d50 2023-06-09T07:04:17.088 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.084+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81540b4e20 con 0x7f81540c3d50 2023-06-09T07:04:17.089 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.085+0000 7f8142ffd700 1 -- 172.21.15.149:0/1941680322 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81540b4e20 con 0x7f81540c3d50 2023-06-09T07:04:17.089 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 1 2023-06-09T07:04:17.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f813406ace0 msgr2=0x7f813406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f813406ace0 0x7f813406d190 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8144000c00 tx=0x7f8144013000 comp rx=0 tx=0).stop 2023-06-09T07:04:17.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81540c3d50 msgr2=0x7f81540c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81540c3d50 0x7f81540c41a0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f814c001330 tx=0x7f814c00a640 comp rx=0 tx=0).stop 2023-06-09T07:04:17.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 shutdown_connections 2023-06-09T07:04:17.091 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f813406ace0 0x7f813406d190 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f81540c3d50 0x7f81540c41a0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f813c003a00 0x7f81540c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 --2- 172.21.15.149:0/1941680322 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f815415a7f0 0x7f81540b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 >> 172.21.15.149:0/1941680322 conn(0x7f815406aec0 msgr2=0x7f81540af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:17.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 shutdown_connections 2023-06-09T07:04:17.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.087+0000 7f81589f1700 1 -- 172.21.15.149:0/1941680322 wait complete. 2023-06-09T07:04:17.106 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T07:04:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.256+0000 7feed1817700 1 Processor -- start 2023-06-09T07:04:17.260 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.256+0000 7feed1817700 1 -- start start 2023-06-09T07:04:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.257+0000 7feed1817700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0ccb00 0x7feecc0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.257+0000 7feed1817700 1 --2- >> v2:172.21.15.149:3300/0 conn(0x7feecc0b4ed0 0x7feecc0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.257+0000 7feed1817700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc15c750 con 0x7feecc0b43f0 2023-06-09T07:04:17.262 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.257+0000 7feed1817700 1 -- --> v2:172.21.15.149:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc0ccfc0 con 0x7feecc0b4ed0 2023-06-09T07:04:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.257+0000 7feed1817700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0cf740 con 0x7feecc0ccb00 2023-06-09T07:04:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.257+0000 7feecaffd700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7feecc0b43f0 0x7feecc0b47c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43734/0 (socket says 172.21.15.149:43734) 2023-06-09T07:04:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.257+0000 7feecaffd700 1 -- 172.21.15.149:0/476205505 learned_addr learned my addr 172.21.15.149:0/476205505 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T07:04:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feecb7fe700 1 --2- 172.21.15.149:0/476205505 >> v2:172.21.15.149:3300/0 conn(0x7feecc0b4ed0 0x7feecc0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feecb7fe700 1 -- 172.21.15.149:0/476205505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0ccb00 msgr2=0x7feecc0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feecb7fe700 1 --2- 172.21.15.149:0/476205505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0ccb00 0x7feecc0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.263 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feecb7fe700 1 -- 172.21.15.149:0/476205505 >> v1:172.21.15.149:6789/0 conn(0x7feecc0b43f0 legacy=0x7feecc0b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feec9ffb700 1 -- 172.21.15.149:0/476205505 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090877165 0 0) 0x7feebc001110 con 0x7feecc0b43f0 2023-06-09T07:04:17.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feecb7fe700 1 -- 172.21.15.149:0/476205505 --> v2:172.21.15.149:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0cd540 con 0x7feecc0b4ed0 2023-06-09T07:04:17.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feecb7fe700 1 --2- 172.21.15.149:0/476205505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0b4ed0 0x7feecc0d0b80 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7feec4009d90 tx=0x7feec400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548766593884bfad server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:17.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feec9ffb700 1 -- 172.21.15.149:0/476205505 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400e070 con 0x7feecc0b4ed0 2023-06-09T07:04:17.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feec9ffb700 1 -- 172.21.15.149:0/476205505 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec400bbd0 con 0x7feecc0b4ed0 2023-06-09T07:04:17.264 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.258+0000 7feec9ffb700 1 -- 172.21.15.149:0/476205505 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4012430 con 0x7feecc0b4ed0 2023-06-09T07:04:17.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 -- 172.21.15.149:0/476205505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0b4ed0 msgr2=0x7feecc0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.265 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 --2- 172.21.15.149:0/476205505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0b4ed0 0x7feecc0d0b80 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7feec4009d90 tx=0x7feec400b330 comp rx=0 tx=0).stop 2023-06-09T07:04:17.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 -- 172.21.15.149:0/476205505 shutdown_connections 2023-06-09T07:04:17.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 --2- 172.21.15.149:0/476205505 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0b4ed0 0x7feecc0d0b80 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 --2- 172.21.15.149:0/476205505 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0ccb00 0x7feecc0d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 -- 172.21.15.149:0/476205505 >> 172.21.15.149:0/476205505 conn(0x7feecc072120 msgr2=0x7feecc06afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:17.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 -- 172.21.15.149:0/476205505 shutdown_connections 2023-06-09T07:04:17.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.259+0000 7feed1817700 1 -- 172.21.15.149:0/476205505 wait complete. 2023-06-09T07:04:17.266 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.261+0000 7feed1817700 1 Processor -- start 2023-06-09T07:04:17.267 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.261+0000 7feed1817700 1 -- start start 2023-06-09T07:04:17.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feed1817700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0b43f0 0x7feecc1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.268 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feed1817700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feecc0b4ed0 0x7feecc0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feed1817700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0ccb00 0x7feecc15d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feed1817700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc150800 con 0x7feecc0ccb00 2023-06-09T07:04:17.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feed1817700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0c75a0 con 0x7feecc0b4ed0 2023-06-09T07:04:17.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feed1817700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0c8fc0 con 0x7feecc0b43f0 2023-06-09T07:04:17.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feeca7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feecc0b4ed0 0x7feecc0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feecaffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0b43f0 0x7feecc1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.269 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feecb7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0ccb00 0x7feecc15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feeca7fc700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feecc0b4ed0 0x7feecc0c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:39142/0 (socket says 172.21.15.149:39142) 2023-06-09T07:04:17.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feecaffd700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0b43f0 0x7feecc1502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3301/0 says I am v2:172.21.15.149:53720/0 (socket says 172.21.15.149:53720) 2023-06-09T07:04:17.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.262+0000 7feeca7fc700 1 -- 172.21.15.149:0/983760108 learned_addr learned my addr 172.21.15.149:0/983760108 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T07:04:17.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feecb7fe700 1 -- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0b43f0 msgr2=0x7feecc1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feecb7fe700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0b43f0 0x7feecc1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feecb7fe700 1 -- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feecc0b4ed0 msgr2=0x7feecc0c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.270 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feecb7fe700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feecc0b4ed0 0x7feecc0c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feecb7fe700 1 -- 172.21.15.149:0/983760108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4009a70 con 0x7feecc0ccb00 2023-06-09T07:04:17.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feecaffd700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0b43f0 0x7feecc1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T07:04:17.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feeca7fc700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feecc0b4ed0 0x7feecc0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T07:04:17.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feecb7fe700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0ccb00 0x7feecc15d850 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7feec4016000 tx=0x7feec4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:17.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feeb3fff700 1 -- 172.21.15.149:0/983760108 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4012430 con 0x7feecc0ccb00 2023-06-09T07:04:17.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feeb3fff700 1 -- 172.21.15.149:0/983760108 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec4020070 con 0x7feecc0ccb00 2023-06-09T07:04:17.271 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc0c6f50 con 0x7feecc0ccb00 2023-06-09T07:04:17.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feeb3fff700 1 -- 172.21.15.149:0/983760108 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4004280 con 0x7feecc0ccb00 2023-06-09T07:04:17.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.263+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc0c92a0 con 0x7feecc0ccb00 2023-06-09T07:04:17.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.264+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc073fa0 con 0x7feecc0ccb00 2023-06-09T07:04:17.272 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.264+0000 7feeb3fff700 1 -- 172.21.15.149:0/983760108 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feec40043e0 con 0x7feecc0ccb00 2023-06-09T07:04:17.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.265+0000 7feeb3fff700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feeb806ace0 0x7feeb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.265+0000 7feeb3fff700 1 -- 172.21.15.149:0/983760108 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7feec4022070 con 0x7feecc0ccb00 2023-06-09T07:04:17.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.265+0000 7feecaffd700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feeb806ace0 0x7feeb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.273 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.265+0000 7feecaffd700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feeb806ace0 0x7feeb806d190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feebc000f60 tx=0x7feebc007e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:17.274 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.270+0000 7feeb3fff700 1 -- 172.21.15.149:0/983760108 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feec40566b0 con 0x7feecc0ccb00 2023-06-09T07:04:17.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.491+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feecc0c76e0 con 0x7feecc0ccb00 2023-06-09T07:04:17.495 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.492+0000 7feeb3fff700 1 -- 172.21.15.149:0/983760108 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+11 (secure 0 0 0) 0x7feec4059cd0 con 0x7feecc0ccb00 2023-06-09T07:04:17.496 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 32 2023-06-09T07:04:17.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feeb806ace0 msgr2=0x7feeb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feeb806ace0 0x7feeb806d190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7feebc000f60 tx=0x7feebc007e70 comp rx=0 tx=0).stop 2023-06-09T07:04:17.498 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0ccb00 msgr2=0x7feecc15d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0ccb00 0x7feecc15d850 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7feec4016000 tx=0x7feec4004ad0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 shutdown_connections 2023-06-09T07:04:17.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7feeb806ace0 0x7feeb806d190 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7feecc0b43f0 0x7feecc1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feecc0ccb00 0x7feecc15d850 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 --2- 172.21.15.149:0/983760108 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feecc0b4ed0 0x7feecc0c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.499 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 >> 172.21.15.149:0/983760108 conn(0x7feecc072120 msgr2=0x7feecc0d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:17.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 shutdown_connections 2023-06-09T07:04:17.500 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.494+0000 7feed1817700 1 -- 172.21.15.149:0/983760108 wait complete. 2023-06-09T07:04:17.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T07:04:17.665 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.662+0000 7fd4e4871700 1 Processor -- start 2023-06-09T07:04:17.666 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.662+0000 7fd4e4871700 1 -- start start 2023-06-09T07:04:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4e4871700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 0x7fd4e00b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4e4871700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4e00ccb00 0x7fd4e00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4e4871700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e015c750 con 0x7fd4e015fdf0 2023-06-09T07:04:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4e4871700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e00ccfc0 con 0x7fd4e00ccb00 2023-06-09T07:04:17.667 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4e4871700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e00b5240 con 0x7fd4e00b43f0 2023-06-09T07:04:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4ddd9b700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd4e00ccb00 0x7fd4e00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4ded9d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd4e015fdf0 0x7fd4e0160250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.149:49750/0 (socket says 172.21.15.149:49750) 2023-06-09T07:04:17.668 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4ded9d700 1 -- 172.21.15.149:0/735456312 learned_addr learned my addr 172.21.15.149:0/735456312 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T07:04:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4ddd9b700 1 -- 172.21.15.149:0/735456312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 msgr2=0x7fd4e00b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4ddd9b700 1 --2- 172.21.15.149:0/735456312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 0x7fd4e00b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.669 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4ddd9b700 1 -- 172.21.15.149:0/735456312 >> v1:172.21.15.184:6789/0 conn(0x7fd4e015fdf0 legacy=0x7fd4e0160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.663+0000 7fd4ddd9b700 1 -- 172.21.15.149:0/735456312 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00cf740 con 0x7fd4e00ccb00 2023-06-09T07:04:17.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.664+0000 7fd4ddd9b700 1 --2- 172.21.15.149:0/735456312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e00ccb00 0x7fd4e00b4d00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009840 tx=0x7fd4d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eff7e9e13a6cb4d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:17.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.664+0000 7fd4dd59a700 1 -- 172.21.15.149:0/735456312 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4011830 con 0x7fd4e00ccb00 2023-06-09T07:04:17.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.664+0000 7fd4dd59a700 1 -- 172.21.15.149:0/735456312 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4011990 con 0x7fd4e00ccb00 2023-06-09T07:04:17.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.664+0000 7fd4dd59a700 1 -- 172.21.15.149:0/735456312 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4011d20 con 0x7fd4e00ccb00 2023-06-09T07:04:17.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 -- 172.21.15.149:0/735456312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e00ccb00 msgr2=0x7fd4e00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.670 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 --2- 172.21.15.149:0/735456312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e00ccb00 0x7fd4e00b4d00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009840 tx=0x7fd4d4009b50 comp rx=0 tx=0).stop 2023-06-09T07:04:17.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 -- 172.21.15.149:0/735456312 shutdown_connections 2023-06-09T07:04:17.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 --2- 172.21.15.149:0/735456312 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 0x7fd4e00b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 --2- 172.21.15.149:0/735456312 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e00ccb00 0x7fd4e00b4d00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 -- 172.21.15.149:0/735456312 >> 172.21.15.149:0/735456312 conn(0x7fd4e0072120 msgr2=0x7fd4e006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:17.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 -- 172.21.15.149:0/735456312 shutdown_connections 2023-06-09T07:04:17.671 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.665+0000 7fd4e4871700 1 -- 172.21.15.149:0/735456312 wait complete. 2023-06-09T07:04:17.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.666+0000 7fd4e4871700 1 Processor -- start 2023-06-09T07:04:17.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.666+0000 7fd4e4871700 1 -- start start 2023-06-09T07:04:17.673 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4e4871700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 0x7fd4e01f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4e4871700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4e00ccb00 0x7fd4e015cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4e4871700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e015fdf0 0x7fd4e00c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4e4871700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015d2a0 con 0x7fd4e00ccb00 2023-06-09T07:04:17.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4e4871700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015d580 con 0x7fd4e015fdf0 2023-06-09T07:04:17.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4e4871700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e015d860 con 0x7fd4e00b43f0 2023-06-09T07:04:17.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4ddd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4e00ccb00 0x7fd4e015cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.674 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4ddd9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4e00ccb00 0x7fd4e015cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:48124/0 (socket says 172.21.15.149:48124) 2023-06-09T07:04:17.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4ddd9b700 1 -- 172.21.15.149:0/2314816085 learned_addr learned my addr 172.21.15.149:0/2314816085 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T07:04:17.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4de59c700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 0x7fd4e01f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.667+0000 7fd4ddd9b700 1 -- 172.21.15.149:0/2314816085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 msgr2=0x7fd4e01f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ddd9b700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 0x7fd4e01f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ddd9b700 1 -- 172.21.15.149:0/2314816085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e015fdf0 msgr2=0x7fd4e00c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ddd9b700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e015fdf0 0x7fd4e00c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.675 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ddd9b700 1 -- 172.21.15.149:0/2314816085 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40094a0 con 0x7fd4e00ccb00 2023-06-09T07:04:17.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ddd9b700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4e00ccb00 0x7fd4e015cb90 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40090b0 tx=0x7fd4d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:17.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ceffd700 1 -- 172.21.15.149:0/2314816085 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d40038a0 con 0x7fd4e00ccb00 2023-06-09T07:04:17.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ceffd700 1 -- 172.21.15.149:0/2314816085 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d401f070 con 0x7fd4e00ccb00 2023-06-09T07:04:17.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4ceffd700 1 -- 172.21.15.149:0/2314816085 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4003c60 con 0x7fd4e00ccb00 2023-06-09T07:04:17.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e00ca950 con 0x7fd4e00ccb00 2023-06-09T07:04:17.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.668+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e00c90a0 con 0x7fd4e00ccb00 2023-06-09T07:04:17.676 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.669+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e00cab10 con 0x7fd4e00ccb00 2023-06-09T07:04:17.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.670+0000 7fd4ceffd700 1 -- 172.21.15.149:0/2314816085 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd4d401a430 con 0x7fd4e00ccb00 2023-06-09T07:04:17.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.670+0000 7fd4ceffd700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd4c006ad10 0x7fd4c006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:17.677 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.670+0000 7fd4ceffd700 1 -- 172.21.15.149:0/2314816085 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fd4d4021070 con 0x7fd4e00ccb00 2023-06-09T07:04:17.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.670+0000 7fd4de59c700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd4c006ad10 0x7fd4c006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:17.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.670+0000 7fd4de59c700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd4c006ad10 0x7fd4c006d1c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009a10 tx=0x7fd4d0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:17.678 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.674+0000 7fd4ceffd700 1 -- 172.21.15.149:0/2314816085 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd4d4056040 con 0x7fd4e00ccb00 2023-06-09T07:04:17.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.909+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd4e00b88c0 con 0x7fd4e00ccb00 2023-06-09T07:04:17.913 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.909+0000 7fd4ceffd700 1 -- 172.21.15.149:0/2314816085 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd4d4059660 con 0x7fd4e00ccb00 2023-06-09T07:04:17.914 INFO:teuthology.orchestra.run.smithi149.stdout:pg_num: 64 2023-06-09T07:04:17.915 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.912+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd4c006ad10 msgr2=0x7fd4c006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.912+0000 7fd4e4871700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd4c006ad10 0x7fd4c006d1c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009a10 tx=0x7fd4d0009190 comp rx=0 tx=0).stop 2023-06-09T07:04:17.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.912+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4e00ccb00 msgr2=0x7fd4e015cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:17.916 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.912+0000 7fd4e4871700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4e00ccb00 0x7fd4e015cb90 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40090b0 tx=0x7fd4d4004750 comp rx=0 tx=0).stop 2023-06-09T07:04:17.919 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 shutdown_connections 2023-06-09T07:04:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7fd4c006ad10 0x7fd4c006d1c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7fd4e00b43f0 0x7fd4e01f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd4e015fdf0 0x7fd4e00c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 --2- 172.21.15.149:0/2314816085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd4e00ccb00 0x7fd4e015cb90 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 >> 172.21.15.149:0/2314816085 conn(0x7fd4e0072120 msgr2=0x7fd4e00b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:17.920 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 shutdown_connections 2023-06-09T07:04:17.921 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:17.916+0000 7fd4e4871700 1 -- 172.21.15.149:0/2314816085 wait complete. 2023-06-09T07:04:17.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T07:04:18.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.088+0000 7f960bbde700 1 Processor -- start 2023-06-09T07:04:18.092 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.088+0000 7f960bbde700 1 -- start start 2023-06-09T07:04:18.093 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f960bbde700 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f96040b43f0 0x7f96040b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:18.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f960bbde700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040cd430 0x7f96040d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:18.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f960bbde700 1 -- --> v1:172.21.15.149:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040cf690 con 0x7f96040ccfc0 2023-06-09T07:04:18.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f960bbde700 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040d0180 con 0x7f96040b43f0 2023-06-09T07:04:18.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f960bbde700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040d0770 con 0x7f96040cd430 2023-06-09T07:04:18.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f9609179700 1 --1- >> v1:172.21.15.149:6789/0 conn(0x7f96040ccfc0 0x7f96040d0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.149:6789/0 says I am v1:172.21.15.149:43764/0 (socket says 172.21.15.149:43764) 2023-06-09T07:04:18.094 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f9609179700 1 -- 172.21.15.149:0/397771825 learned_addr learned my addr 172.21.15.149:0/397771825 (peer_addr_for_me v1:172.21.15.149:0/0) 2023-06-09T07:04:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f960997a700 1 --2- 172.21.15.149:0/397771825 >> v2:172.21.15.184:3300/0 conn(0x7f96040b43f0 0x7f96040b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f960a17b700 1 --2- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040cd430 0x7f96040d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f9608978700 1 -- 172.21.15.149:0/397771825 <== mon.0 v1:172.21.15.149:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369565686 0 0) 0x7f96040cf690 con 0x7f96040ccfc0 2023-06-09T07:04:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.089+0000 7f9608978700 1 -- 172.21.15.149:0/397771825 --> v1:172.21.15.149:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f00035b0 con 0x7f96040ccfc0 2023-06-09T07:04:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f960997a700 1 -- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040cd430 msgr2=0x7f96040d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T07:04:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f960997a700 1 --2- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040cd430 0x7f96040d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.095 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f960997a700 1 -- 172.21.15.149:0/397771825 >> v1:172.21.15.149:6789/0 conn(0x7f96040ccfc0 legacy=0x7f96040d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f960997a700 1 -- 172.21.15.149:0/397771825 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040b4d00 con 0x7f96040b43f0 2023-06-09T07:04:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f960a17b700 1 --2- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040cd430 0x7f96040d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T07:04:18.096 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f960997a700 1 --2- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040b43f0 0x7f96040b47c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009de0 tx=0x7f95fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21505c81c091a767 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f9608978700 1 -- 172.21.15.149:0/397771825 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00e070 con 0x7f96040b43f0 2023-06-09T07:04:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f9608978700 1 -- 172.21.15.149:0/397771825 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00bb20 con 0x7f96040b43f0 2023-06-09T07:04:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.090+0000 7f9608978700 1 -- 172.21.15.149:0/397771825 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc012430 con 0x7f96040b43f0 2023-06-09T07:04:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 -- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040b43f0 msgr2=0x7f96040b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:18.097 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 --2- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040b43f0 0x7f96040b47c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f95fc009de0 tx=0x7f95fc00b330 comp rx=0 tx=0).stop 2023-06-09T07:04:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 -- 172.21.15.149:0/397771825 shutdown_connections 2023-06-09T07:04:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 --2- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040cd430 0x7f96040d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 --2- 172.21.15.149:0/397771825 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040b43f0 0x7f96040b47c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 -- 172.21.15.149:0/397771825 >> 172.21.15.149:0/397771825 conn(0x7f960406afb0 msgr2=0x7f960406b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 -- 172.21.15.149:0/397771825 shutdown_connections 2023-06-09T07:04:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.091+0000 7f960bbde700 1 -- 172.21.15.149:0/397771825 wait complete. 2023-06-09T07:04:18.098 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.093+0000 7f960bbde700 1 Processor -- start 2023-06-09T07:04:18.099 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.093+0000 7f960bbde700 1 -- start start 2023-06-09T07:04:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f960bbde700 1 --2- >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040b43f0 0x7f96041f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f960bbde700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040ccfc0 0x7f96041585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f960bbde700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96040cd430 0x7f96041e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f960bbde700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604159070 con 0x7f96040cd430 2023-06-09T07:04:18.100 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f960bbde700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604159350 con 0x7f96040ccfc0 2023-06-09T07:04:18.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f960bbde700 1 -- --> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604159630 con 0x7f96040b43f0 2023-06-09T07:04:18.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f9609179700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040ccfc0 0x7f96041585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:18.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f9609179700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040ccfc0 0x7f96041585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.149:39170/0 (socket says 172.21.15.149:39170) 2023-06-09T07:04:18.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.094+0000 7f9609179700 1 -- 172.21.15.149:0/2649191782 learned_addr learned my addr 172.21.15.149:0/2649191782 (peer_addr_for_me v2:172.21.15.149:0/0) 2023-06-09T07:04:18.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960a17b700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96040cd430 0x7f96041e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:18.101 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960997a700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040b43f0 0x7f96041f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:18.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960a17b700 1 -- 172.21.15.149:0/2649191782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040b43f0 msgr2=0x7f96041f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:18.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960a17b700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040b43f0 0x7f96041f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960a17b700 1 -- 172.21.15.149:0/2649191782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040ccfc0 msgr2=0x7f96041585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:18.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960a17b700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040ccfc0 0x7f96041585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960a17b700 1 -- 172.21.15.149:0/2649191782 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40094a0 con 0x7f96040cd430 2023-06-09T07:04:18.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.095+0000 7f960a17b700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96040cd430 0x7f96041e38c0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f95f400e910 tx=0x7f95f400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:18.102 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.096+0000 7f95fa7fc700 1 -- 172.21.15.149:0/2649191782 <== mon.0 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400ee60 con 0x7f96040cd430 2023-06-09T07:04:18.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.096+0000 7f95fa7fc700 1 -- 172.21.15.149:0/2649191782 <== mon.0 v2:172.21.15.149:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4004020 con 0x7f96040cd430 2023-06-09T07:04:18.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.096+0000 7f95fa7fc700 1 -- 172.21.15.149:0/2649191782 <== mon.0 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40043d0 con 0x7f96040cd430 2023-06-09T07:04:18.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.096+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc009a70 con 0x7f96040cd430 2023-06-09T07:04:18.103 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.096+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96041f19d0 con 0x7f96040cd430 2023-06-09T07:04:18.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.097+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9604159e30 con 0x7f96040cd430 2023-06-09T07:04:18.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.097+0000 7f95fa7fc700 1 -- 172.21.15.149:0/2649191782 <== mon.0 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95f400c850 con 0x7f96040cd430 2023-06-09T07:04:18.104 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.098+0000 7f95fa7fc700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f95e806ace0 0x7f95e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T07:04:18.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.098+0000 7f95fa7fc700 1 -- 172.21.15.149:0/2649191782 <== mon.0 v2:172.21.15.149:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f95f4089280 con 0x7f96040cd430 2023-06-09T07:04:18.107 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.098+0000 7f960997a700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f95e806ace0 0x7f95e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T07:04:18.108 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.104+0000 7f95fa7fc700 1 -- 172.21.15.149:0/2649191782 <== mon.0 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9604159e30 con 0x7f96040cd430 2023-06-09T07:04:18.109 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.105+0000 7f960997a700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f95e806ace0 0x7f95e806d190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f95fc014040 tx=0x7f95fc011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T07:04:18.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.374+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9604159e30 con 0x7f96040cd430 2023-06-09T07:04:18.378 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.375+0000 7f95fa7fc700 1 -- 172.21.15.149:0/2649191782 <== mon.0 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9604159e30 con 0x7f96040cd430 2023-06-09T07:04:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f95e806ace0 msgr2=0x7f95e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f95e806ace0 0x7f95e806d190 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f95fc014040 tx=0x7f95fc011000 comp rx=0 tx=0).stop 2023-06-09T07:04:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96040cd430 msgr2=0x7f96041e38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T07:04:18.381 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96040cd430 0x7f96041e38c0 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f95f400e910 tx=0x7f95f400ec20 comp rx=0 tx=0).stop 2023-06-09T07:04:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 shutdown_connections 2023-06-09T07:04:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:6832/2920572545,v1:172.21.15.149:6833/2920572545] conn(0x7f95e806ace0 0x7f95e806d190 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.184:3301/0,v1:172.21.15.184:6790/0] conn(0x7f96040b43f0 0x7f96041f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96040cd430 0x7f96041e38c0 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 --2- 172.21.15.149:0/2649191782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f96040ccfc0 0x7f96041585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T07:04:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 >> 172.21.15.149:0/2649191782 conn(0x7f960406afb0 msgr2=0x7f96040b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T07:04:18.382 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 shutdown_connections 2023-06-09T07:04:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:2023-06-09T07:04:18.377+0000 7f960bbde700 1 -- 172.21.15.149:0/2649191782 wait complete. 2023-06-09T07:04:18.383 INFO:teuthology.orchestra.run.smithi149.stderr:listed 0 entries 2023-06-09T07:04:18.397 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T07:04:18.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T07:04:18.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-09T07:04:18.448 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T07:04:18.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T07:04:18.449 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T07:04:18.495 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2023-06-09T07:04:18.495 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T07:04:18.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=8026740k,nr_inodes=2006685,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1543 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=1609048k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.149:6789:/test /tmp/tmp.p05IS5EmxFtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=8958df92-450c-4c1c-8166-a5a3573afffd,acl 0 0 172.21.15.149:6789:/scratch /tmp/tmp.37bCAzag0Bscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=8958df92-450c-4c1c-8166-a5a3573afffd,acl 0 0 2023-06-09T07:04:18.522 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi149.front.sepia.ceph.com 2023-06-09T07:04:18.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T07:04:18.522 DEBUG:teuthology.orchestra.run.smithi149:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T07:04:18.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T07:04:18.580 INFO:teuthology.orchestra.run.smithi149.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-09T07:04:18.580 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T07:04:18.580 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T07:04:18.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3392 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-09T07:04:18.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T07:04:18.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T07:04:18.934 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T07:04:19.071 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-09T07:04:19.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T07:04:19.072 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2023-06-09T07:04:19.072 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T07:04:19.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3392 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-06-09T07:04:19.230 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi184.front.sepia.ceph.com 2023-06-09T07:04:19.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T07:04:19.231 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T07:04:19.310 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T07:04:19.310 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-09T07:04:20.917 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-09T07:04:20.918 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-09T07:04:20.918 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-09T07:04:20.918 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-09T07:04:20.919 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-09T07:04:20.919 INFO:tasks.ceph.osd.6:Sent signal 15 2023-06-09T07:04:20.919 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-09T07:04:20.919 INFO:tasks.ceph.mds.a:Sent signal 15 2023-06-09T07:04:20.920 INFO:tasks.ceph.mds.c:Sent signal 15 2023-06-09T07:04:20.920 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-09T07:04:20.920 INFO:tasks.ceph.mds.d:Sent signal 15 2023-06-09T07:04:20.921 INFO:tasks.ceph.mon.a:Sent signal 15 2023-06-09T07:04:20.921 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-09T07:04:20.921 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-09T07:04:20.921 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-09T07:04:20.922 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-09T07:04:20.922 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T07:04:20.915+0000 7f70361b3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 100553) UID: 0 2023-06-09T07:04:20.922 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T07:04:20.915+0000 7f70361b3700 -1 osd.4 45 *** Got signal Terminated *** 2023-06-09T07:04:20.923 INFO:tasks.ceph.osd.4.smithi184.stderr:2023-06-09T07:04:20.915+0000 7f70361b3700 -1 osd.4 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T07:04:20.923 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T07:04:20.915+0000 7fc102cf8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 100556) UID: 0 2023-06-09T07:04:20.923 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T07:04:20.915+0000 7fc102cf8700 -1 osd.5 45 *** Got signal Terminated *** 2023-06-09T07:04:20.923 INFO:tasks.ceph.osd.5.smithi184.stderr:2023-06-09T07:04:20.915+0000 7fc102cf8700 -1 osd.5 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T07:04:20.924 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T07:04:20.917+0000 7f5a931e5700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 100559) UID: 0 2023-06-09T07:04:20.924 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T07:04:20.917+0000 7f5a931e5700 -1 osd.6 45 *** Got signal Terminated *** 2023-06-09T07:04:20.924 INFO:tasks.ceph.osd.6.smithi184.stderr:2023-06-09T07:04:20.917+0000 7f5a931e5700 -1 osd.6 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T07:04:20.924 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T07:04:20.917+0000 7fd1388f4700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 107638) UID: 0 2023-06-09T07:04:20.924 INFO:tasks.ceph.mds.b.smithi184.stderr:2023-06-09T07:04:20.917+0000 7fd1388f4700 -1 mds.b *** got signal Terminated *** 2023-06-09T07:04:20.925 INFO:tasks.ceph.mon.b.smithi184.stderr:2023-06-09T07:04:20.917+0000 7f3f5e96f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 99904) UID: 0 2023-06-09T07:04:20.925 INFO:tasks.ceph.mon.b.smithi184.stderr:2023-06-09T07:04:20.917+0000 7f3f5e96f700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-06-09T07:04:20.925 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T07:04:20.917+0000 7f46ca054700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 107639) UID: 0 2023-06-09T07:04:20.926 INFO:tasks.ceph.mds.d.smithi184.stderr:2023-06-09T07:04:20.917+0000 7f46ca054700 -1 mds.d *** got signal Terminated *** 2023-06-09T07:04:20.926 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T07:04:20.918+0000 7fe30460e700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 100561) UID: 0 2023-06-09T07:04:20.926 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T07:04:20.918+0000 7fe30460e700 -1 osd.7 45 *** Got signal Terminated *** 2023-06-09T07:04:20.926 INFO:tasks.ceph.osd.7.smithi184.stderr:2023-06-09T07:04:20.918+0000 7fe30460e700 -1 osd.7 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T07:04:20.927 INFO:tasks.ceph.mon.c.smithi184.stderr:2023-06-09T07:04:20.918+0000 7fccf1039700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 99906) UID: 0 2023-06-09T07:04:20.927 INFO:tasks.ceph.mon.c.smithi184.stderr:2023-06-09T07:04:20.918+0000 7fccf1039700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-09T07:04:20.927 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T07:04:20.914+0000 7fa27a023700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 100469) UID: 0 2023-06-09T07:04:20.927 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T07:04:20.914+0000 7fa27a023700 -1 osd.1 45 *** Got signal Terminated *** 2023-06-09T07:04:20.928 INFO:tasks.ceph.osd.1.smithi149.stderr:2023-06-09T07:04:20.914+0000 7fa27a023700 -1 osd.1 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T07:04:20.928 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T07:04:20.915+0000 7f9fc24c4700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 100470) UID: 0 2023-06-09T07:04:20.928 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T07:04:20.915+0000 7f9fc24c4700 -1 osd.2 45 *** Got signal Terminated *** 2023-06-09T07:04:20.928 INFO:tasks.ceph.osd.2.smithi149.stderr:2023-06-09T07:04:20.915+0000 7f9fc24c4700 -1 osd.2 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T07:04:20.929 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T07:04:20.915+0000 7f18d4cee700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 100477) UID: 0 2023-06-09T07:04:20.929 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T07:04:20.915+0000 7f18d4cee700 -1 osd.3 45 *** Got signal Terminated *** 2023-06-09T07:04:20.929 INFO:tasks.ceph.osd.3.smithi149.stderr:2023-06-09T07:04:20.915+0000 7f18d4cee700 -1 osd.3 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T07:04:20.929 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-06-09T07:04:20.916+0000 7f0ede4d8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 116187) UID: 0 2023-06-09T07:04:20.930 INFO:tasks.ceph.mds.a.smithi149.stderr:2023-06-09T07:04:20.916+0000 7f0ede4d8700 -1 mds.a *** got signal Terminated *** 2023-06-09T07:04:20.930 INFO:tasks.ceph.mds.c.smithi149.stderr:2023-06-09T07:04:20.917+0000 7f886cc94700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 116188) UID: 0 2023-06-09T07:04:20.930 INFO:tasks.ceph.mds.c.smithi149.stderr:2023-06-09T07:04:20.917+0000 7f886cc94700 -1 mds.c *** got signal Terminated *** 2023-06-09T07:04:20.930 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-06-09T07:04:20.918+0000 7f4f2cc82700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 100124) UID: 0 2023-06-09T07:04:20.930 INFO:tasks.ceph.mon.a.smithi149.stderr:2023-06-09T07:04:20.918+0000 7f4f2cc82700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-06-09T07:04:20.931 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T07:04:20.919+0000 7f3f66ebf700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 100167) UID: 0 2023-06-09T07:04:20.931 INFO:tasks.ceph.mgr.y.smithi149.stderr:2023-06-09T07:04:20.919+0000 7f3f66ebf700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-06-09T07:04:21.123 INFO:tasks.ceph.mgr.x.smithi184.stderr:daemon-helper: command crashed with signal 15 2023-06-09T07:10:02.452 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:02.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:02.578 INFO:teuthology.orchestra.run.smithi184.stderr:ceph-mds: no process found 2023-06-09T07:12:38.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:12:38.725 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:08.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:08.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:38.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:13:39.002 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:09.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:09.127 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:39.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:14:39.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:09.340 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:09.343 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:39.485 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:15:39.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:09.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:09.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:39.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:16:39.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:09.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:09.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:40.051 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:17:40.054 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:10.180 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:10.183 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:40.333 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:18:40.336 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:10.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:10.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:40.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:19:40.637 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:10.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:10.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:40.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:20:40.968 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:11.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:11.030 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:41.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:21:41.176 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:11.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:11.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:41.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:22:41.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:11.618 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:11.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:41.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:23:41.757 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:11.883 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:11.886 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:42.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:24:42.027 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:12.200 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:12.203 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:42.361 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:25:42.365 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:12.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:12.525 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:42.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:26:42.681 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:12.789 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:12.793 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:42.967 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:42.970 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:13.105 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:13.108 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:43.242 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:28:43.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:13.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:13.392 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:43.533 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:29:43.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:13.695 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:13.698 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:43.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:30:43.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:13.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:13.972 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:44.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:31:44.102 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:14.283 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:14.286 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:44.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:32:44.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:14.594 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:14.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:44.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:33:44.733 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:14.867 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:14.870 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:44.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:34:44.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:15.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:15.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:45.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:35:45.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:15.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:15.468 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:45.593 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:36:45.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:15.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:15.724 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:45.868 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:37:45.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:16.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:16.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:46.141 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:38:46.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:16.290 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:16.293 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:46.425 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:39:46.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:16.561 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:16.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:46.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:40:46.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:16.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:16.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:47.072 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:41:47.075 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:17.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:17.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:47.382 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:42:47.385 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:17.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:17.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:47.663 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:43:47.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:17.808 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:17.811 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:47.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:44:47.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:18.048 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:18.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:48.195 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:45:48.198 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:18.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:18.334 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:48.476 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:46:48.479 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:18.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:18.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:48.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:47:48.770 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:18.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:18.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:49.041 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:48:49.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:19.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:19.185 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:49.323 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:49:49.326 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:19.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:19.474 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:49.607 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:50:49.610 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:19.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:19.757 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:49.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:51:49.901 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:20.026 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:20.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:50.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:52:50.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:20.335 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:20.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:50.489 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:53:50.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:20.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:20.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:50.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:54:50.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:20.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:20.937 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:51.077 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:55:51.080 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:21.207 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:21.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:51.365 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:56:51.368 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:21.489 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:21.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:51.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:57:51.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:21.755 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:21.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:51.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:58:51.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:22.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:22.043 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:52.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:59:52.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:22.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:22.344 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:52.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:00:52.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:22.627 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:22.630 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:52.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:01:52.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:22.928 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:22.931 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:53.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:53.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:23.221 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:23.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:53.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:03:53.361 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:23.524 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:23.527 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:53.662 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:04:53.665 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:23.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:23.803 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:53.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:05:53.957 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:24.178 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:24.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:54.405 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:06:54.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:24.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:24.530 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:54.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:07:54.670 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:24.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:24.799 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:54.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:08:54.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:25.053 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:25.056 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:55.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:09:55.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:25.336 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:25.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:55.502 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:10:55.505 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:25.683 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:25.686 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:55.839 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:11:55.842 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:26.001 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:26.004 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:56.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:12:56.150 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:26.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:26.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:56.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:13:56.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:26.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:26.577 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:56.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:14:56.739 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:26.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:26.876 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:57.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:15:57.046 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:27.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:27.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:57.293 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:16:57.295 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:27.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:27.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:57.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:17:57.532 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:27.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:27.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:57.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:18:57.828 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:27.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:27.989 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:58.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:19:58.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:28.278 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:28.280 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:58.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:20:58.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:28.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:28.571 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:58.723 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:21:58.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:28.909 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:28.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:59.061 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:22:59.064 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:29.183 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:29.186 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:59.320 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:23:59.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:29.450 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:29.453 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:59.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:24:59.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:29.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:29.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:59.965 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:25:59.968 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:30.104 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:26:30.106 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:00.235 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:00.237 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:30.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:27:30.391 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:00.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:00.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:30.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:28:30.674 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:00.929 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:00.932 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:31.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:29:31.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:01.332 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:01.335 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:31.494 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:31.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:01.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:01.642 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:31.786 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:31:31.789 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:01.905 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:01.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:32.021 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:32:32.024 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:02.163 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:02.166 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:32.291 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:33:32.294 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:02.445 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:02.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:32.582 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:34:32.585 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:02.727 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:02.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:32.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:35:32.876 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:03.029 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:03.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:33.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:36:33.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:03.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:03.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:33.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:37:33.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:03.576 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:03.579 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:33.813 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:38:33.816 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:03.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:03.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:34.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:39:34.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:04.186 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:04.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:34.328 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:40:34.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:04.486 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:04.489 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:34.625 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:41:34.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:04.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:04.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:34.926 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:42:34.930 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:05.081 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:05.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:35.225 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:43:35.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:05.370 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:05.373 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:35.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:44:35.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:05.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:05.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:35.796 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:45:35.845 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:05.985 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:05.988 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:36.123 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:46:36.125 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:06.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:06.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:36.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:47:36.407 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:06.541 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:06.544 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:36.688 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:36.691 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:06.833 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:06.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:37.017 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:49:37.020 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:07.173 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:07.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:37.318 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:50:37.321 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:07.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:07.468 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:37.613 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:51:37.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:07.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:07.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:38.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:52:38.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:08.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:08.249 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:38.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:53:38.386 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:08.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:08.506 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:38.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:38.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:08.811 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:08.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:38.948 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:55:38.951 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:09.093 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:09.096 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:39.230 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:56:39.233 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:09.375 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:09.378 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:39.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:57:39.515 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:09.667 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:09.670 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:39.803 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:58:39.806 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:09.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:09.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:40.098 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:40.101 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:10.228 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:10.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:40.386 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:00:40.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:10.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:10.566 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:40.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:01:40.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:10.824 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:10.827 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:40.958 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:02:40.961 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:11.121 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:11.124 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:41.271 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:41.274 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:11.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:11.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:41.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:41.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:11.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:11.680 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:41.824 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:41.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:11.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:11.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:42.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:42.099 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:12.251 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:12.254 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:42.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:42.390 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:12.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:12.511 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:42.664 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:42.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:12.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:12.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:42.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:42.989 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:13.145 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:13.148 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:43.302 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:43.304 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:13.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:13.449 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:43.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:11:43.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:13.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:13.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:43.893 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:12:43.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:14.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:14.034 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:44.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:13:44.168 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:14.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:14.314 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:44.465 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:14:44.468 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:14.593 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:14.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:44.739 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:44.742 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:14.911 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:14.914 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:45.082 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:45.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:15.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:15.236 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:45.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:45.366 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:15.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:15.478 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:45.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:45.606 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:15.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:15.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:45.902 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:45.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:16.041 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:16.044 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:46.195 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:46.198 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:16.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:16.366 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:46.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:46.496 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:16.621 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:16.624 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:46.770 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:46.772 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:16.920 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:16.923 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:47.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:47.078 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:17.228 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:17.230 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:47.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:24:47.361 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:17.497 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:17.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:47.622 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:25:47.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:17.773 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:17.776 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:47.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:26:47.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:18.025 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:18.028 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:48.164 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:48.167 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:18.316 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:18.319 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:48.454 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:28:48.457 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:18.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:18.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:48.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:29:48.754 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:18.897 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:18.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:49.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:30:49.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:19.222 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:19.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:49.367 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:31:49.370 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:19.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:19.526 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:49.678 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:32:49.681 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:19.824 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:19.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:49.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:33:49.973 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:20.108 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:20.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:50.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:34:50.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:20.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:20.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:50.589 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:35:50.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:20.760 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:20.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:50.898 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:50.901 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:21.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:21.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:51.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:37:51.095 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:21.239 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:21.242 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:51.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:38:51.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:21.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:21.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:51.635 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:39:51.638 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:21.764 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:21.766 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:51.922 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:51.924 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:22.063 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:22.066 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:52.415 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:41:52.418 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:22.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:22.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:52.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:42:52.677 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:22.821 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:22.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:52.968 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:43:52.971 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:23.131 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:23.134 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:53.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:53.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:23.432 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:23.435 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:53.596 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:45:53.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:23.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:23.761 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:53.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:46:53.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:24.085 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:24.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:54.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:47:54.234 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:24.386 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:24.427 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:54.578 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:48:54.580 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:24.748 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:24.752 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:54.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:54.904 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:25.064 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:25.067 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:55.192 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:50:55.195 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:25.338 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:25.341 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:55.492 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:51:55.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:25.620 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:25.623 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:55.830 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:52:55.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:25.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:25.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:56.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:56.076 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:26.244 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:26.246 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:56.364 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:56.367 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:26.484 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:26.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:56.651 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:55:56.654 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:26.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:26.825 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:56.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:56:56.999 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:27.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:27.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:57.244 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:57:57.247 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:27.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:27.386 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:57.522 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:57.524 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:27.677 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:27.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:57.815 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:59:57.817 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:27.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:27.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:58.099 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:00:58.102 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:28.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:28.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:58.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:01:58.424 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:28.557 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:28.559 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:58.692 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:58.695 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:28.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:28.853 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:58.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:03:58.994 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:29.128 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:29.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:59.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:04:59.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:29.593 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:29.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:59.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:05:59.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:29.910 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:29.913 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:00.079 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:00.082 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:30.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:07:30.236 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:00.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:00.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:30.499 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:08:30.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:00.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:00.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:30.807 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:09:30.810 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:00.943 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:00.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:31.090 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:10:31.093 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:01.243 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:01.246 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:31.419 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:31.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:01.567 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:01.570 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:31.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:31.715 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:01.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:01.869 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:32.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:32.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:02.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:02.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:32.294 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:32.297 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:02.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:02.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:32.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:32.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:02.754 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:02.758 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:32.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:16:32.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:03.062 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:03.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:33.210 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:17:33.213 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:03.354 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:03.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:33.495 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:18:33.498 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:03.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:03.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:33.745 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:33.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:03.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:03.899 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:34.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:20:34.034 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:04.168 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:04.171 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:34.306 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:21:34.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:04.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:04.456 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:34.765 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:22:34.768 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:04.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:04.916 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:35.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:23:35.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:05.189 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:05.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:35.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:35.381 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:05.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:05.519 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:35.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:35.674 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:05.826 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:05.829 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:35.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:35.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:06.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:06.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:36.298 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:36.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:06.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:06.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:36.584 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:36.587 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:06.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:06.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:36.901 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:36.904 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:07.056 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:07.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:37.203 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:37.206 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:07.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:07.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:37.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:37.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:07.626 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:07.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:37.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:37.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:07.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:07.916 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:38.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:33:38.060 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:08.202 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:08.204 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:38.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:34:38.345 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:08.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:08.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:38.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:35:38.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:08.757 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:08.760 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:38.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:38.914 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:09.049 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:09.052 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:39.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:37:39.199 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:09.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:09.345 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:39.489 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:38:39.492 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:09.622 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:09.626 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:39.784 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:39:39.787 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:09.937 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:09.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:40.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:40.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:10.196 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:10.199 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:40.350 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:40.353 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:10.506 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:10.511 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:40.653 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:42:40.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:10.807 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:10.811 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:40.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:43:40.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:11.084 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:11.087 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:41.255 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:44:41.257 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:11.400 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:11.403 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:41.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:41.534 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:11.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:11.697 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:41.841 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:46:41.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:11.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:11.982 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:42.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:47:42.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:12.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:12.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:42.402 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:48:42.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:12.531 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:12.534 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:42.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:42.698 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:12.822 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:12.825 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:42.951 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:50:42.954 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:13.104 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:13.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:43.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:51:43.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:13.404 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:13.408 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:43.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:52:43.553 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:13.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:13.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:43.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:53:43.989 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:14.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:14.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:44.273 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:44.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:14.418 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:14.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:44.564 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:44.567 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:14.708 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:14.711 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:44.871 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:44.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:15.016 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:15.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:45.153 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:57:45.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:15.308 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:15.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:45.474 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:58:45.476 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:15.622 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:15.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:45.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:59:45.761 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:15.896 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:15.899 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:46.026 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:46.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:16.172 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:16.175 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:46.333 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:46.337 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:16.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:16.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:46.632 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:46.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:16.792 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:16.795 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:46.863 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:46.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:17.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:17.014 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:47.165 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:47.167 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:17.305 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:17.308 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:47.458 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:47.461 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:17.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:17.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:47.766 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:47.769 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:17.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:17.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:48.053 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:48.056 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:18.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:18.184 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:48.327 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:48.331 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:18.482 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:18.485 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:48.652 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:48.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:18.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:18.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:48.943 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:48.946 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:19.094 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:19.100 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:49.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:11:49.351 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:19.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:19.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:49.557 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:12:49.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:19.695 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:19.698 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:49.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:13:49.853 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:19.998 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:20.001 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:50.153 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:50.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:20.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:20.288 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:50.430 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:15:50.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:20.551 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:20.555 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:50.712 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:16:50.715 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:20.919 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:20.922 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:51.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:17:51.042 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:21.156 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:21.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:51.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:51.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:21.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:21.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:51.610 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:51.612 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:21.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:21.750 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:52.027 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:52.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:22.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:22.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:52.236 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:52.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:22.375 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:22.379 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:52.538 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:22:52.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:22.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:22.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:52.797 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:23:52.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:22.934 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:22.937 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:53.275 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:24:53.277 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:23.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:23.420 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:53.540 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:25:53.542 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:23.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:23.604 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:53.747 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:53.750 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:23.882 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:23.884 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:54.013 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:27:54.016 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:24.149 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:24.151 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:54.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:28:54.298 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:24.442 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:24.445 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:54.561 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:29:54.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:24.707 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:24.710 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:54.903 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:30:54.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:25.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:25.030 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:55.241 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:55.244 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:25.373 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:25.376 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:55.526 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:32:55.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:25.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:25.658 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:55.785 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:33:55.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:25.932 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:25.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:56.066 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:34:56.069 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:26.218 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:26.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:56.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:35:56.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:26.536 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:26.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:56.714 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:36:56.717 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:26.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:26.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:57.158 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:37:57.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:27.353 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:27.356 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:57.500 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:38:57.502 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:27.641 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:27.644 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:57.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:39:57.714 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:27.840 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:27.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:57.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:40:57.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:28.073 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:28.076 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:58.211 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:41:58.214 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:28.349 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:28.352 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:58.471 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:42:58.474 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:28.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:28.612 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:58.758 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:58.761 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:28.894 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:28.897 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:59.040 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:44:59.043 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:29.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:29.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:59.314 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:45:59.317 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:29.446 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:29.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:59.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:46:59.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:29.750 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:29.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:59.924 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:47:59.927 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:30.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:48:30.078 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:00.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:00.249 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:30.374 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:49:30.377 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:00.519 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:00.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:30.674 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:50:30.677 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:00.828 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:00.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:30.975 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:30.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:01.151 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:01.154 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:31.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:31.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:01.431 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:01.434 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:31.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:31.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:01.724 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:01.727 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:31.887 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:31.890 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:02.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:02.028 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:32.161 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:32.163 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:02.297 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:02.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:32.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:32.451 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:02.639 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:02.642 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:32.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:32.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:02.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:02.941 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:33.067 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:33.070 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:03.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:03.208 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:33.357 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:33.360 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:03.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:03.500 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:33.631 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:33.634 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:03.752 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:03.755 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:33.905 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:33.908 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:03.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:03.995 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:34.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:34.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:04.270 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:04.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:34.395 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:34.398 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:04.546 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:04.549 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:34.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:34.706 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:04.838 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:04.841 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:34.994 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:34.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:05.139 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:05.142 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:35.287 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:35.290 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:05.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:05.449 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:35.608 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:35.611 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:05.751 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:05.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:35.889 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:35.892 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:06.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:06.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:36.182 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:36.185 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:06.338 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:06.340 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:36.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:36.459 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:06.588 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:06.591 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:36.756 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:36.771 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:06.914 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:06.917 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:37.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:37.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:07.233 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:07.236 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:37.429 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:37.432 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:07.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:07.569 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:37.679 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:37.682 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:07.824 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:07.827 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:37.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:37.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:08.112 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:08.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:38.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:38.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:08.406 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:08.409 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:38.552 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:38.554 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:08.681 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:08.684 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:38.819 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:38.822 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:08.999 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:09.002 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:39.162 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:39.165 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:09.250 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:09.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:39.383 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:39.386 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:09.529 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:09.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:39.657 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:39.660 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:09.819 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:09.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:40.033 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:40.035 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:10.177 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:10.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:40.322 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:40.325 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:10.459 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:10.462 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:40.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:40.533 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:10.675 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:10.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:40.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:40.833 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:10.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:10.969 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:41.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:41.106 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:11.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:11.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:41.394 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:41.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:11.532 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:11.535 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:41.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:41.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:11.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:11.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:41.993 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:41.996 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:12.138 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:12.141 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:42.284 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:42.287 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:12.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:12.443 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:42.585 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:42.588 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:12.728 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:12.731 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:42.882 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:42.885 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:13.020 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:13.023 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:43.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:43.288 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:13.434 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:13.437 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:43.589 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:43.594 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:13.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:13.722 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:43.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:43.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:13.992 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:13.995 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:44.124 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:44.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:14.280 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:14.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:44.420 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:44.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:14.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:14.577 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:44.705 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:44.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:14.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:14.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:45.010 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:45.012 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:15.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:15.155 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:45.292 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:45.295 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:15.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:15.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:45.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:45.586 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:15.729 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:15.732 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:45.860 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:45.863 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:15.974 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:15.977 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:46.103 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:46.106 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:16.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:16.265 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:46.407 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:46.409 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:16.543 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:16.547 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:46.706 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:46.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:16.850 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:16.853 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:47.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:47.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:17.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:17.173 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:47.312 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:47.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:17.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:17.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:47.584 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:47.588 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:17.732 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:17.734 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:47.877 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:47.880 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:18.006 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:18.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:48.160 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:48.163 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:18.309 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:18.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:48.443 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:48.445 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:18.602 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:18.605 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:48.741 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:48.744 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:18.879 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:18.882 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:49.008 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:49.010 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:19.146 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:19.149 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:49.384 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:49.387 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:19.510 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:19.513 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:49.660 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:49.663 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:19.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:19.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:49.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:49.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:20.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:20.112 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:50.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:50.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:20.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:20.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:50.554 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:50.557 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:20.716 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:20.719 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:50.870 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:50.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:21.024 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:21.026 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:51.144 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:51.147 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:21.265 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:21.268 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:51.410 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:51.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:21.556 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:21.559 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:51.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:51.697 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:21.840 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:21.843 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:51.996 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:51.998 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:22.141 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:22.213 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:52.355 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:52.358 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:22.512 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:22.515 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:52.656 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:52.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:22.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:22.813 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:52.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:52.994 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:23.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:23.157 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:53.289 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:53.292 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:23.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:23.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:53.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:53.583 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:23.726 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:23.729 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:53.855 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:53.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:24.016 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:24.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:54.171 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:54.174 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:24.308 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:24.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:54.444 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:54.447 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:24.594 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:24.597 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:54.719 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:54.722 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:24.856 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:24.859 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:55.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:55.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:25.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:25.257 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:55.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:55.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:25.537 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:25.540 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:55.668 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:55.670 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:25.815 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:25.818 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:55.966 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:55.969 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:26.119 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:26.122 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:56.271 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:56.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:26.417 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:26.420 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:56.572 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:56.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:26.710 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:26.713 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:56.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:56.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:26.984 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:26.987 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:57.141 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:57.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:27.275 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:27.277 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:57.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:57.415 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:27.574 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:27.577 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:57.780 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:57.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:27.933 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:27.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:58.061 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:58.064 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:28.206 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:28.209 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:58.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:58.346 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:28.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:28.511 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:58.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:58.653 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:28.788 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:28.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:58.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:58.942 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:29.153 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:29.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:59.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:59.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:29.470 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:29.473 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:59.609 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:59.612 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:29.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:29.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:59.915 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:59.918 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:30.056 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:30.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:00.203 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:00.206 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:30.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:30.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:00.504 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:00.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:30.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:30.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:00.940 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:00.943 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:31.091 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:31.094 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:01.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:01.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:31.371 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:31.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:01.493 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:01.496 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:31.631 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:31.634 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:01.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:01.796 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:31.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:31.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:02.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:02.112 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:32.263 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:32.266 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:02.388 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:02.391 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:32.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:32.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:02.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:02.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:32.736 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:32.739 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:02.908 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:02.911 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:33.052 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:33.055 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:03.168 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:03.171 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:33.343 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:33.346 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:03.488 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:03.491 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:33.642 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:33.645 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:03.805 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:03.808 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:33.942 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:33.945 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:04.096 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:04.099 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:34.241 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:34.244 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:04.373 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:04.376 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:34.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:34.526 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:04.652 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:04.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:34.806 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:34.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:05.034 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:05.037 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:35.181 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:35.183 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:05.318 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:05.321 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:35.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:35.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:05.633 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:05.636 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:35.779 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:35.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:05.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:05.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:36.043 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:36.046 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:06.191 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:06.194 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:36.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:36.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:06.456 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:06.459 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:36.594 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:36.596 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:06.739 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:06.742 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:36.876 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:36.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:07.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:07.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:37.166 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:37.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:07.463 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:07.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:37.617 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:37.620 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:07.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:07.763 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:37.907 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:37.910 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:08.060 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:08.063 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:38.184 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:38.187 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:08.310 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:08.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:38.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:38.465 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:08.601 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:08.603 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:38.738 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:38.741 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:08.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:08.869 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:39.012 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:39.015 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:09.174 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:09.177 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:39.345 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:39.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:09.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:09.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:39.676 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:39.679 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:09.815 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:09.818 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:39.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:39.938 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:10.190 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:10.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:40.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:40.288 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:10.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:10.442 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:40.604 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:40.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:10.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:10.765 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:40.916 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:40.919 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:11.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:11.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:41.238 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:41.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:11.386 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:11.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:41.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:41.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:11.694 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:11.697 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:41.847 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:41.849 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:11.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:11.981 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:42.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:42.129 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:12.259 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:12.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:42.422 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:42.425 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:12.566 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:12.569 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:42.720 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:42.722 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:12.875 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:12.877 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:43.021 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:43.024 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:13.167 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:13.170 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:43.302 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:43.305 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:13.447 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:13.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:43.581 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:43.585 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:13.730 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:13.733 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:43.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:43.869 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:14.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:14.007 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:44.157 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:44.160 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:14.312 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:14.315 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:44.449 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:44.452 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:14.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:14.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:44.762 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:44.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:14.885 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:14.888 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:45.031 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:45.034 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:15.202 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:15.205 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:45.348 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:45.351 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:15.420 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:15.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:45.547 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:45.550 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:15.693 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:15.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:45.838 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:45.841 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:15.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:15.975 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:46.112 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:46.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:16.249 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:16.252 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:46.387 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:46.390 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:16.534 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:16.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:46.688 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:46.691 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:16.818 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:16.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:46.960 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:46.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:17.080 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:17.083 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:47.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:47.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:17.378 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:17.381 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:47.516 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:47.519 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:17.637 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:17.640 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:47.792 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:47.795 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:17.953 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:17.956 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:48.107 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:48.137 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:18.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:18.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:48.411 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:48.414 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:18.534 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:18.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:48.655 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:48.659 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:18.793 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:18.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:48.932 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:48.935 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:19.122 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:19.125 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:49.262 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:49.265 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:19.391 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:19.394 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:49.536 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:49.539 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:19.682 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:19.685 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:49.827 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:49.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:19.989 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:19.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:50.137 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:50.140 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:20.285 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:20.288 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:50.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:50.450 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:20.611 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:20.614 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:50.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:50.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:20.905 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:20.908 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:51.050 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:51.053 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:21.203 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:21.206 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:51.298 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:51.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:21.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:21.455 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:51.583 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:51.586 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:21.727 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:21.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:51.866 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:51.869 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:22.002 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:22.006 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:52.148 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:52.152 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:22.286 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:22.290 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:52.428 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:52.431 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:22.562 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:22.567 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:52.711 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:52.717 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:22.783 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:22.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:52.925 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:52.928 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:23.056 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:23.059 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:53.197 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:53.200 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:23.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:23.342 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:53.485 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:53.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:23.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:23.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:53.725 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:53.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:23.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:23.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:53.935 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:53.937 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:24.005 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:24.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:54.143 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:54.146 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:24.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:24.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:54.441 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:54.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:24.603 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:24.606 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:54.759 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:54.762 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:24.913 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:24.916 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:55.059 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:55.062 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:25.194 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:25.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:55.339 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:55.342 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:25.484 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:25.487 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:55.612 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:55.615 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:25.767 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:25.770 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:55.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:55.940 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:26.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:26.094 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:56.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:56.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:26.385 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:26.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:56.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:56.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:26.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:26.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:56.834 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:56.837 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:26.982 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:26.985 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:57.127 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:57.129 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:27.272 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:27.275 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:57.409 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:57.412 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:27.555 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:27.558 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:57.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:57.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:27.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:27.848 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:57.990 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:57.993 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:28.152 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:28.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:58.298 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:58.301 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:28.453 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:28.457 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:58.589 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:58.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:28.734 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:28.737 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:58.872 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:58.875 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:29.016 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:29.019 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:59.153 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:59.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:29.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:29.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:59.437 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:59.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:29.598 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:29.601 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:59.769 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:59.772 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:29.919 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:29.922 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:00.083 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:00.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:30.220 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:30.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:00.375 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:00.378 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:30.530 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:30.533 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:00.659 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:00.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:30.798 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:30.805 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:00.969 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:00.972 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:31.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:31.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:01.232 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:01.235 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:31.392 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:31.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:01.515 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:01.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:31.668 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:31.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:01.823 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:01.825 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:31.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:31.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:02.087 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:02.090 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:32.225 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:32.229 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:02.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:02.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:32.490 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:32.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:02.644 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:02.647 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:32.799 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:32.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:02.936 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:02.939 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:33.075 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:33.078 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:03.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:03.232 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:33.380 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:33.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:03.526 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:03.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:33.677 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:33.680 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:03.809 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:03.812 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:33.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:33.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:04.100 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:04.103 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:34.247 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:34.250 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:04.382 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:04.385 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:34.533 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:34.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:04.686 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:04.689 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:34.835 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:34.838 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:04.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:04.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:35.109 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:35.111 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:05.246 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:05.249 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:35.402 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:35.404 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:05.548 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:05.551 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:35.691 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:35.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:05.845 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:05.848 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:35.991 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:35.994 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:06.125 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:06.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:36.296 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:36.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:06.427 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:06.429 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:36.573 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:36.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:06.704 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:06.707 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:36.871 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:36.873 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:07.045 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:07.047 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:37.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:37.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:07.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:07.571 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:37.720 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:37.723 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:07.865 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:07.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:38.028 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:38.031 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:08.092 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:08.094 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:38.219 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:38.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:08.381 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:08.384 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:38.527 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:38.529 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:08.666 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:08.669 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:38.827 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:38.830 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:08.972 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:08.974 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:39.142 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:39.145 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:09.279 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:09.282 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:39.441 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:39.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:09.578 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:09.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:39.649 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:39.652 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:09.795 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:09.798 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:39.962 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:39.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:10.126 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:10.129 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:40.257 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:40.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:10.411 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:10.413 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:40.580 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:40.582 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:10.737 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:10.740 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:40.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:40.857 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:11.022 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:11.025 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:41.135 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:41.138 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:11.299 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:11.302 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:41.462 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:41.464 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:11.599 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:11.602 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:41.727 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:41.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:11.864 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:11.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:42.018 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:42.021 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:12.175 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:12.178 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:42.359 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:42.362 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:12.520 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:12.523 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:42.668 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:42.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:12.862 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:12.865 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:43.011 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:43.014 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:13.179 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:13.182 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:43.319 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:43.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:13.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:13.479 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:43.647 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:43.650 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:13.776 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:13.779 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:43.922 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:43.925 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:14.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:14.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:44.199 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:44.202 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:14.342 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:14.345 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:44.480 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:44.483 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:14.650 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:14.652 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:44.787 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:44.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:14.941 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:14.944 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:45.069 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:45.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:15.199 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:15.202 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:45.352 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:45.355 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:15.498 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:15.501 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:45.634 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:45.637 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:15.763 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:15.766 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:46.082 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:46.106 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:16.281 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:16.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:46.441 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:46.444 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:16.595 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:16.598 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:46.742 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:46.747 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:16.886 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:16.889 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:47.048 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:47.051 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:17.185 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:17.188 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:47.327 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:47.330 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:17.475 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:17.478 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:47.605 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:47.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:17.735 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:17.738 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:47.821 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:47.824 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:17.960 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:17.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:48.104 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:48.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:18.245 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:18.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:48.386 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:48.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:18.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:18.528 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:48.661 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:48.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:18.807 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:18.809 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:48.960 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:48.963 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:19.097 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:19.101 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:49.229 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:49.231 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:19.376 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:19.380 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:49.533 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:49.536 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:19.662 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:19.665 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:49.825 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:49.828 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:19.970 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:19.973 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:50.115 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:50.119 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:20.260 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:20.263 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:50.435 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:50.438 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:20.568 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:20.572 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:50.701 DEBUG:teuthology.orchestra.run.smithi149:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:50.703 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:56.708 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-09T16:23:56.709 DEBUG:teuthology.task.console_log:Killing console logger for smithi149 2023-06-09T16:23:56.709 DEBUG:teuthology.task.console_log:Killing console logger for smithi184 2023-06-09T16:23:56.709 DEBUG:teuthology.exit:Finished running handlers